Trace number 308655

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMP? (TO) 1200.18 601.479

General information on the benchmark

Namerandom/2+p/p0.7/v5500/
unif2p-p0.7-v5500-c14685-S145970304-01-UNSAT.cnf
MD5SUMa9c69ac58ba32eb3b79077be89bd5498
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables5496
Number of clauses14684
Sum of the clauses size39647
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24405
Number of clauses of size 310279
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/308655-1172524439/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.00/0.02	c Input file : '/tmp/evaluation/308655-1172524439/instance-308655-1172524439.cnf'
0.00/0.02	c [#vars: 5500, #clauses: 14684 , (2-3)-CNF]
0.00/0.04	c unit clauses propagate before processing (#clause: 14684)
0.00/0.04	c estimated distribution: 8 tasks
0.00/0.08	c <16286> [PID]: 16288 16289 16290 16291 16292 16293 16294
0.10/0.66	c <16286> [PID]: 16295
0.10/0.66	c real distribution: 8 tasks
3.80/2.02	c <16286> [16289: UNSAT][16291: UNSAT][16290: UNSAT][16288: UNSAT][16292: NOT SOLVED]
1200.12/601.47	c <16286> [16293: NOT SOLVED][16295: NOT SOLVED][16294: NOT SOLVED]
1200.12/601.47	s NOT SOLVED
1200.12/601.47	c CPU time            : 70.090 seconds
1200.12/601.47	c Elapsed Time        : 601.451 seconds
1200.12/601.47	c Size of search tree : 0 node
1200.12/601.47	c average speed       : 0.000 nodes/sec.
1200.12/601.47	

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: NOT

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node18/watcher-308655-1172524439 -o ROOT/results/node18/solver-308655-1172524439 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/308655-1172524439/kcnfs-smp /tmp/evaluation/308655-1172524439/instance-308655-1172524439.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 16286
/proc/meminfo: memFree=1746096/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=180916 CPUtime=0
/proc/16286/stat : 16286 (kcnfs-smp) R 16284 16286 15094 0 -1 4194304 130 0 0 0 0 0 0 0 18 0 1 0 272398427 185257984 115 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/16286/statm: 45229 115 48 160 0 45067 0

[startup+0.10731 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 16286
/proc/meminfo: memFree=1746096/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.07
/proc/16286/stat : 16286 (kcnfs-smp) R 16284 16286 15094 0 -1 4194304 1196 0 0 0 7 0 0 0 20 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 183360

[startup+0.515348 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 16286
/proc/meminfo: memFree=1746096/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.08
/proc/16286/stat : 16286 (kcnfs-smp) R 16284 16286 15094 0 -1 4194304 1410 0 0 0 8 0 0 0 24 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639292 0 0 4096 0 0 0 0 17 0 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 183360

[startup+1.33743 s]
/proc/loadavg: 1.56 1.12 1.04 9/86 16295
/proc/meminfo: memFree=1738336/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.1
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1469 0 0 0 10 0 0 0 24 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16288] ppid=16286 vsize=183360 CPUtime=0.52
/proc/16288/stat : 16288 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 91 0 0 0 52 0 0 0 24 0 1 0 272398432 187760640 1078 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567399 0 0 4096 2 0 0 0 17 1 0 0
/proc/16288/statm: 45840 1078 68 160 0 45678 0
[pid=16289] ppid=16286 vsize=183360 CPUtime=0.41
/proc/16289/stat : 16289 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 95 0 0 0 41 0 0 0 24 0 1 0 272398433 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572850 0 0 4096 0 0 0 0 17 0 0 0
/proc/16289/statm: 45840 1085 71 160 0 45678 0
[pid=16290] ppid=16286 vsize=183360 CPUtime=0.34
/proc/16290/stat : 16290 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 34 0 0 0 24 0 1 0 272398437 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567239 0 0 4096 2 0 0 0 17 1 0 0
/proc/16290/statm: 45840 1085 71 160 0 45678 0
[pid=16291] ppid=16286 vsize=183360 CPUtime=0.32
/proc/16291/stat : 16291 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 93 0 0 0 32 0 0 0 25 0 1 0 272398441 187760640 1084 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683120 0 0 4096 0 0 0 0 17 1 0 0
/proc/16291/statm: 45840 1084 70 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=0.26
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 26 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134636699 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1085 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=0.3
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 30 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567500 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1085 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=0.21
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 87 0 0 0 21 0 0 0 25 0 1 0 272398487 187760640 1080 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567268 0 0 4096 2 0 0 0 17 0 0 0
/proc/16294/statm: 45840 1080 67 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=0.11
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 89 0 0 0 11 0 0 0 25 0 1 0 272398491 187760640 1082 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134675448 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1082 70 160 0 45678 0
Current children cumulated CPU time (s) 2.57
Current children cumulated vsize (KiB) 1650240

[startup+2.98959 s]
/proc/loadavg: 1.56 1.12 1.04 8/85 16295
/proc/meminfo: memFree=1738664/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.54
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 165 0 0 10 0 44 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16288] ppid=16286 vsize=183360 CPUtime=1.08
/proc/16288/stat : 16288 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 108 0 0 0 25 0 1 0 272398432 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683111 0 0 4096 2 0 0 0 17 1 0 0
/proc/16288/statm: 45840 1085 71 160 0 45678 0
[pid=16290] ppid=16286 vsize=183360 CPUtime=0.84
/proc/16290/stat : 16290 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 84 0 0 0 25 0 1 0 272398437 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572608 0 0 4096 2 0 0 0 17 1 0 0
/proc/16290/statm: 45840 1085 71 160 0 45678 0
[pid=16291] ppid=16286 vsize=0 CPUtime=0.37
/proc/16291/stat : 16291 (kcnfs-smp) R 16286 16286 15094 0 -1 4194372 163 0 0 0 37 0 0 0 25 0 1 0 272398441 0 0 18446744073709551615 0 0 0 0 0 0 2147483391 4096 0 0 0 0 17 1 0 0
/proc/16291/statm: 0 0 0 0 0 0 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=0.8
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 80 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567350 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1085 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=0.8
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 93 0 0 0 80 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572896 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1085 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=0.73
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 73 0 0 0 25 0 1 0 272398487 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572246 0 0 4096 2 0 0 0 17 0 0 0
/proc/16294/statm: 45840 1085 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=0.7
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 70 0 0 0 25 0 1 0 272398491 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134578439 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1085 71 160 0 45678 0
Current children cumulated CPU time (s) 5.86
Current children cumulated vsize (KiB) 1283520

[startup+6.1949 s]
/proc/loadavg: 1.56 1.12 1.04 7/84 16295
/proc/meminfo: memFree=1738672/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.91
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 328 0 0 10 0 81 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16288] ppid=16286 vsize=183360 CPUtime=2.12
/proc/16288/stat : 16288 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 212 0 0 0 25 0 1 0 272398432 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580071 0 0 4096 2 0 0 0 17 1 0 0
/proc/16288/statm: 45840 1085 71 160 0 45678 0
[pid=16290] ppid=16286 vsize=183360 CPUtime=1.94
/proc/16290/stat : 16290 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 194 0 0 0 25 0 1 0 272398437 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683038 0 0 4096 2 0 0 0 17 1 0 0
/proc/16290/statm: 45840 1085 71 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=1.87
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 187 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572748 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1085 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=1.9
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 190 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572254 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1085 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=1.82
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 182 0 0 0 25 0 1 0 272398487 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567517 0 0 4096 2 0 0 0 17 0 0 0
/proc/16294/statm: 45840 1085 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=1.71
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 92 0 0 0 171 0 0 0 25 0 1 0 272398491 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1085 71 160 0 45678 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 1283520

[startup+12.6715 s]
/proc/loadavg: 2.24 1.28 1.09 7/84 16295
/proc/meminfo: memFree=1738608/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.91
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 328 0 0 10 0 81 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16288] ppid=16286 vsize=183360 CPUtime=4.32
/proc/16288/stat : 16288 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 432 0 0 0 25 0 1 0 272398432 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567307 0 0 4096 2 0 0 0 17 1 0 0
/proc/16288/statm: 45840 1085 71 160 0 45678 0
[pid=16290] ppid=16286 vsize=183360 CPUtime=4.08
/proc/16290/stat : 16290 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 408 0 0 0 25 0 1 0 272398437 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567303 0 0 4096 2 0 0 0 17 1 0 0
/proc/16290/statm: 45840 1085 71 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=4
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 400 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580357 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1085 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=4.02
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 402 0 0 0 25 0 1 0 272398444 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572793 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1085 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=3.93
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 97 0 0 0 393 0 0 0 25 0 1 0 272398487 187760640 1086 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567283 0 0 4096 2 0 0 0 17 0 0 0
/proc/16294/statm: 45840 1086 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=3.91
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 391 0 0 0 25 0 1 0 272398491 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567466 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1085 71 160 0 45678 0
Current children cumulated CPU time (s) 25.17
Current children cumulated vsize (KiB) 1283520

[startup+25.5378 s]
/proc/loadavg: 2.82 1.43 1.14 7/84 16295
/proc/meminfo: memFree=1738608/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=0.91
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 328 0 0 10 0 81 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16288] ppid=16286 vsize=183360 CPUtime=8.62
/proc/16288/stat : 16288 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 862 0 0 0 25 0 1 0 272398432 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572683 0 0 4096 2 0 0 0 17 1 0 0
/proc/16288/statm: 45840 1085 71 160 0 45678 0
[pid=16290] ppid=16286 vsize=183360 CPUtime=8.34
/proc/16290/stat : 16290 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 834 0 0 0 25 0 1 0 272398437 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572621 0 0 4096 2 0 0 0 17 1 0 0
/proc/16290/statm: 45840 1085 71 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=8.3
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 97 0 0 0 830 0 0 0 25 0 1 0 272398444 187760640 1086 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579714 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1086 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=8.3
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 97 0 0 0 830 0 0 0 25 0 1 0 272398444 187760640 1086 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683127 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1086 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=8.23
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 97 0 0 0 823 0 0 0 25 0 1 0 272398487 187760640 1086 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580154 0 0 4096 2 0 0 0 17 0 0 0
/proc/16294/statm: 45840 1086 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=8.16
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 96 0 0 0 816 0 0 0 25 0 1 0 272398491 187760640 1085 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567508 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1085 71 160 0 45678 0
Current children cumulated CPU time (s) 50.86
Current children cumulated vsize (KiB) 1283520

[startup+51.1432 s]
/proc/loadavg: 3.45 1.72 1.25 5/82 16295
/proc/meminfo: memFree=1739456/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=21.2
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 97 0 0 0 2120 0 0 0 25 0 1 0 272398444 187760640 1086 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567505 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1086 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=19.74
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 1974 0 0 0 25 0 1 0 272398444 187760640 1087 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567210 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1087 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=19.71
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 1971 0 0 0 25 0 1 0 272398487 187760640 1087 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134636542 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1087 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=19.61
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 98 0 0 0 1961 0 0 0 25 0 1 0 272398491 187760640 1087 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1087 71 160 0 45678 0
Current children cumulated CPU time (s) 101.95

################
# More data... #
################

/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=106.88
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 10688 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567399 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=105.08
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 99 0 0 0 10508 0 0 0 25 0 1 0 272398444 187760640 1088 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1088 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=105.33
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 99 0 0 0 10532 1 0 0 25 0 1 0 272398487 187760640 1088 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567500 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1088 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=104.9
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 99 0 0 0 10490 0 0 0 25 0 1 0 272398491 187760640 1088 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572890 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1088 71 160 0 45678 0
Current children cumulated CPU time (s) 443.88
Current children cumulated vsize (KiB) 916800

[startup+282.521 s]
/proc/loadavg: 3.98 2.94 1.84 5/82 16295
/proc/meminfo: memFree=1739584/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=136.87
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 13687 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567426 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=134.95
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 13495 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567239 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=135.34
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 13533 1 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=134.79
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 99 0 0 0 13479 0 0 0 25 0 1 0 272398491 187760640 1088 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567521 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1088 71 160 0 45678 0
Current children cumulated CPU time (s) 563.64
Current children cumulated vsize (KiB) 916800

[startup+342.549 s]
/proc/loadavg: 3.99 3.13 1.97 5/82 16295
/proc/meminfo: memFree=1739648/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=166.87
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 16686 1 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134633623 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=164.83
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 16483 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683350 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=165.36
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 16535 1 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683111 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=164.69
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 16469 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567193 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 683.44
Current children cumulated vsize (KiB) 916800

[startup+402.579 s]
/proc/loadavg: 3.99 3.28 2.10 5/82 16295
/proc/meminfo: memFree=1739648/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=196.87
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 19686 1 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572850 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=194.72
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 19472 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572863 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=195.38
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 19537 1 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580256 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=194.58
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 19458 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567303 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 803.24
Current children cumulated vsize (KiB) 916800

[startup+462.61 s]
/proc/loadavg: 3.99 3.41 2.21 5/82 16295
/proc/meminfo: memFree=1739648/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=226.86
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 22685 1 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640585 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=224.58
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 22458 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=225.4
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 22538 2 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580041 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=224.48
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 22448 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567577 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 923.01
Current children cumulated vsize (KiB) 916800

[startup+522.639 s]
/proc/loadavg: 3.99 3.52 2.32 5/82 16295
/proc/meminfo: memFree=1739648/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=256.88
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 25686 2 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134573762 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=254.47
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 25447 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567641 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=255.4
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 25538 2 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572901 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=254.37
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 25437 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572608 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 1042.81
Current children cumulated vsize (KiB) 916800

[startup+582.668 s]
/proc/loadavg: 3.99 3.60 2.42 5/82 16295
/proc/meminfo: memFree=1739712/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=286.9
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 28688 2 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134633206 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=284.35
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 28435 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572623 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=285.39
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 28537 2 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567505 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=284.27
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 28427 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 1162.6
Current children cumulated vsize (KiB) 916800



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+601.47 s]
/proc/loadavg: 3.99 3.63 2.46 5/82 16295
/proc/meminfo: memFree=1739648/2055920 swapFree=4192812/4192956
[pid=16286] ppid=16284 vsize=183360 CPUtime=21.69
/proc/16286/stat : 16286 (kcnfs-smp) S 16284 16286 15094 0 -1 4194304 1470 662 0 0 10 0 2159 0 16 0 1 0 272398427 187760640 1068 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/16286/statm: 45840 1068 66 160 0 45678 0
[pid=16292] ppid=16286 vsize=183360 CPUtime=296.3
/proc/16292/stat : 16292 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 29628 2 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 2 0 0 0 17 1 0 0
/proc/16292/statm: 45840 1089 71 160 0 45678 0
[pid=16293] ppid=16286 vsize=183360 CPUtime=293.75
/proc/16293/stat : 16293 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 29375 0 0 0 25 0 1 0 272398444 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/16293/statm: 45840 1089 71 160 0 45678 0
[pid=16294] ppid=16286 vsize=183360 CPUtime=294.79
/proc/16294/stat : 16294 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 29477 2 0 0 25 0 1 0 272398487 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567303 0 0 4096 2 0 0 0 17 1 0 0
/proc/16294/statm: 45840 1089 71 160 0 45678 0
[pid=16295] ppid=16286 vsize=183360 CPUtime=293.59
/proc/16295/stat : 16295 (kcnfs-smp) R 16286 16286 15094 0 -1 4194368 100 0 0 0 29359 0 0 0 25 0 1 0 272398491 187760640 1089 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683195 0 0 4096 0 0 0 0 17 0 0 0
/proc/16295/statm: 45840 1089 71 160 0 45678 0
Current children cumulated CPU time (s) 1200.12
Current children cumulated vsize (KiB) 916800

Sending SIGTERM to process tree (bottom up)
SSolver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 601.479
CPU time (s): 1200.18
CPU user time (s): 1200.11
CPU system time (s): 0.06499
CPU usage (%): 199.538
Max. virtual memory (cumulated for all children) (KiB): 1650240

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1200.11
system time used= 0.06499
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2614
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 57
involuntary context switches= 34269

runsolver used 0.556915 second user time and 1.58176 second system time

The end

Launcher Data (download as text)

Begin job on node18 on Mon Feb 26 21:13:59 UTC 2007

IDJOB= 308655
IDBENCH= 20237
IDSOLVER= 112
FILE ID= node18/308655-1172524439

PBS_JOBID= 3971604

Free space on /tmp= 66554 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/random/2+p/p0.7/v5500/unif2p-p0.7-v5500-c14685-S145970304-01-UNSAT.cnf
COMMAND LINE= /tmp/evaluation/308655-1172524439/kcnfs-smp /tmp/evaluation/308655-1172524439/instance-308655-1172524439.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node18/watcher-308655-1172524439 -o ROOT/results/node18/solver-308655-1172524439 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/308655-1172524439/kcnfs-smp /tmp/evaluation/308655-1172524439/instance-308655-1172524439.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  a9c69ac58ba32eb3b79077be89bd5498

RANDOM SEED= 830184222

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node18.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1746568 kB
Buffers:         40272 kB
Cached:         155772 kB
SwapCached:          0 kB
Active:         216688 kB
Inactive:        39672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1746568 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3376 kB
Writeback:           0 kB
Mapped:          79224 kB
Slab:            38680 kB
Committed_AS:   934920 kB
PageTables:       1672 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66554 MiB

End job on node18 on Mon Feb 26 21:24:00 UTC 2007