Trace number 309639

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMPSAT 107.59 53.9712

General information on the benchmark

Namerandom/2+p/p0.9/v810/
unif2p-p0.9-v810-c2932-S1678549664-11-SAT.cnf
MD5SUM597b7f6fd53d553e7db789a34606fe09
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.033994
Satisfiable
(Un)Satisfiability was proved
Number of variables810
Number of clauses2931
Sum of the clauses size8500
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2293
Number of clauses of size 32638
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/309639-1172545029/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.00/0.00	c Input file : '/tmp/evaluation/309639-1172545029/instance-309639-1172545029.cnf'
0.00/0.00	c [#vars: 810, #clauses: 2931 , (2-3)-CNF]
0.00/0.00	c unit clauses propagate before processing (#clause: 2931)
0.00/0.00	c estimated distribution: 8 tasks
0.00/0.05	c <18535> [PID]: 18537 18538 18539 18540 18541 18542 18543
0.00/0.53	c <18535> [PID]: 18544
0.00/0.53	c real distribution: 8 tasks
107.40/53.95	c <18535> [18537: SAT]
107.40/53.95	c <18535> [END]: 18538 18539 18540 18541 18542 18543 18544
107.40/53.95	s SATISFIABLE
107.40/53.95	v        1       -2       -3        4        5       -6        7
107.40/53.95	v        8       -9       10      -11       12       13      -14
107.40/53.95	v      -15       16      -17       18       19      -20      -21
107.40/53.95	v       22       23       24      -25      -26      -27      -28
107.40/53.95	v       29       30      -31      -32       33       34       35
107.40/53.95	v       36      -37      -38       39      -40       41       42
107.40/53.95	v       43      -44       45      -46      -47       48      -49
107.40/53.95	v       50      -51       52       53       54      -55       57
107.40/53.95	v      -58      -59       60      -61       62      -63       64
107.40/53.95	v       65      -66      -67       68      -69      -70      -71
107.40/53.95	v      -72       73      -74       75       76      -77      -79
107.40/53.95	v       80      -81      -82       83      -84      -85       86
107.40/53.95	v      -87      -88       89      -90      -91       92      -93
107.40/53.95	v      -94      -95       96       97      -98       99      100
107.40/53.95	v     -101     -102      103     -104     -105     -106      107
107.40/53.95	v      108     -109      110      111     -112     -113     -114
107.40/53.95	v     -115     -116      117      118     -119      120     -121
107.40/53.95	v     -122     -123     -124      125      126     -127     -128
107.40/53.95	v      129     -130     -131     -132      133     -134     -135
107.40/53.95	v      136      137     -138      139      140     -141     -142
107.40/53.95	v     -143      144      145      146      147     -148      149
107.40/53.95	v     -150      151     -152     -153     -154     -155      156
107.40/53.95	v      157      158      159     -160     -161     -162     -163
107.40/53.95	v     -164      165      166     -167      168     -169      170
107.40/53.95	v      171     -172      173      174      175      176      177
107.40/53.95	v      178      179      180     -181      182      183     -184
107.40/53.95	v      185     -186     -187      188     -189      190      191
107.40/53.95	v     -192      193      194     -195      196     -197     -198
107.40/53.95	v     -199     -200     -201     -202      203      204      205
107.40/53.95	v     -206     -207      208      209      210     -211      212
107.40/53.95	v      213     -214     -215      216      217     -218      219
107.40/53.95	v     -220      221      222      223      224     -225      226
107.40/53.95	v      227      228      229     -230     -231     -232      233
107.40/53.95	v     -234      235      236     -237      238      239      240
107.40/53.95	v     -241      242     -243     -244      245      246      247
107.40/53.95	v     -248     -249      250      251      252     -253     -254
107.40/53.95	v      255     -256      257      258      259     -260     -261
107.40/53.95	v      262     -263     -264      265     -266      267      268
107.40/53.95	v      269     -270     -271     -272      273     -274     -275
107.40/53.95	v     -276      277      278      279     -280     -281      282
107.40/53.95	v      283     -284     -285     -286      287     -288      289
107.40/53.95	v      290      291      292      293      294     -295      296
107.40/53.95	v      297      298      299     -300      301      302      303
107.40/53.95	v      304      305      306     -307     -308      309      310
107.40/53.95	v      311      312     -313      314     -315     -316     -317
107.40/53.95	v     -318     -319      320     -321      322     -323      324
107.40/53.95	v     -325     -326     -327      328     -329      330      331
107.40/53.95	v     -332     -333      334      335     -336      337     -338
107.40/53.95	v      339     -340      341      342      343     -344      345
107.40/53.95	v      346     -347      348      349      350     -351      352
107.40/53.95	v      353     -354     -355     -356     -357     -358     -359
107.40/53.95	v     -360     -361     -362      363      364     -365     -366
107.40/53.95	v      367      368     -369      370     -371     -372      373
107.40/53.95	v     -374      375     -376      377      378      379      380
107.40/53.95	v      381     -382      383      384     -385      386      387
107.40/53.95	v     -388     -389     -390     -391      392     -393      394
107.40/53.95	v     -395     -396     -397      398     -399     -400     -401
107.40/53.95	v     -402     -403     -404      405     -406     -407      408
107.40/53.95	v     -409      410     -411     -412     -413      414     -415
107.40/53.95	v      416     -417     -418      419     -420      421      422
107.40/53.95	v     -423     -424      425     -426      427     -428      429
107.40/53.95	v     -430      431      432     -433     -434      435     -436
107.59/53.97	v     -437     -438     -439     -440      441     -442     -443
107.59/53.97	v     -444     -445     -446     -447     -448      449     -450
107.59/53.97	v     -451     -452      453     -454     -455      456      457
107.59/53.97	v     -458      459      460      461      462     -463      464
107.59/53.97	v      465      466     -467     -468      469      470      471
107.59/53.97	v      472      473      474      475      476     -477     -478
107.59/53.97	v     -479     -480      481     -482     -483     -484      485
107.59/53.97	v      486      487      488     -489      490     -491      492
107.59/53.97	v      493     -494      495      496     -497      498      499
107.59/53.97	v      500     -501      502      503     -504      505     -506
107.59/53.97	v      507     -508     -509      510     -511     -512     -513
107.59/53.97	v     -514      515      516     -517     -518      519     -520
107.59/53.97	v      521      522      523     -524     -525      526     -527
107.59/53.97	v      528      529     -530     -531      532     -533      534
107.59/53.97	v      535     -536      537      538     -539      540      541
107.59/53.97	v      542     -543      544      545      546      547     -548
107.59/53.97	v      549     -550      551      552     -553      554      555
107.59/53.97	v      556      557     -558     -559     -560     -561      562
107.59/53.97	v      563      564      565     -566      567     -568     -569
107.59/53.97	v      570      571      572     -573     -574     -575      576
107.59/53.97	v      577      578      579     -580      581     -582      583
107.59/53.97	v      584      585     -586      587     -588     -589      590
107.59/53.97	v      591      592      593      594      595     -596     -597
107.59/53.97	v     -598     -599      600      601     -602     -603      604
107.59/53.97	v     -605     -606      607     -608      609     -610      611
107.59/53.97	v      612      613      614     -615     -616      617      618
107.59/53.97	v     -619      620     -621     -622     -623     -624     -625
107.59/53.97	v     -626      627      628      629     -630      631      632
107.59/53.97	v     -633     -634      635     -636      637      638      639
107.59/53.97	v     -640     -641      642     -643     -644     -645      646
107.59/53.97	v      647      648      649     -650      651      652      653
107.59/53.97	v      654      655     -656      657     -658      659     -660
107.59/53.97	v      661      662     -663      664     -665      666      667
107.59/53.97	v      668     -669     -670     -671      672      673      674
107.59/53.97	v      675     -676      677     -678      679     -680      681
107.59/53.97	v      682     -683      684      685     -686      687     -688
107.59/53.97	v      689      690     -691     -692     -693     -694     -695
107.59/53.97	v     -696     -697      698      699     -700      701      702
107.59/53.97	v      703      704      705      706     -707     -708     -709
107.59/53.97	v      710      711     -712     -713      714      715      716
107.59/53.97	v     -717      718      719      720      721     -722     -723
107.59/53.97	v     -724      725     -726     -727      728      729      730
107.59/53.97	v      731     -732      733     -734     -735      736      737
107.59/53.97	v      738      739     -740     -741     -742      743      744
107.59/53.97	v     -745     -746      747     -748      749     -750     -751
107.59/53.97	v     -752      753      754      755     -756      757      758
107.59/53.97	v      759      760      761     -762      763      764     -765
107.59/53.97	v      766     -767     -768      769     -770      771      772
107.59/53.97	v      773     -774      775     -776     -777     -778      779
107.59/53.97	v      780      781      782     -783     -784     -785     -786
107.59/53.97	v     -787      788      789     -790      791      792     -793
107.59/53.97	v     -794     -795     -796      797      798      799     -800
107.59/53.97	v      801     -802      803      804     -805      806     -807
107.59/53.97	v      808      809     -810        0
107.59/53.97	c CPU time            : 13.730 seconds
107.59/53.97	c Elapsed Time        : 53.948 seconds
107.59/53.97	c Size of search tree : 15671 nodes
107.59/53.97	c average speed       : 1141.369 nodes/sec.
107.59/53.97	

Verifier Data (download as text)

OK

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node18/watcher-309639-1172545029 -o ROOT/results/node18/solver-309639-1172545029 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/309639-1172545029/kcnfs-smp /tmp/evaluation/309639-1172545029/instance-309639-1172545029.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 1.06 1.17 3/77 18535
/proc/meminfo: memFree=1727288/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=180916 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) R 18533 18535 18019 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 274457527 185257984 117 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/18535/statm: 45229 117 48 160 0 45067 0

[startup+0.107591 s]
/proc/loadavg: 0.92 1.06 1.17 3/77 18535
/proc/meminfo: memFree=1727288/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) R 18533 18535 18019 0 -1 4194304 464 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 294 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639211 0 0 4096 0 0 0 0 17 0 0 0
/proc/18535/statm: 45411 294 64 160 0 45249 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 181644

[startup+0.516631 s]
/proc/loadavg: 0.92 1.06 1.17 3/77 18535
/proc/meminfo: memFree=1727288/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) R 18533 18535 18019 0 -1 4194304 485 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 181644

[startup+1.34571 s]
/proc/loadavg: 0.92 1.06 1.17 9/86 18544
/proc/meminfo: memFree=1724272/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=0.54
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 54 0 0 0 24 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577101 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=0.42
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 42 0 0 0 24 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683204 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=0.31
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 31 0 0 0 24 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683216 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=0.39
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 39 0 0 0 24 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572638 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=0.3
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 30 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577666 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=0.3
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 30 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=0.24
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 24 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134674464 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=0.13
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 13 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580317 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 2.63
Current children cumulated vsize (KiB) 1634796

[startup+2.98287 s]
/proc/loadavg: 0.92 1.06 1.17 9/86 18544
/proc/meminfo: memFree=1724080/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=0.94
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 94 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567239 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=0.82
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 82 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134603272 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=0.73
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 73 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572099 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=0.8
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 80 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134589640 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=0.7
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 70 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572834 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=0.7
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 70 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572608 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=0.64
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 64 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683132 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=0.56
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 56 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683143 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 1634796

[startup+6.27519 s]
/proc/loadavg: 1.49 1.18 1.20 9/86 18544
/proc/meminfo: memFree=1723888/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=1.76
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 176 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134593190 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=1.62
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 162 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579723 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=1.61
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 161 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567517 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=1.6
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 160 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134628417 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=1.52
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 152 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134628990 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=1.5
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 150 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577417 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=1.44
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 144 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577596 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=1.42
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 142 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572704 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 12.47
Current children cumulated vsize (KiB) 1634796

[startup+12.7638 s]
/proc/loadavg: 2.01 1.29 1.24 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=3.44
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 344 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580054 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=3.22
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 322 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134591580 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=3.21
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 321 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134601201 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=3.2
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 320 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572793 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=3.17
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 317 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134601201 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=3.1
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 310 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577666 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=3.04
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 304 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572623 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=3.02
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 302 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579727 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 1634796

[startup+25.6471 s]
/proc/loadavg: 3.33 1.62 1.35 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=6.64
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 664 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134603435 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=6.5
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 650 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=6.41
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 641 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567426 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=6.4
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 640 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134595520 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=6.4
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 640 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134634356 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=6.31
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 631 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134682982 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=6.24
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 624 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134597608 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=6.22
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 622 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577686 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 51.12
Current children cumulated vsize (KiB) 1634796

[startup+51.2925 s]
/proc/loadavg: 4.93 2.13 1.52 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=13.04
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1304 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134635508 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=12.92
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1292 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=12.8
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1280 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567193 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=12.83
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1283 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683578 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=12.74
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1274 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567453 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=12.69
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1269 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567268 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=12.64
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1264 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577451 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=12.62
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1262 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577634 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1634796

Solver just ended. Dumping a history of the last processes samples

[startup+52.7397 s]
/proc/loadavg: 4.93 2.13 1.52 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=13.42
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1342 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579714 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=13.21
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1321 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577061 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=13.2
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1320 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134598872 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=13.2
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1320 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134595418 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=13.09
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1309 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572863 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=13.09
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1309 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567399 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=13.03
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1303 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134569531 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=12.92
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1292 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577530 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 105.16
Current children cumulated vsize (KiB) 1634796

[startup+53.5598 s]
/proc/loadavg: 4.93 2.13 1.52 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=181644 CPUtime=0
/proc/18535/stat : 18535 (kcnfs-smp) S 18533 18535 18019 0 -1 4194304 495 0 0 0 0 0 0 0 24 0 1 0 274457527 186003456 295 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18535/statm: 45411 295 65 160 0 45249 0
[pid=18537] ppid=18535 vsize=181644 CPUtime=13.64
/proc/18537/stat : 18537 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1364 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580071 0 0 4096 2 0 0 0 17 1 0 0
/proc/18537/statm: 45411 308 71 160 0 45249 0
[pid=18538] ppid=18535 vsize=181644 CPUtime=13.41
/proc/18538/stat : 18538 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1341 0 0 0 25 0 1 0 274457528 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577417 0 0 4096 0 0 0 0 17 1 0 0
/proc/18538/statm: 45411 308 71 160 0 45249 0
[pid=18539] ppid=18535 vsize=181644 CPUtime=13.4
/proc/18539/stat : 18539 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1340 0 0 0 25 0 1 0 274457530 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580349 0 0 4096 2 0 0 0 17 1 0 0
/proc/18539/statm: 45411 308 71 160 0 45249 0
[pid=18540] ppid=18535 vsize=181644 CPUtime=13.4
/proc/18540/stat : 18540 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1340 0 0 0 25 0 1 0 274457531 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580075 0 0 4096 0 0 0 0 17 1 0 0
/proc/18540/statm: 45411 308 71 160 0 45249 0
[pid=18541] ppid=18535 vsize=181644 CPUtime=13.29
/proc/18541/stat : 18541 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1329 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572846 0 0 4096 2 0 0 0 17 0 0 0
/proc/18541/statm: 45411 308 71 160 0 45249 0
[pid=18542] ppid=18535 vsize=181644 CPUtime=13.29
/proc/18542/stat : 18542 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 46 0 0 0 1329 0 0 0 25 0 1 0 274457532 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134674464 0 0 4096 0 0 0 0 17 0 0 0
/proc/18542/statm: 45411 308 71 160 0 45249 0
[pid=18543] ppid=18535 vsize=181644 CPUtime=13.24
/proc/18543/stat : 18543 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1324 0 0 0 25 0 1 0 274457573 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579676 0 0 4096 2 0 0 0 17 0 0 0
/proc/18543/statm: 45411 308 71 160 0 45249 0
[pid=18544] ppid=18535 vsize=181644 CPUtime=13.12
/proc/18544/stat : 18544 (kcnfs-smp) R 18535 18535 18019 0 -1 4194368 44 0 0 0 1312 0 0 0 25 0 1 0 274457578 186003456 308 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577634 0 0 4096 0 0 0 0 17 0 0 0
/proc/18544/statm: 45411 308 71 160 0 45249 0
Current children cumulated CPU time (s) 106.79
Current children cumulated vsize (KiB) 1634796

[startup+53.9678 s]
/proc/loadavg: 4.93 2.13 1.52 9/86 18544
/proc/meminfo: memFree=1723760/2055920 swapFree=4192812/4192956
[pid=18535] ppid=18533 vsize=0 CPUtime=13.73
/proc/18535/stat : 18535 (kcnfs-smp) D 18533 18535 18019 0 -1 4194308 525 69 0 0 0 0 1373 0 18 0 1 0 274457527 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744072100051646 0 0 17 1 0 0
/proc/18535/statm: 0 0 0 0 0 0 0
[pid=18538] ppid=18535 vsize=0 CPUtime=13.52
/proc/18538/stat : 18538 (kcnfs-smp) Z 18535 18535 18019 0 -1 4195404 46 0 0 0 1352 0 0 0 25 0 1 0 274457528 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744071563351923 0 0 17 1 0 0
/proc/18538/statm: 0 0 0 0 0 0 0
[pid=18539] ppid=18535 vsize=0 CPUtime=13.5
/proc/18539/stat : 18539 (kcnfs-smp) D 18535 18535 18019 0 -1 4194372 49 0 0 0 1350 0 0 0 25 0 1 0 274457530 0 0 18446744073709551615 0 0 0 0 0 0 2 4096 2 18446744072100051646 0 0 17 0 0 0
/proc/18539/statm: 0 0 0 0 0 0 0
[pid=18540] ppid=18535 vsize=0 CPUtime=13.5
/proc/18540/stat : 18540 (kcnfs-smp) Z 18535 18535 18019 0 -1 4195404 46 0 0 0 1350 0 0 0 24 0 1 0 274457531 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744071563351923 0 0 17 0 0 0
/proc/18540/statm: 0 0 0 0 0 0 0
[pid=18541] ppid=18535 vsize=0 CPUtime=13.39
/proc/18541/stat : 18541 (kcnfs-smp) D 18535 18535 18019 0 -1 4194372 49 0 0 0 1339 0 0 0 25 0 1 0 274457532 0 0 18446744073709551615 0 0 0 0 0 0 2 4096 2 18446744072100051646 0 0 17 0 0 0
/proc/18541/statm: 0 0 0 0 0 0 0
[pid=18542] ppid=18535 vsize=0 CPUtime=13.39
/proc/18542/stat : 18542 (kcnfs-smp) D 18535 18535 18019 0 -1 4195396 46 0 0 0 1339 0 0 0 25 0 1 0 274457532 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744072100051646 0 0 17 0 0 0
/proc/18542/statm: 0 0 0 0 0 0 0
[pid=18543] ppid=18535 vsize=0 CPUtime=13.34
/proc/18543/stat : 18543 (kcnfs-smp) D 18535 18535 18019 0 -1 4194372 47 0 0 0 1334 0 0 0 25 0 1 0 274457573 0 0 18446744073709551615 0 0 0 0 0 0 2 4096 2 18446744072100051646 0 0 17 0 0 0
/proc/18543/statm: 0 0 0 0 0 0 0
[pid=18544] ppid=18535 vsize=0 CPUtime=13.22
/proc/18544/stat : 18544 (kcnfs-smp) D 18535 18535 18019 0 -1 4195396 44 0 0 0 1322 0 0 0 25 0 1 0 274457578 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744072100051646 0 0 17 0 0 0
/proc/18544/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 107.59
Current children cumulated vsize (KiB) 0

Child status: 10

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 18535 and gives childrusage.ru_utime.tv_sec=13 childrusage.ru_utime.tv_usec=740911 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=2999
CPU time returned by wait4() is 13.7439
while last known CPU time is 107.59

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 53.9712
CPU time (s): 107.59
CPU user time (s): 107.59
CPU system time (s): 0
CPU usage (%): 199.347
Max. virtual memory (cumulated for all children) (KiB): 1634796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13.7409
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 594
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 158

runsolver used 0.06099 second user time and 0.141978 second system time

The end

Launcher Data (download as text)

Begin job on node18 on Tue Feb 27 02:57:10 UTC 2007

IDJOB= 309639
IDBENCH= 20265
IDSOLVER= 112
FILE ID= node18/309639-1172545029

PBS_JOBID= 3971647

Free space on /tmp= 66555 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/random/2+p/p0.9/v810/unif2p-p0.9-v810-c2932-S1678549664-11-SAT.cnf
COMMAND LINE= /tmp/evaluation/309639-1172545029/kcnfs-smp /tmp/evaluation/309639-1172545029/instance-309639-1172545029.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node18/watcher-309639-1172545029 -o ROOT/results/node18/solver-309639-1172545029 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/309639-1172545029/kcnfs-smp /tmp/evaluation/309639-1172545029/instance-309639-1172545029.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  597b7f6fd53d553e7db789a34606fe09

RANDOM SEED= 850713797

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node18.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1727760 kB
Buffers:         40872 kB
Cached:         174280 kB
SwapCached:          0 kB
Active:         228216 kB
Inactive:        46616 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1727760 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3336 kB
Writeback:           0 kB
Mapped:          78540 kB
Slab:            38944 kB
Committed_AS:   947044 kB
PageTables:       1668 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66555 MiB

End job on node18 on Tue Feb 27 02:58:04 UTC 2007