Trace number 309434

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMPSAT 12.27 6.27523

General information on the benchmark

Namerandom/2+p/p0.9/v990/
unif2p-p0.9-v990-c3583-S592344929-16-SAT.cnf
MD5SUM4f1fdd7886037e39bdc6f3becce96722
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.040993
Satisfiable
(Un)Satisfiability was proved
Number of variables990
Number of clauses3582
Sum of the clauses size10388
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2358
Number of clauses of size 33224
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/309434-1172541339/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.00/0.00	c Input file : '/tmp/evaluation/309434-1172541339/instance-309434-1172541339.cnf'
0.00/0.00	c [#vars: 990, #clauses: 3582 , (2-3)-CNF]
0.00/0.01	c unit clauses propagate before processing (#clause: 3582)
0.00/0.01	c estimated distribution: 8 tasks
0.00/0.02	c <20307> [PID]: 20309 20310 20311 20312 20313 20314 20315
0.00/0.31	c <20307> [PID]: 20316
0.00/0.31	c real distribution: 8 tasks
12.27/6.26	c <20307> [20310: SAT]
12.27/6.26	c <20307> [END]: 20309 20311 20312 20313 20314 20315 20316
12.27/6.26	s SATISFIABLE
12.27/6.26	v       -1       -2       -3        4        5       -6        7
12.27/6.26	v        8        9       10      -11       12      -13       14
12.27/6.26	v      -15      -16      -17       18      -19       20       21
12.27/6.26	v       22       23      -24       25      -26      -27      -28
12.27/6.26	v       29      -30      -31       32       33       34       35
12.27/6.26	v      -36      -37       38      -39      -40       41       42
12.27/6.26	v      -43       44       45      -46      -47       48       49
12.27/6.26	v      -50      -51      -52       53       54      -55      -56
12.27/6.26	v       57      -58      -59       60      -61       62      -63
12.27/6.26	v      -64       65       66       67       68       69      -70
12.27/6.26	v       71      -72      -73       74      -75       76      -77
12.27/6.26	v      -78       79       80      -81       82       83      -84
12.27/6.26	v      -85      -86      -87       88       89      -90      -91
12.27/6.26	v      -92       93       94       95       96      -97      -98
12.27/6.26	v       99     -100     -101     -102     -103     -104      105
12.27/6.26	v     -106      107     -108     -109      110      111      112
12.27/6.26	v      113      114     -115      116      117      118     -119
12.27/6.26	v      120     -121      122     -123     -124      125      126
12.27/6.26	v      127     -128      129      130     -131      132      133
12.27/6.26	v     -134      135      136      137     -138     -139      140
12.27/6.26	v     -141     -142      143     -144     -145      146     -147
12.27/6.26	v      148      149      150      151      152     -153      154
12.27/6.26	v      155      156      157      158     -159     -160      161
12.27/6.26	v     -162      163      164     -165     -166     -167     -168
12.27/6.26	v      169     -170     -171      172     -173      174     -175
12.27/6.26	v     -176     -177      178      179      180     -181     -182
12.27/6.26	v     -183     -184     -185     -186     -187      188     -189
12.27/6.26	v      190     -191      192     -193     -194      195     -196
12.27/6.26	v     -197     -198      199     -200     -201      202     -203
12.27/6.26	v      204     -205      206     -207      208      209      210
12.27/6.26	v     -211      212      213     -214      215     -216     -217
12.27/6.26	v      218      219      220      221      222     -223      224
12.27/6.26	v     -225     -226     -227      228      229      230      231
12.27/6.26	v      232     -233     -234      235      236     -237      238
12.27/6.26	v     -239      240     -241      242      243     -244      245
12.27/6.26	v      246      247      248      249      250      251      252
12.27/6.26	v     -253     -254      255     -256      257      258      259
12.27/6.26	v     -260     -261     -262      263     -264     -265     -266
12.27/6.26	v      267      268     -269      270      271      272      273
12.27/6.26	v      274     -275      276      277     -278      279      280
12.27/6.26	v     -281     -282      283     -284      285      286     -287
12.27/6.26	v      288      289      290     -291      292      293     -294
12.27/6.26	v      295      296      297     -298     -299     -300      301
12.27/6.26	v     -302     -303      304      305      306      307     -308
12.27/6.26	v     -309     -310      311     -312     -313      314      315
12.27/6.26	v      316     -317      318     -319      320      321     -322
12.27/6.26	v      323     -324      325     -326      327      328      329
12.27/6.26	v      330     -331      332      333     -334      335      336
12.27/6.26	v      337     -338     -339      340      341      342     -343
12.27/6.26	v     -344     -345      346      347     -348      349     -350
12.27/6.26	v     -351     -352     -353      354     -355     -356     -357
12.27/6.26	v     -358     -359     -360     -361      362      363     -364
12.27/6.26	v      365     -366      367     -368     -369      370     -371
12.27/6.26	v     -372     -373      374     -375      376      377      378
12.27/6.26	v     -379      380      381      382     -383     -384     -385
12.27/6.26	v     -386      387     -388     -389     -390     -391      392
12.27/6.26	v      393     -394     -395      396      397     -398      399
12.27/6.26	v      400      401     -402      403     -404      405     -406
12.27/6.26	v     -407     -408     -409     -410      411     -412      413
12.27/6.26	v     -414      415      416     -417      418      419      420
12.27/6.26	v      421     -422      423     -424      425     -426     -427
12.27/6.26	v     -428     -429     -430     -431      432      433      434
12.27/6.26	v     -435      436     -437      438      439      440      441
12.27/6.26	v      442      443     -444      445     -446      447     -448
12.27/6.26	v      449      450      451     -452      453      454     -455
12.27/6.26	v     -456      457      458     -459     -460      461     -462
12.27/6.26	v     -463      464      465     -466      467      468     -469
12.27/6.26	v     -470     -471     -472     -473      474      475     -476
12.27/6.26	v     -477      478      479     -480      481     -482      483
12.27/6.26	v     -484     -485     -486     -487      488     -489     -490
12.27/6.26	v     -491     -492     -493     -494      495     -496      497
12.27/6.26	v      498     -499      500      501     -502     -503      504
12.27/6.26	v      505     -506      507     -508      509     -510     -511
12.27/6.26	v      512      513      514     -515      516     -517      518
12.27/6.26	v      519     -520      521     -522      523     -524     -525
12.27/6.26	v      526      527      528      529      530     -531      532
12.27/6.26	v      533      534     -535      536     -537     -538      539
12.27/6.26	v     -540      541      542      543     -544     -545     -546
12.27/6.26	v     -547     -548      549      550      551      552     -553
12.27/6.27	v      554      555      556      557      558      559     -560
12.27/6.27	v      561      562     -563      564     -565      566      567
12.27/6.27	v     -568      569      570     -571      572      573     -574
12.27/6.27	v      575      576      577     -578     -579      580      581
12.27/6.27	v      582      583     -584     -585     -586     -587      588
12.27/6.27	v      589      590     -591     -592      593      594     -595
12.27/6.27	v      596      597     -598      599     -600     -601     -602
12.27/6.27	v     -603      604      605      606     -607     -608      609
12.27/6.27	v     -610     -611      612      613      614      615      616
12.27/6.27	v      617     -618     -619     -620      621      622      623
12.27/6.27	v      624      625     -626     -627     -628     -629      630
12.27/6.27	v      631     -632      633     -634     -635     -636      637
12.27/6.27	v     -638      639     -640     -641     -642     -643     -644
12.27/6.27	v      645     -646      647     -648     -649      650      651
12.27/6.27	v     -652     -653     -654      655      656     -657     -658
12.27/6.27	v      659      660      661      662      663     -664      665
12.27/6.27	v     -666     -667     -668     -669      670     -671     -672
12.27/6.27	v     -673     -674     -675      676     -677     -678      679
12.27/6.27	v      680     -681      682     -683      684     -685      686
12.27/6.27	v     -687     -688     -689      690      691     -692      693
12.27/6.27	v      694      695      696     -697     -698      699      700
12.27/6.27	v      701      702      703      704      705      706      707
12.27/6.27	v     -708     -709     -710      711     -712      713     -714
12.27/6.27	v     -715     -716     -717     -718      719      720      721
12.27/6.27	v     -722     -723      724     -725      726      727     -728
12.27/6.27	v      729     -730      731      732      733      734      735
12.27/6.27	v      736     -737     -738      739      740      741     -742
12.27/6.27	v      743     -744     -745      746     -747     -748     -749
12.27/6.27	v     -750      751     -752     -753      754      755      756
12.27/6.27	v     -757     -758     -759      760     -761      762      763
12.27/6.27	v     -764     -765     -766      767      768      769      770
12.27/6.27	v     -771      772     -773     -774      775     -776     -777
12.27/6.27	v      778     -779     -780      781      782     -783      784
12.27/6.27	v      785      786      787      788     -789      790      791
12.27/6.27	v     -792      793      794      795     -796      797      798
12.27/6.27	v      799      800      801      802      803     -804      805
12.27/6.27	v     -806     -807     -808      809     -810     -811      812
12.27/6.27	v      813     -814      815      816      817      818     -819
12.27/6.27	v     -820      821      822      823      824      825      826
12.27/6.27	v      827     -828      829     -830      831     -832      833
12.27/6.27	v      834     -835     -836     -837     -838     -839     -840
12.27/6.27	v     -841     -842     -843     -844     -845     -846      847
12.27/6.27	v      848      849      850      851      852     -853      854
12.27/6.27	v     -855     -856      857     -858      859      860      861
12.27/6.27	v     -862      863     -864     -865      866      867      868
12.27/6.27	v      869     -870     -871     -872     -873      874     -875
12.27/6.27	v      876     -877     -878      879     -880      881      882
12.27/6.27	v     -883      884      885     -886     -887     -888      889
12.27/6.27	v      890      891      892      893     -894     -895     -896
12.27/6.27	v     -897      898     -899      900     -901      902     -903
12.27/6.27	v      904     -905      906     -907     -908     -909     -910
12.27/6.27	v      911     -912     -913     -914     -915     -916      917
12.27/6.27	v      918      919      920     -921      922     -923      924
12.27/6.27	v     -925      926      927      928      929      930     -931
12.27/6.27	v      932     -933     -934     -935     -936      937      938
12.27/6.27	v      939     -940     -941      942     -943      944      945
12.27/6.27	v     -946     -947     -948     -949     -950     -951      952
12.27/6.27	v      953     -954      955     -956      957     -958     -959
12.27/6.27	v      960      961     -962     -963      964      965      966
12.27/6.27	v      967      968      969     -970      971     -972     -973
12.27/6.27	v      974     -975     -976      977     -978      979      980
12.27/6.27	v      981     -982      983     -984     -985      986     -987
12.27/6.27	v      988     -989     -990        0
12.27/6.27	c CPU time            : 1.140 seconds
12.27/6.27	c Elapsed Time        : 6.260 seconds
12.27/6.27	c Size of search tree : 1150 nodes
12.27/6.27	c average speed       : 1008.772 nodes/sec.
12.27/6.27

Verifier Data (download as text)

OK

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node15/watcher-309434-1172541339 -o ROOT/results/node15/solver-309434-1172541339 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/309434-1172541339/kcnfs-smp /tmp/evaluation/309434-1172541339/instance-309434-1172541339.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.85 0.97 0.99 3/77 20307
/proc/meminfo: memFree=1580800/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=180916 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) R 20305 20307 20199 0 -1 4194304 129 0 0 0 0 0 0 0 18 0 1 0 274088288 185257984 114 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/20307/statm: 45229 115 48 160 0 45067 0

[startup+0.107566 s]
/proc/loadavg: 0.85 0.97 0.99 3/77 20307
/proc/meminfo: memFree=1580800/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) R 20305 20307 20199 0 -1 4194304 425 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 335 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/20307/statm: 45444 335 63 160 0 45282 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 181776

[startup+0.519606 s]
/proc/loadavg: 0.85 0.97 0.99 3/77 20307
/proc/meminfo: memFree=1580800/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 181776

[startup+1.34074 s]
/proc/loadavg: 0.85 0.97 0.99 9/86 20316
/proc/meminfo: memFree=1577464/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=0.5
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 50 0 0 0 24 0 1 0 274088289 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580041 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 351 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=181776 CPUtime=0.4
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 40 0 0 0 24 0 1 0 274088290 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567437 0 0 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 45444 352 71 160 0 45282 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=0.4
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 40 0 0 0 25 0 1 0 274088290 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567534 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 350 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=0.22
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 22 0 0 0 24 0 1 0 274088290 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572629 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 350 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=0.34
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 34 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580054 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=0.32
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 32 0 0 0 25 0 1 0 274088315 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134581904 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 350 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=0.23
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 48 0 0 0 23 0 0 0 25 0 1 0 274088318 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134597681 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 350 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=0.2
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 48 0 0 0 20 0 0 0 25 0 1 0 274088319 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683266 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 350 71 160 0 45282 0
Current children cumulated CPU time (s) 2.61
Current children cumulated vsize (KiB) 1635984

[startup+2.98202 s]
/proc/loadavg: 0.85 0.97 0.99 9/86 20316
/proc/meminfo: memFree=1577272/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=0.9
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 90 0 0 0 25 0 1 0 274088289 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577666 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 351 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=181776 CPUtime=0.8
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 80 0 0 0 25 0 1 0 274088290 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 45444 352 71 160 0 45282 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=0.8
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 80 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134633359 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 351 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=0.66
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 66 0 0 0 25 0 1 0 274088290 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579737 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 350 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=0.74
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 74 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572912 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=0.72
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 72 0 0 0 25 0 1 0 274088315 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572631 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 351 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=0.66
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 66 0 0 0 25 0 1 0 274088318 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572890 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 351 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=0.6
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 48 0 0 0 60 0 0 0 25 0 1 0 274088319 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572832 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 350 71 160 0 45282 0
Current children cumulated CPU time (s) 5.88
Current children cumulated vsize (KiB) 1635984

Solver just ended. Dumping a history of the last processes samples

[startup+3.29107 s]
/proc/loadavg: 0.85 0.97 0.99 9/86 20316
/proc/meminfo: memFree=1577272/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=1
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 100 0 0 0 25 0 1 0 274088289 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572638 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 351 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=181776 CPUtime=0.87
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 87 0 0 0 25 0 1 0 274088290 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567426 0 0 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 45444 352 71 160 0 45282 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=0.9
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 90 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567268 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 351 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=0.7
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 70 0 0 0 25 0 1 0 274088290 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567399 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 350 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=0.84
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 84 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577061 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=0.79
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 79 0 0 0 25 0 1 0 274088315 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577754 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 351 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=0.71
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 71 0 0 0 25 0 1 0 274088318 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567303 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 351 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=0.7
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 70 0 0 0 25 0 1 0 274088319 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683188 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 351 71 160 0 45282 0
Current children cumulated CPU time (s) 6.51
Current children cumulated vsize (KiB) 1635984

[startup+4.94736 s]
/proc/loadavg: 0.85 0.97 0.99 9/86 20316
/proc/meminfo: memFree=1577208/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=1.48
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 148 0 0 0 25 0 1 0 274088289 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572930 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 352 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=0 CPUtime=1.14
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194372 83 0 0 0 114 0 0 0 25 0 1 0 274088290 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 0 0 0 0 0 0 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=1.3
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 130 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683073 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 351 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=1.2
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 120 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572621 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 351 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=1.24
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 124 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640226 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=1.22
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 122 0 0 0 25 0 1 0 274088315 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683120 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 351 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=1.12
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 112 0 0 0 25 0 1 0 274088318 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567268 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 352 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=1.1
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 110 0 0 0 25 0 1 0 274088319 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580056 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 351 71 160 0 45282 0
Current children cumulated CPU time (s) 9.8
Current children cumulated vsize (KiB) 1454208

[startup+5.7735 s]
/proc/loadavg: 1.42 1.08 1.03 9/86 20316
/proc/meminfo: memFree=1577144/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=1.71
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 171 0 0 0 25 0 1 0 274088289 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572655 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 352 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=0 CPUtime=1.14
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194372 83 0 0 0 114 0 0 0 25 0 1 0 274088290 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 0 0 0 0 0 0 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=1.5
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 150 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683127 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 351 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=1.5
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 150 0 0 0 25 0 1 0 274088290 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572834 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 352 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=1.54
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 154 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567601 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=1.42
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 142 0 0 0 25 0 1 0 274088315 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580273 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 351 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=1.34
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 134 0 0 0 25 0 1 0 274088318 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580220 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 352 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=1.3
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 130 0 0 0 25 0 1 0 274088319 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572319 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 351 71 160 0 45282 0
Current children cumulated CPU time (s) 11.45
Current children cumulated vsize (KiB) 1454208

[startup+6.18157 s]
/proc/loadavg: 1.42 1.08 1.03 9/86 20316
/proc/meminfo: memFree=1577144/2055920 swapFree=4192812/4192956
[pid=20307] ppid=20305 vsize=181776 CPUtime=0
/proc/20307/stat : 20307 (kcnfs-smp) S 20305 20307 20199 0 -1 4194304 548 0 0 0 0 0 0 0 21 0 1 0 274088288 186138624 336 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/20307/statm: 45444 336 63 160 0 45282 0
[pid=20309] ppid=20307 vsize=181776 CPUtime=1.9
/proc/20309/stat : 20309 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 190 0 0 0 25 0 1 0 274088289 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134674522 0 0 4096 2 0 0 0 17 1 0 0
/proc/20309/statm: 45444 352 71 160 0 45282 0
[pid=20310] ppid=20307 vsize=0 CPUtime=1.14
/proc/20310/stat : 20310 (kcnfs-smp) R 20307 20307 20199 0 -1 4194372 83 0 0 0 114 0 0 0 25 0 1 0 274088290 0 0 18446744073709551615 0 0 0 0 0 0 2147483391 4096 0 0 0 0 17 1 0 0
/proc/20310/statm: 0 0 0 0 0 0 0
[pid=20311] ppid=20307 vsize=181776 CPUtime=1.6
/proc/20311/stat : 20311 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 160 0 0 0 25 0 1 0 274088290 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577499 0 0 4096 2 0 0 0 17 0 0 0
/proc/20311/statm: 45444 351 71 160 0 45282 0
[pid=20312] ppid=20307 vsize=181776 CPUtime=1.6
/proc/20312/stat : 20312 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 51 0 0 0 160 0 0 0 25 0 1 0 274088290 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572763 0 0 4096 0 0 0 0 17 1 0 0
/proc/20312/statm: 45444 352 71 160 0 45282 0
[pid=20313] ppid=20307 vsize=181776 CPUtime=1.66
/proc/20313/stat : 20313 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 166 0 0 0 25 0 1 0 274088310 186138624 350 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 2 0 0 0 17 1 0 0
/proc/20313/statm: 45444 350 71 160 0 45282 0
[pid=20314] ppid=20307 vsize=181776 CPUtime=1.52
/proc/20314/stat : 20314 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 152 0 0 0 25 0 1 0 274088315 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580334 0 0 4096 0 0 0 0 17 0 0 0
/proc/20314/statm: 45444 351 71 160 0 45282 0
[pid=20315] ppid=20307 vsize=181776 CPUtime=1.45
/proc/20315/stat : 20315 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 50 0 0 0 145 0 0 0 25 0 1 0 274088318 186138624 352 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683204 0 0 4096 2 0 0 0 17 0 0 0
/proc/20315/statm: 45444 352 71 160 0 45282 0
[pid=20316] ppid=20307 vsize=181776 CPUtime=1.4
/proc/20316/stat : 20316 (kcnfs-smp) R 20307 20307 20199 0 -1 4194368 49 0 0 0 140 0 0 0 25 0 1 0 274088319 186138624 351 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580940 0 0 4096 0 0 0 0 17 0 0 0
/proc/20316/statm: 45444 351 71 160 0 45282 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 1454208

Child status: 10

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 20307 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=156824 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=3999
CPU time returned by wait4() is 1.16082
while last known CPU time is 12.27

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 6.27523
CPU time (s): 12.27
CPU user time (s): 12.27
CPU system time (s): 0
CPU usage (%): 195.531
Max. virtual memory (cumulated for all children) (KiB): 1635984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.15682
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 665
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 59

runsolver used 0.010998 second user time and 0.021996 second system time

The end

Launcher Data (download as text)

Begin job on node15 on Tue Feb 27 01:55:39 UTC 2007

IDJOB= 309434
IDBENCH= 20259
IDSOLVER= 112
FILE ID= node15/309434-1172541339

PBS_JOBID= 3971642

Free space on /tmp= 66557 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/random/2+p/p0.9/v990/unif2p-p0.9-v990-c3583-S592344929-16-SAT.cnf
COMMAND LINE= /tmp/evaluation/309434-1172541339/kcnfs-smp /tmp/evaluation/309434-1172541339/instance-309434-1172541339.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node15/watcher-309434-1172541339 -o ROOT/results/node15/solver-309434-1172541339 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/309434-1172541339/kcnfs-smp /tmp/evaluation/309434-1172541339/instance-309434-1172541339.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  4f1fdd7886037e39bdc6f3becce96722

RANDOM SEED= 230399772

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node15.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1581272 kB
Buffers:         50676 kB
Cached:         293676 kB
SwapCached:          0 kB
Active:         248832 kB
Inactive:       155728 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1581272 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3512 kB
Writeback:           0 kB
Mapped:          79088 kB
Slab:            55556 kB
Committed_AS:   933820 kB
PageTables:       1800 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66557 MiB

End job on node15 on Tue Feb 27 01:55:45 UTC 2007