Trace number 297880

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT BASE 2007-02-08? (TO) 1200.1 1200.65

General information on the benchmark

Namerandom/OnTreshold/3SAT/v450/
unif-k3-r4.25-v450-c1912-S1113882813-11.SAT.shuffled.cnf
MD5SUM77226f3880fdc77b8d075583e32b35e0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.009997
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1912
Sum of the clauses size5736
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31912
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node42/watcher-297880-1171846608 -o ROOT/results/node42/solver-297880-1171846608 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/297880-1171846608/cmusat_base /tmp/evaluation/297880-1171846608/instance-297880-1171846608.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 1.08 3/64 14146
/proc/meminfo: memFree=384080/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=2308 CPUtime=0
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 173 0 0 0 0 0 0 0 18 0 1 0 204616865 2363392 155 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134553299 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 577 160 93 241 0 333 0

[startup+0.107312 s]
/proc/loadavg: 0.92 0.98 1.08 3/64 14146
/proc/meminfo: memFree=384080/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=2712 CPUtime=0.1
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 280 0 0 0 10 0 0 0 18 0 1 0 204616865 2777088 262 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 678 262 111 241 0 434 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2712

[startup+0.515389 s]
/proc/loadavg: 0.92 0.98 1.08 3/64 14146
/proc/meminfo: memFree=384080/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=3264 CPUtime=0.51
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 412 0 0 0 51 0 0 0 21 0 1 0 204616865 3342336 394 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559864 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 816 394 111 241 0 572 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3264

[startup+1.33554 s]
/proc/loadavg: 0.92 0.98 1.08 2/65 14147
/proc/meminfo: memFree=382728/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=3508 CPUtime=1.33
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 473 0 0 0 133 0 0 0 25 0 1 0 204616865 3592192 455 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559954 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 877 455 111 241 0 633 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3508

[startup+2.97486 s]
/proc/loadavg: 0.92 0.98 1.08 2/65 14147
/proc/meminfo: memFree=381384/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=4724 CPUtime=2.97
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 760 0 0 0 297 0 0 0 25 0 1 0 204616865 4837376 742 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134551964 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 1181 742 111 241 0 937 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 4724

[startup+6.25048 s]
/proc/loadavg: 0.93 0.98 1.08 2/65 14147
/proc/meminfo: memFree=380680/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=5608 CPUtime=6.24
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 999 0 0 0 624 0 0 0 25 0 1 0 204616865 5742592 981 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559872 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 1402 981 111 241 0 1158 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 5608

[startup+12.7067 s]
/proc/loadavg: 0.93 0.98 1.08 2/65 14147
/proc/meminfo: memFree=378248/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=7896 CPUtime=12.69
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 1644 0 0 0 1269 0 0 0 25 0 1 0 204616865 8085504 1508 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134552705 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 1974 1508 111 241 0 1730 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 7896

[startup+25.5082 s]
/proc/loadavg: 0.95 0.98 1.08 2/65 14147
/proc/meminfo: memFree=373064/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=13700 CPUtime=25.49
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 3331 0 0 0 2548 1 0 0 25 0 1 0 204616865 14028800 2788 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560509 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 3425 2788 111 241 0 3181 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 13700

[startup+51.114 s]
/proc/loadavg: 0.96 0.98 1.08 2/65 14147
/proc/meminfo: memFree=372360/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=13940 CPUtime=51.08
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 3764 0 0 0 5107 1 0 0 25 0 1 0 204616865 14274560 2940 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 3485 2940 111 241 0 3241 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 13940

[startup+102.323 s]
/proc/loadavg: 0.98 0.98 1.07 2/65 14147
/proc/meminfo: memFree=362376/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=25336 CPUtime=102.28
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 7156 0 0 0 10224 4 0 0 25 0 1 0 204616865 25944064 5449 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 6334 5449 111 241 0 6090 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 25336

[startup+162.341 s]
/proc/loadavg: 0.99 0.98 1.07 2/65 14147
/proc/meminfo: memFree=360968/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=26296 CPUtime=162.27
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 7767 0 0 0 16223 4 0 0 25 0 1 0 204616865 26927104 5796 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560023 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 6574 5796 111 241 0 6330 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 26296

[startup+222.36 s]
/proc/loadavg: 0.99 0.98 1.06 2/65 14147
/proc/meminfo: memFree=359944/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=27152 CPUtime=222.27
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 8349 0 0 0 22222 5 0 0 25 0 1 0 204616865 27803648 6061 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 6788 6061 111 241 0 6544 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 27152

[startup+282.395 s]
/proc/loadavg: 0.99 0.98 1.06 2/71 14251
/proc/meminfo: memFree=354192/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=31088 CPUtime=282.23
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 9842 0 0 0 28216 7 0 0 25 0 1 0 204616865 31834112 7172 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 7772 7172 111 241 0 7528 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 31088

[startup+342.439 s]
/proc/loadavg: 0.99 0.98 1.05 2/71 14323
/proc/meminfo: memFree=339920/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=48952 CPUtime=342.19
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 14577 0 0 0 34211 8 0 0 25 0 1 0 204616865 50126848 10728 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559842 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12238 10728 111 241 0 11994 0
Current children cumulated CPU time (s) 342.19
Current children cumulated vsize (KiB) 48952

[startup+402.469 s]
/proc/loadavg: 0.99 0.98 1.04 2/65 14345
/proc/meminfo: memFree=340808/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=49084 CPUtime=402.18
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 14645 0 0 0 40210 8 0 0 25 0 1 0 204616865 50262016 10796 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559881 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12271 10796 111 241 0 12027 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 49084

[startup+462.485 s]
/proc/loadavg: 0.99 0.98 1.04 2/65 14345
/proc/meminfo: memFree=340040/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=49472 CPUtime=462.19
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 15074 0 0 0 46210 9 0 0 25 0 1 0 204616865 50659328 10984 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12368 10984 111 241 0 12124 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 49472

[startup+522.501 s]
/proc/loadavg: 0.99 0.98 1.03 2/65 14345
/proc/meminfo: memFree=339272/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=50032 CPUtime=522.18
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 15549 0 0 0 52209 9 0 0 25 0 1 0 204616865 51232768 11194 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12508 11194 111 241 0 12264 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 50032

[startup+582.519 s]
/proc/loadavg: 0.99 0.98 1.03 2/65 14345
/proc/meminfo: memFree=339144/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=50224 CPUtime=582.18
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 15594 0 0 0 58209 9 0 0 25 0 1 0 204616865 51429376 11239 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12556 11239 111 241 0 12312 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 50224

[startup+642.542 s]
/proc/loadavg: 0.99 0.98 1.02 2/65 14345
/proc/meminfo: memFree=338312/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=50604 CPUtime=642.18
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 16084 0 0 0 64208 10 0 0 25 0 1 0 204616865 51818496 11438 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560143 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12651 11438 111 241 0 12407 0
Current children cumulated CPU time (s) 642.18
Current children cumulated vsize (KiB) 50604

[startup+702.561 s]
/proc/loadavg: 0.99 0.98 1.02 2/65 14345
/proc/meminfo: memFree=338056/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=51120 CPUtime=702.18
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 16158 0 0 0 70208 10 0 0 25 0 1 0 204616865 52346880 11512 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12780 11512 111 241 0 12536 0
Current children cumulated CPU time (s) 702.18
Current children cumulated vsize (KiB) 51120

[startup+762.578 s]
/proc/loadavg: 0.99 0.98 1.01 2/65 14345
/proc/meminfo: memFree=337352/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=51244 CPUtime=762.17
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 16667 0 0 0 76207 10 0 0 25 0 1 0 204616865 52473856 11701 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12811 11701 111 241 0 12567 0
Current children cumulated CPU time (s) 762.17
Current children cumulated vsize (KiB) 51244

[startup+822.598 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=336968/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=51700 CPUtime=822.17
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 16751 0 0 0 82207 10 0 0 25 0 1 0 204616865 52940800 11785 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12925 11785 111 241 0 12681 0
Current children cumulated CPU time (s) 822.17
Current children cumulated vsize (KiB) 51700

[startup+882.616 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=336648/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=51992 CPUtime=882.17
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 16834 0 0 0 88207 10 0 0 25 0 1 0 204616865 53239808 11868 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 12998 11868 111 241 0 12754 0
Current children cumulated CPU time (s) 882.17
Current children cumulated vsize (KiB) 51992

[startup+942.637 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=333896/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=54496 CPUtime=942.17
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 17956 0 0 0 94206 11 0 0 25 0 1 0 204616865 55803904 12541 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 13624 12541 111 241 0 13380 0
Current children cumulated CPU time (s) 942.17
Current children cumulated vsize (KiB) 54496

[startup+1002.65 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=333576/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=54888 CPUtime=1002.16
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 18072 0 0 0 100205 11 0 0 25 0 1 0 204616865 56205312 12624 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 13722 12624 111 241 0 13478 0
Current children cumulated CPU time (s) 1002.16
Current children cumulated vsize (KiB) 54888

[startup+1062.68 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=333576/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=54888 CPUtime=1062.17
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 18080 0 0 0 106205 12 0 0 25 0 1 0 204616865 56205312 12632 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 13722 12632 111 241 0 13478 0
Current children cumulated CPU time (s) 1062.17
Current children cumulated vsize (KiB) 54888

[startup+1122.69 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=329032/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=59072 CPUtime=1122.16
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 19606 0 0 0 112203 13 0 0 25 0 1 0 204616865 60489728 13772 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 14768 13772 111 241 0 14524 0
Current children cumulated CPU time (s) 1122.16
Current children cumulated vsize (KiB) 59072

[startup+1182.71 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=328840/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=59204 CPUtime=1182.16
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 19650 0 0 0 118203 13 0 0 25 0 1 0 204616865 60624896 13816 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 14801 13816 111 241 0 14557 0
Current children cumulated CPU time (s) 1182.16
Current children cumulated vsize (KiB) 59204



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.64 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=328776/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=59204 CPUtime=1200.08
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 19654 0 0 0 119995 13 0 0 25 0 1 0 204616865 60624896 13820 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559831 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 14801 13820 111 241 0 14557 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 59204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.64 s]
/proc/loadavg: 0.99 0.98 1.00 2/65 14345
/proc/meminfo: memFree=328776/2055920 swapFree=4183424/4192956
[pid=14146] ppid=14144 vsize=59204 CPUtime=1200.08
/proc/14146/stat : 14146 (cmusat_base) R 14144 14146 13615 0 -1 4194304 19654 0 0 0 119995 13 0 0 25 0 1 0 204616865 60624896 13820 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559831 0 0 4096 35 0 0 0 17 1 0 0
/proc/14146/statm: 14801 13820 111 241 0 14557 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 59204

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.65
CPU time (s): 1200.1
CPU user time (s): 1199.96
CPU system time (s): 0.148977
CPU usage (%): 99.9546
Max. virtual memory (cumulated for all children) (KiB): 59204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.96
system time used= 0.148977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19654
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1257

runsolver used 0.818875 second user time and 2.47562 second system time

The end

Launcher Data (download as text)

Begin job on node42 on Mon Feb 19 00:56:48 UTC 2007

IDJOB= 297880
IDBENCH= 19972
IDSOLVER= 120
FILE ID= node42/297880-1171846608

PBS_JOBID= 3839730

Free space on /tmp= 66561 MiB

SOLVER NAME= CMUSAT BASE 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v450/unif-k3-r4.25-v450-c1912-S1113882813-11.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/297880-1171846608/cmusat_base /tmp/evaluation/297880-1171846608/instance-297880-1171846608.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node42/watcher-297880-1171846608 -o ROOT/results/node42/solver-297880-1171846608 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/297880-1171846608/cmusat_base /tmp/evaluation/297880-1171846608/instance-297880-1171846608.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  77226f3880fdc77b8d075583e32b35e0

RANDOM SEED= 899183737

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node42.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        384488 kB
Buffers:         52628 kB
Cached:        1491148 kB
SwapCached:       3904 kB
Active:         827932 kB
Inactive:       726296 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        384488 kB
SwapTotal:     4192956 kB
SwapFree:      4183424 kB
Dirty:            2460 kB
Writeback:           0 kB
Mapped:          15832 kB
Slab:           103256 kB
Committed_AS:   786360 kB
PageTables:       1408 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node42 on Mon Feb 19 01:16:51 UTC 2007