Trace number 300914

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT BASE 2007-02-08? (TO) 1200.11 1200.39

General information on the benchmark

Namerandom/LargeSize/5SAT/v700/
unif-k5-r20-v700-c14000-S1036103820-03.cnf
MD5SUM85e6669b731e40790ffff95698079292
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark41.5937
Satisfiable
(Un)Satisfiability was proved
Number of variables700
Number of clauses14000
Sum of the clauses size70000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 514000
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node3/watcher-300914-1171942750 -o ROOT/results/node3/solver-300914-1171942750 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/300914-1171942750/cmusat_base /tmp/evaluation/300914-1171942750/instance-300914-1171942750.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7488
/proc/meminfo: memFree=765992/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=2684 CPUtime=0
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 241 0 0 0 0 0 0 0 18 0 1 0 214229838 2748416 223 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 135064935 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 671 223 90 241 0 427 0

[startup+0.106841 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7488
/proc/meminfo: memFree=765992/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=4232 CPUtime=0.1
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 671 0 0 0 10 0 0 0 18 0 1 0 214229838 4333568 611 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134551406 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 1058 611 111 241 0 814 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 4232

[startup+0.514875 s]
/proc/loadavg: 0.99 0.98 0.99 3/77 7488
/proc/meminfo: memFree=765992/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=5552 CPUtime=0.5
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 1025 0 0 0 50 0 0 0 21 0 1 0 214229838 5685248 965 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 135064935 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 1388 965 111 241 0 1144 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 5552

[startup+1.33494 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=760608/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=7960 CPUtime=1.32
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 1751 0 0 0 132 0 0 0 25 0 1 0 214229838 8151040 1614 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 135064935 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 1990 1614 111 241 0 1746 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 7960

[startup+2.97108 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=759456/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=8892 CPUtime=2.96
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 2074 0 0 0 295 1 0 0 25 0 1 0 214229838 9105408 1854 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 2223 1855 111 241 0 1979 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 8892

[startup+6.25335 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=757408/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=10100 CPUtime=6.24
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 2529 0 0 0 623 1 0 0 25 0 1 0 214229838 10342400 2175 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 2525 2175 111 241 0 2281 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 10100

[startup+12.7099 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=748640/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=19344 CPUtime=12.69
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 5058 0 0 0 1267 2 0 0 25 0 1 0 214229838 19808256 4307 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560029 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 4836 4307 111 241 0 4592 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 19344

[startup+25.5099 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=748448/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=19612 CPUtime=25.49
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 5233 0 0 0 2547 2 0 0 25 0 1 0 214229838 20082688 4422 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559878 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 4903 4422 111 241 0 4659 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 19612

[startup+51.12 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=743072/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=25100 CPUtime=51.09
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 6953 0 0 0 5105 4 0 0 25 0 1 0 214229838 25702400 5851 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 6275 5851 111 241 0 6031 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 25100

[startup+102.335 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=716896/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=52184 CPUtime=102.3
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 14176 0 0 0 10223 7 0 0 25 0 1 0 214229838 53436416 12261 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559842 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 13046 12261 111 241 0 12802 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 52184

[startup+162.367 s]
/proc/loadavg: 0.99 0.98 0.99 2/78 7489
/proc/meminfo: memFree=716320/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=52296 CPUtime=162.32
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 14672 0 0 0 16224 8 0 0 25 0 1 0 214229838 53551104 12400 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560049 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 13074 12400 111 241 0 12830 0
Current children cumulated CPU time (s) 162.32
Current children cumulated vsize (KiB) 52296

[startup+222.397 s]
/proc/loadavg: 1.04 1.00 1.00 2/78 7489
/proc/meminfo: memFree=713312/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=54764 CPUtime=222.33
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 15692 0 0 0 22224 9 0 0 25 0 1 0 214229838 56078336 13133 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560110 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 13691 13133 111 241 0 13447 0
Current children cumulated CPU time (s) 222.33
Current children cumulated vsize (KiB) 54764

[startup+282.422 s]
/proc/loadavg: 1.01 1.00 1.00 2/78 7489
/proc/meminfo: memFree=709728/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=58248 CPUtime=282.34
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 16757 0 0 0 28223 11 0 0 25 0 1 0 214229838 59645952 14037 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 14562 14037 111 241 0 14318 0
Current children cumulated CPU time (s) 282.34
Current children cumulated vsize (KiB) 58248

[startup+342.452 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=704608/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=63212 CPUtime=342.36
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 18214 0 0 0 34224 12 0 0 25 0 1 0 214229838 64729088 15320 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 15803 15320 111 241 0 15559 0
Current children cumulated CPU time (s) 342.36
Current children cumulated vsize (KiB) 63212

[startup+402.483 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=698016/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=69504 CPUtime=402.38
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 20042 0 0 0 40223 15 0 0 25 0 1 0 214229838 71172096 16960 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560509 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 17376 16960 111 241 0 17132 0
Current children cumulated CPU time (s) 402.38
Current children cumulated vsize (KiB) 69504

[startup+462.509 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=650592/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120048 CPUtime=462.39
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 32716 0 0 0 46218 21 0 0 25 0 1 0 214229838 122929152 28757 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560023 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30012 28757 111 241 0 29768 0
Current children cumulated CPU time (s) 462.39
Current children cumulated vsize (KiB) 120048

[startup+522.533 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=650400/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120120 CPUtime=522.39
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 33023 0 0 0 52218 21 0 0 25 0 1 0 214229838 123002880 28860 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 135070109 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30030 28860 111 241 0 29786 0
Current children cumulated CPU time (s) 522.39
Current children cumulated vsize (KiB) 120120

[startup+582.557 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=650272/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120192 CPUtime=582.41
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 33265 0 0 0 58219 22 0 0 25 0 1 0 214229838 123076608 28880 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559888 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30048 28880 111 241 0 29804 0
Current children cumulated CPU time (s) 582.41
Current children cumulated vsize (KiB) 120192

[startup+642.587 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=649824/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120280 CPUtime=642.42
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 33621 0 0 0 64220 22 0 0 25 0 1 0 214229838 123166720 28995 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560509 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30070 28995 111 241 0 29826 0
Current children cumulated CPU time (s) 642.42
Current children cumulated vsize (KiB) 120280

[startup+702.613 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=649824/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120280 CPUtime=702.44
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 33621 0 0 0 70221 23 0 0 25 0 1 0 214229838 123166720 28995 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30070 28995 111 241 0 29826 0
Current children cumulated CPU time (s) 702.44
Current children cumulated vsize (KiB) 120280

[startup+762.64 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=649568/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120280 CPUtime=762.45
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 33696 0 0 0 76221 24 0 0 25 0 1 0 214229838 123166720 29070 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559888 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30070 29070 111 241 0 29826 0
Current children cumulated CPU time (s) 762.45
Current children cumulated vsize (KiB) 120280

[startup+822.671 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=649376/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120372 CPUtime=822.47
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 34002 0 0 0 82223 24 0 0 25 0 1 0 214229838 123260928 29113 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560023 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30093 29113 111 241 0 29849 0
Current children cumulated CPU time (s) 822.47
Current children cumulated vsize (KiB) 120372

[startup+882.697 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=649248/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120504 CPUtime=882.47
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 34033 0 0 0 88223 24 0 0 25 0 1 0 214229838 123396096 29144 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30126 29144 111 241 0 29882 0
Current children cumulated CPU time (s) 882.47
Current children cumulated vsize (KiB) 120504

[startup+942.724 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=648736/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120604 CPUtime=942.49
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 34453 0 0 0 94224 25 0 0 25 0 1 0 214229838 123498496 29278 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560029 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30151 29278 111 241 0 29907 0
Current children cumulated CPU time (s) 942.49
Current children cumulated vsize (KiB) 120604

[startup+1002.75 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=648672/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=120604 CPUtime=1002.51
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 34453 0 0 0 100225 26 0 0 25 0 1 0 214229838 123498496 29278 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134906347 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 30151 29278 111 241 0 29907 0
Current children cumulated CPU time (s) 1002.51
Current children cumulated vsize (KiB) 120604

[startup+1062.79 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=644768/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=124208 CPUtime=1062.52
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 35457 0 0 0 106225 27 0 0 25 0 1 0 214229838 127188992 30282 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 31052 30282 111 241 0 30808 0
Current children cumulated CPU time (s) 1062.52
Current children cumulated vsize (KiB) 124208

[startup+1122.82 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=644000/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=124912 CPUtime=1122.54
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 35939 0 0 0 112226 28 0 0 25 0 1 0 214229838 127909888 30452 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 31228 30452 111 241 0 30984 0
Current children cumulated CPU time (s) 1122.54
Current children cumulated vsize (KiB) 124912

[startup+1182.85 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=643808/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=125232 CPUtime=1182.56
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 35998 0 0 0 118228 28 0 0 25 0 1 0 214229838 128237568 30511 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 31308 30511 111 241 0 31064 0
Current children cumulated CPU time (s) 1182.56
Current children cumulated vsize (KiB) 125232



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=643680/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=125424 CPUtime=1200.07
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 36020 0 0 0 119979 28 0 0 25 0 1 0 214229838 128434176 30533 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 31356 30533 111 241 0 31112 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 125424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 7489
/proc/meminfo: memFree=643680/2055920 swapFree=4192812/4192956
[pid=7488] ppid=7486 vsize=125424 CPUtime=1200.07
/proc/7488/stat : 7488 (cmusat_base) R 7486 7488 5701 0 -1 4194304 36020 0 0 0 119979 28 0 0 25 0 1 0 214229838 128434176 30533 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/7488/statm: 31356 30533 111 241 0 31112 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 125424

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.39
CPU time (s): 1200.11
CPU user time (s): 1199.8
CPU system time (s): 0.307953
CPU usage (%): 99.9762
Max. virtual memory (cumulated for all children) (KiB): 125424

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.8
system time used= 0.307953
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36020
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1927

runsolver used 1.37679 second user time and 2.70759 second system time

The end

Launcher Data (download as text)

Begin job on node3 on Tue Feb 20 03:39:10 UTC 2007

IDJOB= 300914
IDBENCH= 20046
IDSOLVER= 120
FILE ID= node3/300914-1171942750

PBS_JOBID= 3848942

Free space on /tmp= 66549 MiB

SOLVER NAME= CMUSAT BASE 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/5SAT/v700/unif-k5-r20-v700-c14000-S1036103820-03.cnf
COMMAND LINE= /tmp/evaluation/300914-1171942750/cmusat_base /tmp/evaluation/300914-1171942750/instance-300914-1171942750.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node3/watcher-300914-1171942750 -o ROOT/results/node3/solver-300914-1171942750 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/300914-1171942750/cmusat_base /tmp/evaluation/300914-1171942750/instance-300914-1171942750.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  85e6669b731e40790ffff95698079292

RANDOM SEED= 779315250

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node3.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        766464 kB
Buffers:         61648 kB
Cached:        1093808 kB
SwapCached:          0 kB
Active:         551132 kB
Inactive:       659112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        766464 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2788 kB
Writeback:           0 kB
Mapped:          73660 kB
Slab:            64932 kB
Committed_AS:  1035564 kB
PageTables:       1656 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66549 MiB

End job on node3 on Tue Feb 20 03:59:13 UTC 2007