Trace number 293575

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT BASE 2007-02-08? (TO) 1200.04 1200.3

General information on the benchmark

Namerandom/OnTreshold/5SAT/v110/
unif-k5-r21.3-v110-c2343-S1869272420-19.SAT.shuffled.cnf
MD5SUM4c82e15dddaac18e48f58e3db4a1e7b5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.021996
Satisfiable
(Un)Satisfiability was proved
Number of variables110
Number of clauses2343
Sum of the clauses size11715
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52343
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node29/watcher-293575-1171773607 -o ROOT/results/node29/solver-293575-1171773607 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/293575-1171773607/cmusat_base /tmp/evaluation/293575-1171773607/instance-293575-1171773607.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.01 1.01 1.09 3/77 20888
/proc/meminfo: memFree=930144/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=2308 CPUtime=0
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 173 0 0 0 0 0 0 0 18 0 1 0 171124921 2363392 155 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 135064935 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 577 155 90 241 0 333 0

[startup+0.106835 s]
/proc/loadavg: 1.01 1.01 1.09 3/77 20888
/proc/meminfo: memFree=930144/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=2872 CPUtime=0.1
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 323 0 0 0 10 0 0 0 18 0 1 0 171124921 2940928 305 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560493 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 718 305 111 241 0 474 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2872

[startup+0.514861 s]
/proc/loadavg: 1.01 1.01 1.09 3/77 20888
/proc/meminfo: memFree=930144/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=3420 CPUtime=0.51
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 450 0 0 0 51 0 0 0 21 0 1 0 171124921 3502080 432 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559905 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 855 432 111 241 0 611 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3420

[startup+1.33491 s]
/proc/loadavg: 1.01 1.01 1.09 2/78 20889
/proc/meminfo: memFree=928664/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=3704 CPUtime=1.33
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 542 0 0 0 133 0 0 0 25 0 1 0 171124921 3792896 524 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134561900 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 926 524 111 241 0 682 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3704

[startup+2.97101 s]
/proc/loadavg: 1.01 1.01 1.09 2/78 20889
/proc/meminfo: memFree=927064/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=5276 CPUtime=2.96
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 893 0 0 0 296 0 0 0 25 0 1 0 171124921 5402624 875 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134552127 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 1319 875 111 241 0 1075 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5276

[startup+6.24722 s]
/proc/loadavg: 1.01 1.01 1.09 2/78 20889
/proc/meminfo: memFree=926104/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=6008 CPUtime=6.23
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 1096 0 0 0 623 0 0 0 25 0 1 0 171124921 6152192 1078 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134562588 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 1502 1078 111 241 0 1258 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 6008

[startup+12.7036 s]
/proc/loadavg: 1.00 1.01 1.09 2/78 20889
/proc/meminfo: memFree=923808/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=8452 CPUtime=12.69
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 1930 0 0 0 1269 0 0 0 25 0 1 0 171124921 8654848 1624 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559881 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 2113 1624 111 241 0 1869 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 8452

[startup+25.5094 s]
/proc/loadavg: 1.00 1.01 1.09 2/78 20889
/proc/meminfo: memFree=921632/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=15316 CPUtime=25.5
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 3928 0 0 0 2549 1 0 0 25 0 1 0 171124921 15683584 3104 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560029 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 3829 3104 111 241 0 3585 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 15316

[startup+51.12 s]
/proc/loadavg: 1.00 1.01 1.09 2/78 20889
/proc/meminfo: memFree=916832/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=15868 CPUtime=51.1
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 4620 0 0 0 5109 1 0 0 25 0 1 0 171124921 16248832 3381 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559954 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 3967 3381 111 241 0 3723 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 15868

[startup+102.339 s]
/proc/loadavg: 1.00 1.00 1.08 2/78 20889
/proc/meminfo: memFree=905120/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=29200 CPUtime=102.31
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 8606 0 0 0 10227 4 0 0 25 0 1 0 171124921 29900800 6281 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 7300 6281 111 241 0 7056 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 29200

[startup+162.371 s]
/proc/loadavg: 1.00 1.00 1.08 2/78 20889
/proc/meminfo: memFree=904096/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=29328 CPUtime=162.32
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 9169 0 0 0 16228 4 0 0 25 0 1 0 171124921 30031872 6517 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 7332 6517 111 241 0 7088 0
Current children cumulated CPU time (s) 162.32
Current children cumulated vsize (KiB) 29328

[startup+222.406 s]
/proc/loadavg: 1.00 1.00 1.07 2/78 20889
/proc/meminfo: memFree=901024/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=32284 CPUtime=222.35
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 10329 0 0 0 22229 6 0 0 25 0 1 0 171124921 33058816 7283 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559842 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 8071 7283 111 241 0 7827 0
Current children cumulated CPU time (s) 222.35
Current children cumulated vsize (KiB) 32284

[startup+282.432 s]
/proc/loadavg: 1.00 1.00 1.06 2/78 20889
/proc/meminfo: memFree=898208/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=34944 CPUtime=282.36
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 11274 0 0 0 28229 7 0 0 25 0 1 0 171124921 35782656 7986 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134551476 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 8736 7986 111 241 0 8492 0
Current children cumulated CPU time (s) 282.36
Current children cumulated vsize (KiB) 34944

[startup+342.461 s]
/proc/loadavg: 1.00 1.00 1.06 2/78 20889
/proc/meminfo: memFree=895520/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=37468 CPUtime=342.37
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 12225 0 0 0 34229 8 0 0 25 0 1 0 171124921 38367232 8656 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 9367 8656 111 241 0 9123 0
Current children cumulated CPU time (s) 342.37
Current children cumulated vsize (KiB) 37468

[startup+402.495 s]
/proc/loadavg: 1.00 1.00 1.05 2/78 20889
/proc/meminfo: memFree=879008/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58200 CPUtime=402.39
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 17784 0 0 0 40227 12 0 0 25 0 1 0 171124921 59596800 12770 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14550 12770 111 241 0 14306 0
Current children cumulated CPU time (s) 402.39
Current children cumulated vsize (KiB) 58200

[startup+462.524 s]
/proc/loadavg: 1.00 1.00 1.05 2/78 20889
/proc/meminfo: memFree=878816/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58200 CPUtime=462.41
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 17856 0 0 0 46229 12 0 0 25 0 1 0 171124921 59596800 12842 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560516 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14550 12842 111 241 0 14306 0
Current children cumulated CPU time (s) 462.41
Current children cumulated vsize (KiB) 58200

[startup+522.549 s]
/proc/loadavg: 1.00 1.00 1.04 2/78 20889
/proc/meminfo: memFree=878432/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58316 CPUtime=522.42
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 18241 0 0 0 52229 13 0 0 25 0 1 0 171124921 59715584 12928 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559862 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14579 12928 111 241 0 14335 0
Current children cumulated CPU time (s) 522.42
Current children cumulated vsize (KiB) 58316

[startup+582.578 s]
/proc/loadavg: 1.00 1.00 1.04 2/78 20889
/proc/meminfo: memFree=877792/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58448 CPUtime=582.44
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 18737 0 0 0 58230 14 0 0 25 0 1 0 171124921 59850752 13096 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14612 13096 111 241 0 14368 0
Current children cumulated CPU time (s) 582.44
Current children cumulated vsize (KiB) 58448

[startup+642.613 s]
/proc/loadavg: 1.00 1.00 1.03 2/78 20889
/proc/meminfo: memFree=877728/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58448 CPUtime=642.46
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 18739 0 0 0 64232 14 0 0 25 0 1 0 171124921 59850752 13098 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14612 13098 111 241 0 14368 0
Current children cumulated CPU time (s) 642.46
Current children cumulated vsize (KiB) 58448

[startup+702.638 s]
/proc/loadavg: 1.00 1.00 1.02 2/78 20889
/proc/meminfo: memFree=877152/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58580 CPUtime=702.48
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 18908 0 0 0 70233 15 0 0 25 0 1 0 171124921 59985920 13267 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14645 13267 111 241 0 14401 0
Current children cumulated CPU time (s) 702.48
Current children cumulated vsize (KiB) 58580

[startup+762.666 s]
/proc/loadavg: 1.00 1.00 1.02 2/78 20889
/proc/meminfo: memFree=876768/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=58980 CPUtime=762.49
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 19365 0 0 0 76233 16 0 0 25 0 1 0 171124921 60395520 13330 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560029 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14745 13330 111 241 0 14501 0
Current children cumulated CPU time (s) 762.49
Current children cumulated vsize (KiB) 58980

[startup+822.697 s]
/proc/loadavg: 1.00 1.00 1.01 2/78 20889
/proc/meminfo: memFree=876512/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=59244 CPUtime=822.5
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 19439 0 0 0 82234 16 0 0 25 0 1 0 171124921 60665856 13404 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560484 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14811 13404 111 241 0 14567 0
Current children cumulated CPU time (s) 822.5
Current children cumulated vsize (KiB) 59244

[startup+882.727 s]
/proc/loadavg: 1.00 1.00 1.01 2/78 20889
/proc/meminfo: memFree=875424/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=59928 CPUtime=882.52
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 20119 0 0 0 88235 17 0 0 25 0 1 0 171124921 61366272 13688 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134560509 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 14982 13688 111 241 0 14738 0
Current children cumulated CPU time (s) 882.52
Current children cumulated vsize (KiB) 59928

[startup+942.755 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=875104/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=60324 CPUtime=942.54
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 20204 0 0 0 94236 18 0 0 25 0 1 0 171124921 61771776 13773 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 15081 13773 111 241 0 14837 0
Current children cumulated CPU time (s) 942.54
Current children cumulated vsize (KiB) 60324

[startup+1002.78 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=872992/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=62168 CPUtime=1002.55
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 20791 0 0 0 100236 19 0 0 25 0 1 0 171124921 63660032 14327 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 15542 14327 111 241 0 15298 0
Current children cumulated CPU time (s) 1002.55
Current children cumulated vsize (KiB) 62168

[startup+1062.82 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=871200/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=63560 CPUtime=1062.57
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 21633 0 0 0 106237 20 0 0 25 0 1 0 171124921 65085440 14734 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 15890 14734 111 241 0 15646 0
Current children cumulated CPU time (s) 1062.57
Current children cumulated vsize (KiB) 63560

[startup+1122.84 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=870944/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=63944 CPUtime=1122.59
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 21700 0 0 0 112238 21 0 0 25 0 1 0 171124921 65478656 14801 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 15986 14801 111 241 0 15742 0
Current children cumulated CPU time (s) 1122.59
Current children cumulated vsize (KiB) 63944

[startup+1182.87 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=870240/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=64856 CPUtime=1182.6
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 21985 0 0 0 118239 21 0 0 25 0 1 0 171124921 66412544 14988 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 16214 14988 111 241 0 15970 0
Current children cumulated CPU time (s) 1182.6
Current children cumulated vsize (KiB) 64856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.29 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 20889
/proc/meminfo: memFree=870112/2055920 swapFree=4147432/4192956
[pid=20888] ppid=20886 vsize=64988 CPUtime=1200.02
/proc/20888/stat : 20888 (cmusat_base) R 20886 20888 20692 0 -1 4194304 22001 0 0 0 119981 21 0 0 25 0 1 0 171124921 66547712 15004 18446744073709551615 134512640 135500113 4294956624 18446744073709551615 134559902 0 0 4096 35 0 0 0 17 1 0 0
/proc/20888/statm: 16247 15004 111 241 0 16003 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 64988

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.3
CPU time (s): 1200.04
CPU user time (s): 1199.82
CPU system time (s): 0.224965
CPU usage (%): 99.9782
Max. virtual memory (cumulated for all children) (KiB): 64988

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.82
system time used= 0.224965
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22001
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1322

runsolver used 1.38679 second user time and 2.88156 second system time

The end

Launcher Data (download as text)

Begin job on node29 on Sun Feb 18 04:40:07 UTC 2007

IDJOB= 293575
IDBENCH= 19867
IDSOLVER= 120
FILE ID= node29/293575-1171773607

PBS_JOBID= 3839548

Free space on /tmp= 66562 MiB

SOLVER NAME= CMUSAT BASE 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/5SAT/v110/unif-k5-r21.3-v110-c2343-S1869272420-19.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/293575-1171773607/cmusat_base /tmp/evaluation/293575-1171773607/instance-293575-1171773607.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node29/watcher-293575-1171773607 -o ROOT/results/node29/solver-293575-1171773607 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/293575-1171773607/cmusat_base /tmp/evaluation/293575-1171773607/instance-293575-1171773607.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  4c82e15dddaac18e48f58e3db4a1e7b5

RANDOM SEED= 734032504

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node29.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.209
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.209
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        930616 kB
Buffers:         39260 kB
Cached:         984948 kB
SwapCached:      12248 kB
Active:         785124 kB
Inactive:       262080 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        930616 kB
SwapTotal:     4192956 kB
SwapFree:      4147432 kB
Dirty:            2512 kB
Writeback:           0 kB
Mapped:          29916 kB
Slab:            63560 kB
Committed_AS:   623700 kB
PageTables:       1864 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66562 MiB

End job on node29 on Sun Feb 18 05:00:09 UTC 2007