Trace number 295872

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.04 1200.56

General information on the benchmark

Namerandom/OnTreshold/7SAT/v70/
unif-k7-r89-v70-c6230-S1107155013-20.UNSAT.shuffled.cnf
MD5SUM54161bb7f5d80f36a000875f17de5551
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables70
Number of clauses6230
Sum of the clauses size43610
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56230

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  70                                                   |
0.00/0.01	c |  Number of clauses:    6230                                                 |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node33/watcher-295872-1171813649 -o ROOT/results/node33/solver-295872-1171813649 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/295872-1171813649/cmusat /tmp/evaluation/295872-1171813649/instance-295872-1171813649.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 0.99 3/64 14433
/proc/meminfo: memFree=906196/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=18568 CPUtime=0
/proc/14433/stat : 14433 (runsolver) R 14431 14433 14333 0 -1 4194368 16 0 0 0 0 0 0 0 18 0 1 0 106400201 19013632 292 18446744073709551615 4194304 4293652 548682068944 18446744073709551615 210824129831 0 0 4096 24578 0 0 0 17 1 0 0
/proc/14433/statm: 4642 292 257 24 0 2626 0

[startup+0.108052 s]
/proc/loadavg: 1.00 1.00 0.99 3/64 14433
/proc/meminfo: memFree=906196/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=2848 CPUtime=0.1
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 339 0 0 0 10 0 0 0 18 0 1 0 106400201 2916352 322 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134530467 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 712 322 109 243 0 466 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2848

[startup+0.516135 s]
/proc/loadavg: 1.00 1.00 0.99 3/64 14433
/proc/meminfo: memFree=906196/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=3948 CPUtime=0.5
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 773 0 0 0 50 0 0 0 21 0 1 0 106400201 4042752 624 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589715 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 987 624 118 243 0 741 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 3948

[startup+1.3383 s]
/proc/loadavg: 1.00 1.00 0.99 2/65 14434
/proc/meminfo: memFree=903880/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=4296 CPUtime=1.32
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 844 0 0 0 132 0 0 0 25 0 1 0 106400201 4399104 695 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589656 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 1074 695 118 243 0 828 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 4296

[startup+2.97564 s]
/proc/loadavg: 1.00 1.00 0.99 2/65 14434
/proc/meminfo: memFree=902600/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=5680 CPUtime=2.96
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 1184 0 0 0 296 0 0 0 25 0 1 0 106400201 5816320 998 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589690 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 1420 998 118 243 0 1174 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5680

[startup+6.25231 s]
/proc/loadavg: 1.00 1.00 0.99 2/65 14434
/proc/meminfo: memFree=901904/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=6372 CPUtime=6.23
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 1492 0 0 0 623 0 0 0 25 0 1 0 106400201 6524928 1198 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 1593 1198 118 243 0 1347 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 6372

[startup+12.7076 s]
/proc/loadavg: 1.07 1.02 1.00 2/65 14434
/proc/meminfo: memFree=898640/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=9848 CPUtime=12.69
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 2644 0 0 0 1268 1 0 0 25 0 1 0 106400201 10084352 1943 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589715 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 2462 1943 118 243 0 2216 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 9848

[startup+25.5083 s]
/proc/loadavg: 1.06 1.02 1.00 2/65 14434
/proc/meminfo: memFree=897104/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=11252 CPUtime=25.48
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 3302 0 0 0 2547 1 0 0 25 0 1 0 106400201 11522048 2341 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 2813 2341 118 243 0 2567 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 11252

[startup+51.1155 s]
/proc/loadavg: 1.04 1.01 1.00 2/65 14434
/proc/meminfo: memFree=890128/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=19192 CPUtime=51.08
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 5862 0 0 0 5105 3 0 0 25 0 1 0 106400201 19652608 4042 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 4798 4042 118 243 0 4552 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 19192

[startup+102.327 s]
/proc/loadavg: 1.01 1.01 1.00 2/65 14434
/proc/meminfo: memFree=886672/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=21996 CPUtime=102.28
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 7280 0 0 0 10224 4 0 0 25 0 1 0 106400201 22523904 4916 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589690 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 5499 4916 118 243 0 5253 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 21996

[startup+162.349 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=874384/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=37132 CPUtime=162.27
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 11467 0 0 0 16221 6 0 0 25 0 1 0 106400201 38023168 7970 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589545 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 9283 7970 118 243 0 9037 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 37132

[startup+222.367 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=873616/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=37288 CPUtime=222.27
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 12097 0 0 0 22221 6 0 0 25 0 1 0 106400201 38182912 8179 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589771 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 9322 8179 118 243 0 9076 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 37288

[startup+282.385 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=873040/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=37512 CPUtime=282.27
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 12489 0 0 0 28220 7 0 0 25 0 1 0 106400201 38412288 8331 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589536 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 9378 8331 118 243 0 9132 0
Current children cumulated CPU time (s) 282.27
Current children cumulated vsize (KiB) 37512

[startup+342.405 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=871760/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=38688 CPUtime=342.27
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 13132 0 0 0 34219 8 0 0 25 0 1 0 106400201 39616512 8645 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589536 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 9672 8645 118 243 0 9426 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 38688

[startup+402.429 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=868816/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=41308 CPUtime=402.26
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 14152 0 0 0 40218 8 0 0 25 0 1 0 106400201 42299392 9377 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589545 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 10327 9377 118 243 0 10081 0
Current children cumulated CPU time (s) 402.26
Current children cumulated vsize (KiB) 41308

[startup+462.446 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=865296/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=44460 CPUtime=462.26
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 15378 0 0 0 46216 10 0 0 25 0 1 0 106400201 45527040 10254 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 11115 10254 118 243 0 10869 0
Current children cumulated CPU time (s) 462.26
Current children cumulated vsize (KiB) 44460

[startup+522.461 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=864528/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=45480 CPUtime=522.25
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 15637 0 0 0 52215 10 0 0 25 0 1 0 106400201 46571520 10415 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 11370 10415 118 243 0 11124 0
Current children cumulated CPU time (s) 522.25
Current children cumulated vsize (KiB) 45480

[startup+582.478 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=861008/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=48744 CPUtime=582.26
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 16903 0 0 0 58215 11 0 0 25 0 1 0 106400201 49913856 11335 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 12186 11335 118 243 0 11940 0
Current children cumulated CPU time (s) 582.26
Current children cumulated vsize (KiB) 48744

[startup+642.501 s]
/proc/loadavg: 1.05 1.01 1.00 2/65 14434
/proc/meminfo: memFree=860560/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=49068 CPUtime=642.25
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 16994 0 0 0 64214 11 0 0 25 0 1 0 106400201 50245632 11426 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 12267 11426 118 243 0 12021 0
Current children cumulated CPU time (s) 642.25
Current children cumulated vsize (KiB) 49068

[startup+702.523 s]
/proc/loadavg: 1.02 1.01 1.00 2/65 14434
/proc/meminfo: memFree=841296/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74104 CPUtime=702.25
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 23426 0 0 0 70211 14 0 0 25 0 1 0 106400201 75882496 16233 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18526 16233 118 243 0 18280 0
Current children cumulated CPU time (s) 702.25
Current children cumulated vsize (KiB) 74104

[startup+762.538 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14434
/proc/meminfo: memFree=840976/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74252 CPUtime=762.25
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 23873 0 0 0 76210 15 0 0 25 0 1 0 106400201 76034048 16301 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18563 16301 118 243 0 18317 0
Current children cumulated CPU time (s) 762.25
Current children cumulated vsize (KiB) 74252

[startup+822.567 s]
/proc/loadavg: 1.00 1.00 1.00 2/71 14506
/proc/meminfo: memFree=839640/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74252 CPUtime=822.24
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 23928 0 0 0 82209 15 0 0 25 0 1 0 106400201 76034048 16356 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590157 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18563 16356 118 243 0 18317 0
Current children cumulated CPU time (s) 822.24
Current children cumulated vsize (KiB) 74252

[startup+882.614 s]
/proc/loadavg: 1.00 1.00 1.00 2/71 14598
/proc/meminfo: memFree=838864/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74412 CPUtime=882.21
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 24497 0 0 0 88206 15 0 0 25 0 1 0 106400201 76197888 16509 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18603 16509 118 243 0 18357 0
Current children cumulated CPU time (s) 882.21
Current children cumulated vsize (KiB) 74412

[startup+942.645 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=839952/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74412 CPUtime=942.2
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 24505 0 0 0 94204 16 0 0 25 0 1 0 106400201 76197888 16517 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18603 16517 118 243 0 18357 0
Current children cumulated CPU time (s) 942.2
Current children cumulated vsize (KiB) 74412

[startup+1002.66 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=839696/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74412 CPUtime=1002.2
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 24569 0 0 0 100204 16 0 0 25 0 1 0 106400201 76197888 16581 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18603 16581 118 243 0 18357 0
Current children cumulated CPU time (s) 1002.2
Current children cumulated vsize (KiB) 74412

[startup+1062.69 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=839056/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74592 CPUtime=1062.19
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 25196 0 0 0 106203 16 0 0 25 0 1 0 106400201 76382208 16752 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18648 16752 118 243 0 18402 0
Current children cumulated CPU time (s) 1062.19
Current children cumulated vsize (KiB) 74592

[startup+1122.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=839120/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74592 CPUtime=1122.19
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 25199 0 0 0 112203 16 0 0 25 0 1 0 106400201 76382208 16755 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589521 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18648 16755 118 243 0 18402 0
Current children cumulated CPU time (s) 1122.19
Current children cumulated vsize (KiB) 74592

[startup+1182.72 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=839056/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74592 CPUtime=1182.19
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 25202 0 0 0 118203 16 0 0 25 0 1 0 106400201 76382208 16758 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18648 16758 118 243 0 18402 0
Current children cumulated CPU time (s) 1182.19
Current children cumulated vsize (KiB) 74592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.55 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 14632
/proc/meminfo: memFree=838864/2055920 swapFree=4183908/4192956
[pid=14433] ppid=14431 vsize=74988 CPUtime=1200.02
/proc/14433/stat : 14433 (cmusat) R 14431 14433 14333 0 -1 4194304 25256 0 0 0 119985 17 0 0 25 0 1 0 106400201 76787712 16812 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589670 0 0 4096 35 0 0 0 17 1 0 0
/proc/14433/statm: 18747 16812 118 243 0 18501 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 74988

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.56
CPU time (s): 1200.04
CPU user time (s): 1199.85
CPU system time (s): 0.182972
CPU usage (%): 99.9561
Max. virtual memory (cumulated for all children) (KiB): 74988

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.85
system time used= 0.182972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25256
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 3439

runsolver used 0.78588 second user time and 2.50862 second system time

The end

Launcher Data (download as text)

Begin job on node33 on Sun Feb 18 15:47:29 UTC 2007

IDJOB= 295872
IDBENCH= 19923
IDSOLVER= 121
FILE ID= node33/295872-1171813649

PBS_JOBID= 3839647

Free space on /tmp= 66562 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/7SAT/v70/unif-k7-r89-v70-c6230-S1107155013-20.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/295872-1171813649/cmusat /tmp/evaluation/295872-1171813649/instance-295872-1171813649.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node33/watcher-295872-1171813649 -o ROOT/results/node33/solver-295872-1171813649 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/295872-1171813649/cmusat /tmp/evaluation/295872-1171813649/instance-295872-1171813649.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  54161bb7f5d80f36a000875f17de5551

RANDOM SEED= 768588838

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node33.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        906600 kB
Buffers:         41640 kB
Cached:         987388 kB
SwapCached:       4164 kB
Active:         753604 kB
Inactive:       285948 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        906600 kB
SwapTotal:     4192956 kB
SwapFree:      4183908 kB
Dirty:            2596 kB
Writeback:           0 kB
Mapped:          15272 kB
Slab:            95776 kB
Committed_AS:   162660 kB
PageTables:       1408 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66562 MiB

End job on node33 on Sun Feb 18 16:07:31 UTC 2007