Trace number 297881

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.05 1200.56

General information on the benchmark

Namerandom/OnTreshold/3SAT/v450/
unif-k3-r4.25-v450-c1912-S1113882813-11.SAT.shuffled.cnf
MD5SUM77226f3880fdc77b8d075583e32b35e0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.009997
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1912
Sum of the clauses size5736
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31912
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  450                                                  |
0.00/0.00	c |  Number of clauses:    1912                                                 |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node26/watcher-297881-1171846610 -o ROOT/results/node26/solver-297881-1171846610 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/297881-1171846610/cmusat /tmp/evaluation/297881-1171846610/instance-297881-1171846610.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 14604
/proc/meminfo: memFree=796336/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=2312 CPUtime=0
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 191 0 0 0 0 0 0 0 18 0 1 0 204614643 2367488 174 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134539271 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 578 174 109 243 0 332 0

[startup+0.106938 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 14604
/proc/meminfo: memFree=796336/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=2716 CPUtime=0.1
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 300 0 0 0 10 0 0 0 18 0 1 0 204614643 2781184 283 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589715 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 679 283 118 243 0 433 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2716

[startup+0.515009 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 14604
/proc/meminfo: memFree=796336/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=3180 CPUtime=0.51
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 398 0 0 0 51 0 0 0 21 0 1 0 204614643 3256320 381 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 795 381 118 243 0 549 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3180

[startup+1.33815 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=794984/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=3448 CPUtime=1.33
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 491 0 0 0 133 0 0 0 25 0 1 0 204614643 3530752 474 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134581198 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 862 474 118 243 0 616 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3448

[startup+2.97444 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=793640/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=4684 CPUtime=2.97
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 768 0 0 0 297 0 0 0 25 0 1 0 204614643 4796416 751 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589690 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 1171 751 118 243 0 925 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 4684

[startup+6.254 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=792808/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=5592 CPUtime=6.24
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 1001 0 0 0 624 0 0 0 25 0 1 0 204614643 5726208 984 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589653 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 1398 984 118 243 0 1152 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 5592

[startup+12.7081 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=790376/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=7872 CPUtime=12.69
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 1638 0 0 0 1269 0 0 0 25 0 1 0 204614643 8060928 1504 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589792 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 1968 1504 118 243 0 1722 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 7872

[startup+25.5093 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=785320/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=13664 CPUtime=25.49
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 3312 0 0 0 2548 1 0 0 25 0 1 0 204614643 13991936 2772 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134581434 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 3416 2772 118 243 0 3170 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 13664

[startup+51.1208 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=783976/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=14528 CPUtime=51.1
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 4022 0 0 0 5108 2 0 0 25 0 1 0 204614643 14876672 3116 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589771 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 3632 3116 118 243 0 3386 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 14528

[startup+102.34 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=774504/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=25516 CPUtime=102.29
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 7167 0 0 0 10226 3 0 0 25 0 1 0 204614643 26128384 5472 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 6379 5472 118 243 0 6133 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 25516

[startup+162.371 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=773288/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=26140 CPUtime=162.3
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 7876 0 0 0 16226 4 0 0 25 0 1 0 204614643 26767360 5767 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 6535 5767 118 243 0 6289 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 26140

[startup+222.401 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14605
/proc/meminfo: memFree=771624/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=27480 CPUtime=222.31
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 8457 0 0 0 22226 5 0 0 25 0 1 0 204614643 28139520 6183 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 6870 6183 118 243 0 6624 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 27480

[startup+282.454 s]
/proc/loadavg: 1.00 1.00 1.00 2/84 14711
/proc/meminfo: memFree=766456/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=31084 CPUtime=282.31
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 9824 0 0 0 28221 10 0 0 25 0 1 0 204614643 31830016 7169 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 7771 7169 118 243 0 7525 0
Current children cumulated CPU time (s) 282.31
Current children cumulated vsize (KiB) 31084

[startup+342.511 s]
/proc/loadavg: 1.04 1.01 1.00 2/84 14783
/proc/meminfo: memFree=750328/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=50604 CPUtime=342.31
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 14984 0 0 0 34218 13 0 0 25 0 1 0 204614643 51818496 11159 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589690 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 12651 11159 118 243 0 12405 0
Current children cumulated CPU time (s) 342.31
Current children cumulated vsize (KiB) 50604

[startup+402.541 s]
/proc/loadavg: 1.01 1.01 1.00 2/78 14803
/proc/meminfo: memFree=751080/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=51000 CPUtime=402.3
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 15102 0 0 0 40217 13 0 0 25 0 1 0 204614643 52224000 11277 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134578838 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 12750 11277 118 243 0 12504 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 51000

[startup+462.568 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=750312/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=51616 CPUtime=462.31
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 15545 0 0 0 46217 14 0 0 25 0 1 0 204614643 52854784 11414 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589670 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 12904 11414 118 243 0 12658 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 51616

[startup+522.595 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=749800/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=51872 CPUtime=522.31
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 15986 0 0 0 52217 14 0 0 25 0 1 0 204614643 53116928 11591 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590155 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 12968 11591 118 243 0 12722 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 51872

[startup+582.623 s]
/proc/loadavg: 1.06 1.02 1.00 2/78 14803
/proc/meminfo: memFree=749160/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=52256 CPUtime=582.33
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 16165 0 0 0 58218 15 0 0 25 0 1 0 204614643 53510144 11770 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13064 11770 118 243 0 12818 0
Current children cumulated CPU time (s) 582.33
Current children cumulated vsize (KiB) 52256

[startup+642.661 s]
/proc/loadavg: 1.02 1.01 1.00 2/78 14803
/proc/meminfo: memFree=748840/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=52692 CPUtime=642.34
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 16543 0 0 0 64218 16 0 0 25 0 1 0 204614643 53956608 11858 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13173 11858 118 243 0 12927 0
Current children cumulated CPU time (s) 642.34
Current children cumulated vsize (KiB) 52692

[startup+702.689 s]
/proc/loadavg: 1.01 1.00 1.00 2/78 14803
/proc/meminfo: memFree=748072/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=53140 CPUtime=702.34
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17109 0 0 0 70218 16 0 0 25 0 1 0 204614643 54415360 12073 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13285 12073 118 243 0 13039 0
Current children cumulated CPU time (s) 702.34
Current children cumulated vsize (KiB) 53140

[startup+762.715 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=747880/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=53140 CPUtime=762.35
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17135 0 0 0 76218 17 0 0 25 0 1 0 204614643 54415360 12099 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13285 12099 118 243 0 13039 0
Current children cumulated CPU time (s) 762.35
Current children cumulated vsize (KiB) 53140

[startup+822.747 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=747432/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=53796 CPUtime=822.36
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17251 0 0 0 82219 17 0 0 25 0 1 0 204614643 55087104 12215 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13449 12215 118 243 0 13203 0
Current children cumulated CPU time (s) 822.36
Current children cumulated vsize (KiB) 53796

[startup+882.775 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=746664/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=53932 CPUtime=882.37
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17782 0 0 0 88219 18 0 0 25 0 1 0 204614643 55226368 12396 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589750 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13483 12396 118 243 0 13237 0
Current children cumulated CPU time (s) 882.37
Current children cumulated vsize (KiB) 53932

[startup+942.808 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=746536/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=54196 CPUtime=942.38
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17827 0 0 0 94220 18 0 0 25 0 1 0 204614643 55496704 12441 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13549 12441 118 243 0 13303 0
Current children cumulated CPU time (s) 942.38
Current children cumulated vsize (KiB) 54196

[startup+1002.84 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=746536/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=54460 CPUtime=1002.39
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 17874 0 0 0 100220 19 0 0 25 0 1 0 204614643 55767040 12488 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 13615 12488 118 243 0 13369 0
Current children cumulated CPU time (s) 1002.39
Current children cumulated vsize (KiB) 54460

[startup+1062.87 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=742376/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=58028 CPUtime=1062.4
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 18898 0 0 0 106219 21 0 0 25 0 1 0 204614643 59420672 13512 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 14507 13512 118 243 0 14261 0
Current children cumulated CPU time (s) 1062.4
Current children cumulated vsize (KiB) 58028

[startup+1122.89 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=741800/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=58620 CPUtime=1122.4
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 19415 0 0 0 112218 22 0 0 25 0 1 0 204614643 60026880 13645 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589536 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 14655 13645 118 243 0 14409 0
Current children cumulated CPU time (s) 1122.4
Current children cumulated vsize (KiB) 58620

[startup+1182.92 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=741544/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=58928 CPUtime=1182.41
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 19455 0 0 0 118219 22 0 0 25 0 1 0 204614643 60342272 13685 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 14732 13685 118 243 0 14486 0
Current children cumulated CPU time (s) 1182.41
Current children cumulated vsize (KiB) 58928



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.55 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 14803
/proc/meminfo: memFree=740968/2055920 swapFree=4131780/4192956
[pid=14604] ppid=14602 vsize=59500 CPUtime=1200.04
/proc/14604/stat : 14604 (cmusat) R 14602 14604 12475 0 -1 4194304 19596 0 0 0 119981 23 0 0 25 0 1 0 204614643 60928000 13826 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/14604/statm: 14875 13826 118 243 0 14629 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 59500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.56
CPU time (s): 1200.05
CPU user time (s): 1199.81
CPU system time (s): 0.238963
CPU usage (%): 99.9577
Max. virtual memory (cumulated for all children) (KiB): 59500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.81
system time used= 0.238963
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19596
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 20743

runsolver used 1.37179 second user time and 2.78858 second system time

The end

Launcher Data (download as text)

Begin job on node26 on Mon Feb 19 00:56:50 UTC 2007

IDJOB= 297881
IDBENCH= 19972
IDSOLVER= 121
FILE ID= node26/297881-1171846610

PBS_JOBID= 3839657

Free space on /tmp= 66561 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v450/unif-k3-r4.25-v450-c1912-S1113882813-11.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/297881-1171846610/cmusat /tmp/evaluation/297881-1171846610/instance-297881-1171846610.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node26/watcher-297881-1171846610 -o ROOT/results/node26/solver-297881-1171846610 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/297881-1171846610/cmusat /tmp/evaluation/297881-1171846610/instance-297881-1171846610.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  77226f3880fdc77b8d075583e32b35e0

RANDOM SEED= 508636702

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node26.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        796744 kB
Buffers:         44100 kB
Cached:        1073240 kB
SwapCached:      40904 kB
Active:         789764 kB
Inactive:       378868 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        796744 kB
SwapTotal:     4192956 kB
SwapFree:      4131780 kB
Dirty:            2480 kB
Writeback:           0 kB
Mapped:          30352 kB
Slab:            76176 kB
Committed_AS:   607500 kB
PageTables:       1684 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node26 on Mon Feb 19 01:16:52 UTC 2007