Trace number 299480

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.1 1200.53

General information on the benchmark

Namerandom/OnTreshold/3SAT/v650/
unif-k3-r4.261-v650-c2769-S1341479044-12.UNSAT.shuffled.cnf
MD5SUMbe59f67372654e4e0f143ff9a11e7d34
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of clauses2769
Sum of the clauses size8307
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32769
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  650                                                  |
0.00/0.00	c |  Number of clauses:    2769                                                 |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node26/watcher-299480-1171872188 -o ROOT/results/node26/solver-299480-1171872188 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/299480-1171872188/cmusat /tmp/evaluation/299480-1171872188/instance-299480-1171872188.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 19532
/proc/meminfo: memFree=647536/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=2452 CPUtime=0
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 214 0 0 0 0 0 0 0 18 0 1 0 207172426 2510848 197 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134530467 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 613 197 108 243 0 367 0

[startup+0.106648 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 19532
/proc/meminfo: memFree=647536/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=2836 CPUtime=0.1
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 324 0 0 0 10 0 0 0 18 0 1 0 207172426 2904064 307 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 135092575 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 709 307 118 243 0 463 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2836

[startup+0.514718 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 19532
/proc/meminfo: memFree=647536/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=3120 CPUtime=0.51
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 422 0 0 0 51 0 0 0 22 0 1 0 207172426 3194880 405 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589536 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 780 405 118 243 0 534 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3120

[startup+1.33486 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=645736/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=3984 CPUtime=1.33
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 591 0 0 0 133 0 0 0 25 0 1 0 207172426 4079616 574 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134581033 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 996 574 118 243 0 750 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3984

[startup+2.97114 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=645224/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=4536 CPUtime=2.96
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 737 0 0 0 296 0 0 0 25 0 1 0 207172426 4644864 720 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134592868 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 1134 720 118 243 0 888 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 4536

[startup+6.25071 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=642920/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=6636 CPUtime=6.23
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 1275 0 0 0 623 0 0 0 25 0 1 0 207172426 6795264 1225 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 1659 1225 118 243 0 1413 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 6636

[startup+12.7048 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=641384/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=7916 CPUtime=12.69
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 1703 0 0 0 1268 1 0 0 25 0 1 0 207172426 8105984 1584 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134581367 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 1979 1584 118 243 0 1733 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 7916

[startup+25.5101 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=637928/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=11672 CPUtime=25.49
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 2934 0 0 0 2548 1 0 0 25 0 1 0 207172426 11952128 2433 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 2918 2433 118 243 0 2672 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 11672

[startup+51.1245 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=634024/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=15216 CPUtime=51.1
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 4170 0 0 0 5107 3 0 0 25 0 1 0 207172426 15581184 3399 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 3804 3399 118 243 0 3558 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 15216

[startup+102.342 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=627304/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=22876 CPUtime=102.29
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 6588 0 0 0 10225 4 0 0 25 0 1 0 207172426 23425024 5089 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590155 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 5719 5089 118 243 0 5473 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 22876

[startup+162.376 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=621608/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=28144 CPUtime=162.3
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 8400 0 0 0 16224 6 0 0 25 0 1 0 207172426 28819456 6506 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 7036 6506 118 243 0 6790 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 28144

[startup+222.402 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=605928/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=46480 CPUtime=222.31
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 13159 0 0 0 22222 9 0 0 25 0 1 0 207172426 47595520 10420 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11620 10420 118 243 0 11374 0
Current children cumulated CPU time (s) 222.31
Current children cumulated vsize (KiB) 46480

[startup+282.434 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=605224/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=46620 CPUtime=282.32
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 13700 0 0 0 28222 10 0 0 25 0 1 0 207172426 47738880 10600 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11655 10600 118 243 0 11409 0
Current children cumulated CPU time (s) 282.32
Current children cumulated vsize (KiB) 46620

[startup+342.468 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=604840/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=46700 CPUtime=342.34
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 14007 0 0 0 34223 11 0 0 25 0 1 0 207172426 47820800 10700 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11675 10700 118 243 0 11429 0
Current children cumulated CPU time (s) 342.34
Current children cumulated vsize (KiB) 46700

[startup+402.501 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=604328/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=47220 CPUtime=402.34
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 14137 0 0 0 40223 11 0 0 25 0 1 0 207172426 48353280 10830 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11805 10830 118 243 0 11559 0
Current children cumulated CPU time (s) 402.34
Current children cumulated vsize (KiB) 47220

[startup+462.53 s]
/proc/loadavg: 1.03 1.01 1.00 2/78 19533
/proc/meminfo: memFree=603944/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=47312 CPUtime=462.35
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 14479 0 0 0 46223 12 0 0 25 0 1 0 207172426 48447488 10945 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11828 10945 118 243 0 11582 0
Current children cumulated CPU time (s) 462.35
Current children cumulated vsize (KiB) 47312

[startup+522.555 s]
/proc/loadavg: 1.01 1.01 1.00 2/78 19533
/proc/meminfo: memFree=603240/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=47872 CPUtime=522.36
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 14918 0 0 0 52223 13 0 0 25 0 1 0 207172426 49020928 11134 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 11968 11134 118 243 0 11722 0
Current children cumulated CPU time (s) 522.36
Current children cumulated vsize (KiB) 47872

[startup+582.584 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=602856/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=48144 CPUtime=582.37
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 14996 0 0 0 58224 13 0 0 25 0 1 0 207172426 49299456 11212 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 12036 11212 118 243 0 11790 0
Current children cumulated CPU time (s) 582.37
Current children cumulated vsize (KiB) 48144

[startup+642.617 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=598696/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=51852 CPUtime=642.38
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 16312 0 0 0 64223 15 0 0 25 0 1 0 207172426 53096448 12254 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589534 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 12963 12254 118 243 0 12717 0
Current children cumulated CPU time (s) 642.38
Current children cumulated vsize (KiB) 51852

[startup+702.65 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=595432/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=54984 CPUtime=702.39
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 17137 0 0 0 70223 16 0 0 25 0 1 0 207172426 56303616 13079 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 13746 13079 118 243 0 13500 0
Current children cumulated CPU time (s) 702.39
Current children cumulated vsize (KiB) 54984

[startup+762.68 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=593576/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=56644 CPUtime=762.39
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 17871 0 0 0 76222 17 0 0 25 0 1 0 207172426 58003456 13512 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 14161 13512 118 243 0 13915 0
Current children cumulated CPU time (s) 762.39
Current children cumulated vsize (KiB) 56644

[startup+822.71 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=593128/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=57268 CPUtime=822.41
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 17978 0 0 0 82223 18 0 0 25 0 1 0 207172426 58642432 13619 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 14317 13619 118 243 0 14071 0
Current children cumulated CPU time (s) 822.41
Current children cumulated vsize (KiB) 57268

[startup+882.735 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=565672/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=89852 CPUtime=882.41
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 26222 0 0 0 88219 22 0 0 25 0 1 0 207172426 92008448 20488 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22463 20488 118 243 0 22217 0
Current children cumulated CPU time (s) 882.41
Current children cumulated vsize (KiB) 89852

[startup+942.766 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=565288/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90176 CPUtime=942.42
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 26651 0 0 0 94220 22 0 0 25 0 1 0 207172426 92340224 20587 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22544 20587 118 243 0 22298 0
Current children cumulated CPU time (s) 942.42
Current children cumulated vsize (KiB) 90176

[startup+1002.8 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=565224/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90176 CPUtime=1002.43
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 26664 0 0 0 100220 23 0 0 25 0 1 0 207172426 92340224 20600 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22544 20600 118 243 0 22298 0
Current children cumulated CPU time (s) 1002.43
Current children cumulated vsize (KiB) 90176

[startup+1062.83 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=565096/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90308 CPUtime=1062.45
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 26716 0 0 0 106221 24 0 0 25 0 1 0 207172426 92475392 20652 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589715 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22577 20652 118 243 0 22331 0
Current children cumulated CPU time (s) 1062.45
Current children cumulated vsize (KiB) 90308

[startup+1122.86 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 19533
/proc/meminfo: memFree=564072/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90904 CPUtime=1122.45
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 27312 0 0 0 112221 24 0 0 25 0 1 0 207172426 93085696 20885 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590180 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22726 20885 118 243 0 22480 0
Current children cumulated CPU time (s) 1122.45
Current children cumulated vsize (KiB) 90904

[startup+1182.89 s]
/proc/loadavg: 1.06 1.01 1.00 2/78 19533
/proc/meminfo: memFree=564072/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90904 CPUtime=1182.46
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 27313 0 0 0 118221 25 0 0 25 0 1 0 207172426 93085696 20886 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22726 20886 118 243 0 22480 0
Current children cumulated CPU time (s) 1182.46
Current children cumulated vsize (KiB) 90904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.51 s]
/proc/loadavg: 1.04 1.01 1.00 2/78 19533
/proc/meminfo: memFree=564072/2055920 swapFree=4131780/4192956
[pid=19532] ppid=19530 vsize=90904 CPUtime=1200.08
/proc/19532/stat : 19532 (cmusat) R 19530 19532 12475 0 -1 4194304 27313 0 0 0 119983 25 0 0 25 0 1 0 207172426 93085696 20886 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/19532/statm: 22726 20886 118 243 0 22480 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 90904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.53
CPU time (s): 1200.1
CPU user time (s): 1199.83
CPU system time (s): 0.269958
CPU usage (%): 99.9645
Max. virtual memory (cumulated for all children) (KiB): 90904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.83
system time used= 0.269958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27313
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 25816

runsolver used 1.48777 second user time and 2.72358 second system time

The end

Launcher Data (download as text)

Begin job on node26 on Mon Feb 19 08:03:08 UTC 2007

IDJOB= 299480
IDBENCH= 20011
IDSOLVER= 121
FILE ID= node26/299480-1171872188

PBS_JOBID= 3839657

Free space on /tmp= 66561 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v650/unif-k3-r4.261-v650-c2769-S1341479044-12.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/299480-1171872188/cmusat /tmp/evaluation/299480-1171872188/instance-299480-1171872188.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node26/watcher-299480-1171872188 -o ROOT/results/node26/solver-299480-1171872188 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/299480-1171872188/cmusat /tmp/evaluation/299480-1171872188/instance-299480-1171872188.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  be59f67372654e4e0f143ff9a11e7d34

RANDOM SEED= 106379050

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node26.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        647944 kB
Buffers:         53564 kB
Cached:        1189304 kB
SwapCached:      40904 kB
Active:         821928 kB
Inactive:       472336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        647944 kB
SwapTotal:     4192956 kB
SwapFree:      4131780 kB
Dirty:            2496 kB
Writeback:           0 kB
Mapped:          30480 kB
Slab:            99324 kB
Committed_AS:   622916 kB
PageTables:       1684 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node26 on Mon Feb 19 08:23:10 UTC 2007