Trace number 294929

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.04 1200.34

General information on the benchmark

Namerandom/OnTreshold/7SAT/v65/
unif-k7-r89-v65-c5785-S1284960805-05.UNSAT.shuffled.cnf
MD5SUM7faec4d52a8413a8449c21f2ea11cbf4
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables65
Number of clauses5785
Sum of the clauses size40495
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55785

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  65                                                   |
0.00/0.01	c |  Number of clauses:    5785                                                 |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node61/watcher-294929-1171797193 -o ROOT/results/node61/solver-294929-1171797193 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/294929-1171797193/cmusat /tmp/evaluation/294929-1171797193/instance-294929-1171797193.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 3895
/proc/meminfo: memFree=896752/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=2316 CPUtime=0
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 213 0 0 0 0 0 0 0 18 0 1 0 199676217 2371584 196 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 135092575 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 579 197 96 243 0 333 0

[startup+0.106938 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 3895
/proc/meminfo: memFree=896752/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=2740 CPUtime=0.1
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 323 0 0 0 10 0 0 0 18 0 1 0 199676217 2805760 306 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134530328 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 685 306 109 243 0 439 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2740

[startup+0.514975 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 3895
/proc/meminfo: memFree=896752/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=3796 CPUtime=0.51
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 699 0 0 0 51 0 0 0 21 0 1 0 199676217 3887104 563 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590202 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 949 563 118 243 0 703 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3796

[startup+1.33505 s]
/proc/loadavg: 0.91 0.95 0.98 2/65 3896
/proc/meminfo: memFree=894632/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=4148 CPUtime=1.33
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 793 0 0 0 133 0 0 0 25 0 1 0 199676217 4247552 657 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590259 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 1037 657 118 243 0 791 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 4148

[startup+2.97121 s]
/proc/loadavg: 0.91 0.95 0.98 2/65 3896
/proc/meminfo: memFree=893544/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=5348 CPUtime=2.96
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 1093 0 0 0 296 0 0 0 25 0 1 0 199676217 5476352 923 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590173 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 1337 923 118 243 0 1091 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5348

[startup+6.25353 s]
/proc/loadavg: 0.92 0.95 0.98 2/65 3896
/proc/meminfo: memFree=892648/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=6040 CPUtime=6.24
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 1343 0 0 0 624 0 0 0 25 0 1 0 199676217 6184960 1103 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 135092575 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 1510 1103 118 243 0 1264 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 6040

[startup+12.7031 s]
/proc/loadavg: 0.93 0.95 0.98 2/65 3896
/proc/meminfo: memFree=889904/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=9164 CPUtime=12.69
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 2383 0 0 0 1268 1 0 0 25 0 1 0 199676217 9383936 1763 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 2291 1763 118 243 0 2045 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 9164

[startup+25.5074 s]
/proc/loadavg: 0.94 0.96 0.98 2/65 3896
/proc/meminfo: memFree=887920/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=10780 CPUtime=25.49
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 3209 0 0 0 2548 1 0 0 25 0 1 0 199676217 11038720 2271 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589660 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 2695 2271 118 243 0 2449 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 10780

[startup+51.1118 s]
/proc/loadavg: 0.96 0.96 0.98 2/65 3896
/proc/meminfo: memFree=882288/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=17200 CPUtime=51.09
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 5441 0 0 0 5106 3 0 0 25 0 1 0 199676217 17612800 3662 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589715 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 4300 3662 118 243 0 4054 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 17200

[startup+102.316 s]
/proc/loadavg: 0.98 0.96 0.98 2/65 3896
/proc/meminfo: memFree=878512/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=20652 CPUtime=102.28
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 6828 0 0 0 10224 4 0 0 25 0 1 0 199676217 21147648 4649 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 5163 4649 118 243 0 4917 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 20652

[startup+162.335 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=868208/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=33176 CPUtime=162.28
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 10586 0 0 0 16222 6 0 0 25 0 1 0 199676217 33972224 7162 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 8294 7162 118 243 0 8048 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 33176

[startup+222.348 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=866992/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=33860 CPUtime=222.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 11317 0 0 0 22222 7 0 0 25 0 1 0 199676217 34672640 7460 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 8465 7460 118 243 0 8219 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 33860

[startup+282.361 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=865968/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=34688 CPUtime=282.28
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 11855 0 0 0 28221 7 0 0 25 0 1 0 199676217 35520512 7717 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589753 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 8672 7717 118 243 0 8426 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 34688

[startup+342.378 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=863792/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=36608 CPUtime=342.28
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 12657 0 0 0 34220 8 0 0 25 0 1 0 199676217 37486592 8247 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 9152 8247 118 243 0 8906 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 36608

[startup+402.395 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=861104/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=39044 CPUtime=402.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 13665 0 0 0 40220 9 0 0 25 0 1 0 199676217 39981056 8924 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 9761 8924 118 243 0 9515 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 39044

[startup+462.412 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=857776/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=42312 CPUtime=462.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 14913 0 0 0 46219 10 0 0 25 0 1 0 199676217 43327488 9748 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 10578 9748 118 243 0 10332 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 42312

[startup+522.429 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=857520/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=42496 CPUtime=522.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 14978 0 0 0 52219 10 0 0 25 0 1 0 199676217 43515904 9813 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 10624 9813 118 243 0 10378 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 42496

[startup+582.445 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=841200/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=64184 CPUtime=582.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 20538 0 0 0 58218 12 0 0 25 0 1 0 199676217 65724416 13892 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16046 13892 118 243 0 15800 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 64184

[startup+642.461 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=840880/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=64320 CPUtime=642.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 20960 0 0 0 64217 12 0 0 25 0 1 0 199676217 65863680 13956 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16080 13956 118 243 0 15834 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 64320

[startup+702.475 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=840944/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=64320 CPUtime=702.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 20961 0 0 0 70217 12 0 0 25 0 1 0 199676217 65863680 13957 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16080 13957 118 243 0 15834 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 64320

[startup+762.489 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=839664/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=64988 CPUtime=762.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 21660 0 0 0 76216 13 0 0 25 0 1 0 199676217 66547712 14264 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589545 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16247 14264 118 243 0 16001 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 64988

[startup+822.509 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=839472/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=65380 CPUtime=822.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 21756 0 0 0 82217 13 0 0 25 0 1 0 199676217 66949120 14327 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16345 14327 118 243 0 16099 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 65380

[startup+882.528 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=838512/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=65680 CPUtime=882.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 22432 0 0 0 88216 14 0 0 25 0 1 0 199676217 67256320 14573 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589495 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16420 14573 118 243 0 16174 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 65680

[startup+942.542 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=837744/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=66720 CPUtime=942.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 22718 0 0 0 94216 14 0 0 25 0 1 0 199676217 68321280 14728 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16680 14728 118 243 0 16434 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 66720

[startup+1002.55 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=837744/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=66852 CPUtime=1002.29
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 22759 0 0 0 100215 14 0 0 25 0 1 0 199676217 68456448 14769 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16713 14769 118 243 0 16467 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 66852

[startup+1062.57 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=837232/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=66852 CPUtime=1062.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 22874 0 0 0 106216 14 0 0 25 0 1 0 199676217 68456448 14884 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16713 14884 118 243 0 16467 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 66852

[startup+1122.59 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=836784/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=67036 CPUtime=1122.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 23473 0 0 0 112215 15 0 0 25 0 1 0 199676217 68644864 15011 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16759 15011 118 243 0 16513 0
Current children cumulated CPU time (s) 1122.3
Current children cumulated vsize (KiB) 67036

[startup+1182.6 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=836464/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=67428 CPUtime=1182.3
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 23536 0 0 0 118215 15 0 0 25 0 1 0 199676217 69046272 15074 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134590173 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16857 15074 118 243 0 16611 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 67428



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.32 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=836464/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=67428 CPUtime=1200.02
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 23541 0 0 0 119987 15 0 0 25 0 1 0 199676217 69046272 15079 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16857 15079 118 243 0 16611 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 67428

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.32 s]
/proc/loadavg: 0.99 0.97 0.98 2/65 3896
/proc/meminfo: memFree=836464/2055920 swapFree=4183164/4192956
[pid=3895] ppid=3893 vsize=67428 CPUtime=1200.02
/proc/3895/stat : 3895 (cmusat) R 3893 3895 2304 0 -1 4194304 23541 0 0 0 119987 15 0 0 25 0 1 0 199676217 69046272 15079 18446744073709551615 134512640 135508737 4294956640 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/3895/statm: 16857 15079 118 243 0 16611 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 67428

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.34
CPU time (s): 1200.04
CPU user time (s): 1199.87
CPU system time (s): 0.167974
CPU usage (%): 99.9752
Max. virtual memory (cumulated for all children) (KiB): 67428

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.87
system time used= 0.167974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23541
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1628

runsolver used 0.820875 second user time and 2.38764 second system time

The end

Launcher Data (download as text)

Begin job on node61 on Sun Feb 18 11:13:13 UTC 2007

IDJOB= 294929
IDBENCH= 19900
IDSOLVER= 121
FILE ID= node61/294929-1171797193

PBS_JOBID= 3839572

Free space on /tmp= 66562 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/7SAT/v65/unif-k7-r89-v65-c5785-S1284960805-05.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/294929-1171797193/cmusat /tmp/evaluation/294929-1171797193/instance-294929-1171797193.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node61/watcher-294929-1171797193 -o ROOT/results/node61/solver-294929-1171797193 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/294929-1171797193/cmusat /tmp/evaluation/294929-1171797193/instance-294929-1171797193.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  7faec4d52a8413a8449c21f2ea11cbf4

RANDOM SEED= 979170781

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node61.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        897160 kB
Buffers:         37612 kB
Cached:        1019280 kB
SwapCached:       3636 kB
Active:         422620 kB
Inactive:       644240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        897160 kB
SwapTotal:     4192956 kB
SwapFree:      4183164 kB
Dirty:            2588 kB
Writeback:           0 kB
Mapped:          15972 kB
Slab:            78012 kB
Committed_AS:   565680 kB
PageTables:       1392 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66562 MiB

End job on node61 on Sun Feb 18 11:33:15 UTC 2007