Trace number 299726

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.05 1200.38

General information on the benchmark

Namerandom/OnTreshold/3SAT/v400/
unif-k3-r4.26-v400-c1704-S1752604460-10.SAT.shuffled.cnf
MD5SUM26af42426194a43df413cae8f2aea334
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.05599
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  400                                                  |
0.00/0.00	c |  Number of clauses:    1704                                                 |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node40/watcher-299726-1171876701 -o ROOT/results/node40/solver-299726-1171876701 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/299726-1171876701/cmusat /tmp/evaluation/299726-1171876701/instance-299726-1171876701.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.04 1.00 1.00 3/64 17350
/proc/meminfo: memFree=760888/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=2312 CPUtime=0
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 191 0 0 0 0 0 0 0 18 0 1 0 112704339 2367488 174 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134534552 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 578 175 109 243 0 332 0

[startup+0.106302 s]
/proc/loadavg: 1.04 1.00 1.00 3/64 17350
/proc/meminfo: memFree=760888/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=2596 CPUtime=0.1
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 273 0 0 0 10 0 0 0 18 0 1 0 112704339 2658304 256 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134581434 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 649 256 118 243 0 403 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2596

[startup+0.514353 s]
/proc/loadavg: 1.04 1.00 1.00 3/64 17350
/proc/meminfo: memFree=760888/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=3024 CPUtime=0.51
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 369 0 0 0 51 0 0 0 21 0 1 0 112704339 3096576 352 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134521795 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 756 352 118 243 0 510 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3024

[startup+1.33446 s]
/proc/loadavg: 1.03 1.00 1.00 2/65 17351
/proc/meminfo: memFree=759664/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=3336 CPUtime=1.33
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 464 0 0 0 133 0 0 0 25 0 1 0 112704339 3416064 447 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590137 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 834 447 118 243 0 588 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3336

[startup+2.97067 s]
/proc/loadavg: 1.03 1.00 1.00 2/65 17351
/proc/meminfo: memFree=758576/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=4396 CPUtime=2.96
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 679 0 0 0 296 0 0 0 25 0 1 0 112704339 4501504 662 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589790 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 1099 662 118 243 0 853 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 4396

[startup+6.24709 s]
/proc/loadavg: 1.03 1.00 1.00 2/65 17352
/proc/meminfo: memFree=757552/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=6624 CPUtime=6.24
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 1232 0 0 0 624 0 0 0 25 0 1 0 112704339 6782976 1175 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 1656 1175 118 243 0 1410 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 6624

[startup+12.7029 s]
/proc/loadavg: 1.03 1.00 1.00 2/65 17353
/proc/meminfo: memFree=755248/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=7432 CPUtime=12.69
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 1562 0 0 0 1269 0 0 0 25 0 1 0 112704339 7610368 1428 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589515 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 1858 1428 118 243 0 1612 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 7432

[startup+25.5076 s]
/proc/loadavg: 1.02 1.00 1.00 2/65 17353
/proc/meminfo: memFree=752176/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=11136 CPUtime=25.49
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 2799 0 0 0 2548 1 0 0 25 0 1 0 112704339 11403264 2216 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590804 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 2784 2216 118 243 0 2538 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 11136

[startup+51.1139 s]
/proc/loadavg: 1.01 1.00 1.00 3/65 17353
/proc/meminfo: memFree=749104/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=13684 CPUtime=51.09
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 3868 0 0 0 5108 1 0 0 25 0 1 0 112704339 14012416 2971 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590137 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 3421 2971 118 243 0 3175 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 13684

[startup+102.324 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=743088/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=20904 CPUtime=102.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 6134 0 0 0 10226 3 0 0 25 0 1 0 112704339 21405696 4490 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 5226 4490 118 243 0 4980 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 20904

[startup+162.344 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=740080/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=23412 CPUtime=162.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 7295 0 0 0 16225 4 0 0 25 0 1 0 112704339 23973888 5225 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 5853 5225 118 243 0 5607 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 23412

[startup+222.361 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=737456/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=25828 CPUtime=222.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 8138 0 0 0 22225 4 0 0 25 0 1 0 112704339 26447872 5897 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 6457 5897 118 243 0 6211 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 25828

[startup+282.375 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=726064/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=40188 CPUtime=282.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 12188 0 0 0 28223 6 0 0 25 0 1 0 112704339 41152512 8707 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589923 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10047 8707 118 243 0 9801 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 40188

[startup+342.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=725104/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=40924 CPUtime=342.28
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 12658 0 0 0 34222 6 0 0 25 0 1 0 112704339 41906176 8951 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10231 8951 118 243 0 9985 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 40924

[startup+402.409 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=724272/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=41448 CPUtime=402.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 12859 0 0 0 40222 7 0 0 25 0 1 0 112704339 42442752 9119 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590173 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10362 9119 118 243 0 10116 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 41448

[startup+462.429 s]
/proc/loadavg: 1.04 1.01 1.00 2/65 17353
/proc/meminfo: memFree=724272/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=41544 CPUtime=462.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 13143 0 0 0 46222 7 0 0 25 0 1 0 112704339 42541056 9155 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10386 9155 118 243 0 10140 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 41544

[startup+522.448 s]
/proc/loadavg: 1.01 1.01 1.00 2/65 17353
/proc/meminfo: memFree=723376/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=42036 CPUtime=522.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 13634 0 0 0 52222 7 0 0 25 0 1 0 112704339 43044864 9374 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589495 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10509 9374 118 243 0 10263 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 42036

[startup+582.465 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=721136/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=43872 CPUtime=582.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 14485 0 0 0 58221 8 0 0 25 0 1 0 112704339 44924928 9926 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589814 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 10968 9926 118 243 0 10722 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 43872

[startup+642.486 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=720752/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=44396 CPUtime=642.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 14606 0 0 0 64221 8 0 0 25 0 1 0 112704339 45461504 10014 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 11099 10014 118 243 0 10853 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 44396

[startup+702.503 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=718576/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=46636 CPUtime=702.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 15220 0 0 0 70220 9 0 0 25 0 1 0 112704339 47755264 10595 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590150 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 11659 10595 118 243 0 11413 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 46636

[startup+762.52 s]
/proc/loadavg: 1.03 1.01 1.00 2/65 17353
/proc/meminfo: memFree=716528/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=48496 CPUtime=762.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 16052 0 0 0 76219 10 0 0 25 0 1 0 112704339 49659904 11098 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 12124 11098 118 243 0 11878 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 48496

[startup+822.538 s]
/proc/loadavg: 1.01 1.01 1.00 2/65 17353
/proc/meminfo: memFree=716336/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=48656 CPUtime=822.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 16114 0 0 0 82219 10 0 0 25 0 1 0 112704339 49823744 11160 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589534 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 12164 11160 118 243 0 11918 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 48656

[startup+882.553 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=711984/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=52556 CPUtime=882.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 17584 0 0 0 88218 11 0 0 25 0 1 0 112704339 53817344 12236 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590157 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 13139 12236 118 243 0 12893 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 52556

[startup+942.57 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=711728/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=52960 CPUtime=942.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 17675 0 0 0 94218 11 0 0 25 0 1 0 112704339 54231040 12294 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589771 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 13240 12294 118 243 0 12994 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 52960

[startup+1002.59 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=711472/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=53268 CPUtime=1002.29
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 17757 0 0 0 100218 11 0 0 25 0 1 0 112704339 54546432 12376 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 13317 12376 118 243 0 13071 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 53268

[startup+1062.61 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=709616/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=55112 CPUtime=1062.3
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 18210 0 0 0 106218 12 0 0 25 0 1 0 112704339 56434688 12829 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 13778 12829 118 243 0 13532 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 55112

[startup+1122.63 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=688880/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=82104 CPUtime=1122.31
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 25480 0 0 0 112215 16 0 0 25 0 1 0 112704339 84074496 18007 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589518 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 20526 18007 118 243 0 20280 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 82104

[startup+1182.65 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=688624/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=82364 CPUtime=1182.31
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 25530 0 0 0 118215 16 0 0 25 0 1 0 112704339 84340736 18057 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134590282 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 20591 18057 118 243 0 20345 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 82364



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=688624/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=82364 CPUtime=1200.03
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 25530 0 0 0 119987 16 0 0 25 0 1 0 112704339 84340736 18057 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 20591 18057 118 243 0 20345 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 82364

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 17353
/proc/meminfo: memFree=688624/2055920 swapFree=4183864/4192956
[pid=17350] ppid=17348 vsize=82364 CPUtime=1200.03
/proc/17350/stat : 17350 (cmusat) R 17348 17350 16343 0 -1 4194304 25530 0 0 0 119987 16 0 0 25 0 1 0 112704339 84340736 18057 18446744073709551615 134512640 135508737 4294956720 18446744073709551615 134589524 0 0 4096 35 0 0 0 17 1 0 0
/proc/17350/statm: 20591 18057 118 243 0 20345 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 82364

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.38
CPU time (s): 1200.05
CPU user time (s): 1199.87
CPU system time (s): 0.175973
CPU usage (%): 99.9719
Max. virtual memory (cumulated for all children) (KiB): 82364

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.87
system time used= 0.175973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25530
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 2540

runsolver used 0.832873 second user time and 2.37364 second system time

The end

Launcher Data (download as text)

Begin job on node40 on Mon Feb 19 09:18:21 UTC 2007

IDJOB= 299726
IDBENCH= 20017
IDSOLVER= 121
FILE ID= node40/299726-1171876701

PBS_JOBID= 3839768

Free space on /tmp= 66561 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v400/unif-k3-r4.26-v400-c1704-S1752604460-10.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/299726-1171876701/cmusat /tmp/evaluation/299726-1171876701/instance-299726-1171876701.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node40/watcher-299726-1171876701 -o ROOT/results/node40/solver-299726-1171876701 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/299726-1171876701/cmusat /tmp/evaluation/299726-1171876701/instance-299726-1171876701.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  26af42426194a43df413cae8f2aea334

RANDOM SEED= 729875002

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node40.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.242
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.242
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        761360 kB
Buffers:         51052 kB
Cached:        1120416 kB
SwapCached:       4252 kB
Active:         829396 kB
Inactive:       352904 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        761360 kB
SwapTotal:     4192956 kB
SwapFree:      4183864 kB
Dirty:            2468 kB
Writeback:           0 kB
Mapped:          15488 kB
Slab:            98360 kB
Committed_AS:   183592 kB
PageTables:       1412 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node40 on Mon Feb 19 09:38:23 UTC 2007