Trace number 302842

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT 2007-02-08? (TO) 1200.04 1200.32

General information on the benchmark

Namerandom/LargeSize/7SAT/v240/
unif-k7-r85-v240-c20400-S660110840-06.cnf
MD5SUM4b21b8e0976302c1b0731a8b86b306d2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables240
Number of clauses20400
Sum of the clauses size142800
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520400

Solver Data (download as text)

0.00/0.00	c Pre-processing provided 0 assignments
0.00/0.00	c |  Number of variables:  240                                                  |
0.00/0.04	c |  Number of clauses:    20400                                                |

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node3/watcher-302842-1172021098 -o ROOT/results/node3/solver-302842-1172021098 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/302842-1172021098/cmusat /tmp/evaluation/302842-1172021098/instance-302842-1172021098.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 15672
/proc/meminfo: memFree=740776/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=2316 CPUtime=0
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 321 0 0 0 0 0 0 0 18 0 1 0 222064639 2371584 304 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 135092575 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 579 305 96 243 0 333 0

[startup+0.10695 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 15672
/proc/meminfo: memFree=740776/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=4164 CPUtime=0.1
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 796 0 0 0 10 0 0 0 18 0 1 0 222064639 4263936 779 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134530334 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 1041 779 107 243 0 795 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 4164

[startup+0.514983 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 15672
/proc/meminfo: memFree=740776/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=4328 CPUtime=0.5
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 843 0 0 0 50 0 0 0 22 0 1 0 222064639 4431872 826 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134530328 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 1082 826 108 243 0 836 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 4328

[startup+1.33705 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=736352/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=6684 CPUtime=1.33
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 2019 0 0 0 132 1 0 0 25 0 1 0 222064639 6844416 1338 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134580424 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 1671 1338 118 243 0 1425 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 6684

[startup+2.97819 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=733664/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=9700 CPUtime=2.96
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 3021 0 0 0 295 1 0 0 25 0 1 0 222064639 9932800 2111 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589545 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 2425 2111 118 243 0 2179 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 9700

[startup+6.25446 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=731424/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=10776 CPUtime=6.24
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 3449 0 0 0 622 2 0 0 25 0 1 0 222064639 11034624 2414 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589756 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 2694 2414 118 243 0 2448 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 10776

[startup+12.711 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=729312/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=12656 CPUtime=12.7
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 4123 0 0 0 1268 2 0 0 25 0 1 0 222064639 12959744 2883 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 3164 2883 118 243 0 2918 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 12656

[startup+25.511 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=721632/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=21352 CPUtime=25.49
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 6430 0 0 0 2546 3 0 0 25 0 1 0 222064639 21864448 4798 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134590173 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 5338 4798 118 243 0 5092 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 21352

[startup+51.1221 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=720992/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=21776 CPUtime=51.1
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 6799 0 0 0 5106 4 0 0 25 0 1 0 222064639 22298624 4977 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 5444 4977 118 243 0 5198 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 21776

[startup+102.338 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=713376/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=29664 CPUtime=102.3
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 9349 0 0 0 10224 6 0 0 25 0 1 0 222064639 30375936 7060 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 7416 7060 118 243 0 7170 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 29664

[startup+162.365 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=689760/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=54616 CPUtime=162.32
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 16108 0 0 0 16222 10 0 0 25 0 1 0 222064639 55926784 12740 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 13654 12740 118 243 0 13408 0
Current children cumulated CPU time (s) 162.32
Current children cumulated vsize (KiB) 54616

[startup+222.394 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=689184/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=54724 CPUtime=222.33
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 16593 0 0 0 22223 10 0 0 25 0 1 0 222064639 56037376 12876 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589650 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 13681 12876 118 243 0 13435 0
Current children cumulated CPU time (s) 222.33
Current children cumulated vsize (KiB) 54724

[startup+282.423 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=688864/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=54784 CPUtime=282.35
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 16863 0 0 0 28224 11 0 0 25 0 1 0 222064639 56098816 12951 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 13696 12951 118 243 0 13450 0
Current children cumulated CPU time (s) 282.35
Current children cumulated vsize (KiB) 54784

[startup+342.452 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=688544/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=54852 CPUtime=342.36
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 17159 0 0 0 34224 12 0 0 25 0 1 0 222064639 56168448 13037 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 13713 13037 118 243 0 13467 0
Current children cumulated CPU time (s) 342.36
Current children cumulated vsize (KiB) 54852

[startup+402.487 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=685408/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=57764 CPUtime=402.38
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 18175 0 0 0 40224 14 0 0 25 0 1 0 222064639 59150336 13826 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589690 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 14441 13826 118 243 0 14195 0
Current children cumulated CPU time (s) 402.38
Current children cumulated vsize (KiB) 57764

[startup+462.516 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=680608/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=62316 CPUtime=462.4
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 19631 0 0 0 46223 17 0 0 25 0 1 0 222064639 63811584 15036 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589663 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 15579 15036 118 243 0 15333 0
Current children cumulated CPU time (s) 462.4
Current children cumulated vsize (KiB) 62316

[startup+522.544 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=675872/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=67076 CPUtime=522.41
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 20851 0 0 0 52222 19 0 0 25 0 1 0 222064639 68685824 16256 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589593 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 16769 16256 118 243 0 16523 0
Current children cumulated CPU time (s) 522.41
Current children cumulated vsize (KiB) 67076

[startup+582.572 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=674720/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=68084 CPUtime=582.43
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 21362 0 0 0 58223 20 0 0 25 0 1 0 222064639 69718016 16500 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134580019 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 17021 16500 118 243 0 16775 0
Current children cumulated CPU time (s) 582.43
Current children cumulated vsize (KiB) 68084

[startup+642.61 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=668576/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=73992 CPUtime=642.45
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 23186 0 0 0 64223 22 0 0 25 0 1 0 222064639 75767808 18035 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134581134 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 18498 18035 118 243 0 18252 0
Current children cumulated CPU time (s) 642.45
Current children cumulated vsize (KiB) 73992

[startup+702.64 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=668384/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=73992 CPUtime=702.47
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 23220 0 0 0 70224 23 0 0 25 0 1 0 222064639 75767808 18069 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589811 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 18498 18069 118 243 0 18252 0
Current children cumulated CPU time (s) 702.47
Current children cumulated vsize (KiB) 73992

[startup+762.67 s]
/proc/loadavg: 1.00 1.00 1.00 3/78 15673
/proc/meminfo: memFree=628128/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=118644 CPUtime=762.48
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 34803 0 0 0 76222 26 0 0 25 0 1 0 222064639 121491456 28061 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134590140 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 29661 28061 118 243 0 29415 0
Current children cumulated CPU time (s) 762.48
Current children cumulated vsize (KiB) 118644

[startup+822.704 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15673
/proc/meminfo: memFree=628192/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=118644 CPUtime=822.5
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 34803 0 0 0 82223 27 0 0 25 0 1 0 222064639 121491456 28061 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589506 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 29661 28061 118 243 0 29415 0
Current children cumulated CPU time (s) 822.5
Current children cumulated vsize (KiB) 118644

[startup+882.737 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=626400/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120132 CPUtime=882.52
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35295 0 0 0 88224 28 0 0 25 0 1 0 222064639 123015168 28553 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134578847 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30033 28553 118 243 0 29787 0
Current children cumulated CPU time (s) 882.52
Current children cumulated vsize (KiB) 120132

[startup+942.767 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=626400/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120132 CPUtime=942.53
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35297 0 0 0 94225 28 0 0 25 0 1 0 222064639 123015168 28555 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30033 28555 118 243 0 29787 0
Current children cumulated CPU time (s) 942.53
Current children cumulated vsize (KiB) 120132

[startup+1002.79 s]
/proc/loadavg: 1.00 1.00 1.00 3/78 15675
/proc/meminfo: memFree=626400/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120132 CPUtime=1002.55
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35298 0 0 0 100226 29 0 0 25 0 1 0 222064639 123015168 28556 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30033 28556 118 243 0 29787 0
Current children cumulated CPU time (s) 1002.55
Current children cumulated vsize (KiB) 120132

[startup+1062.83 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=626016/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120132 CPUtime=1062.56
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35389 0 0 0 106227 29 0 0 25 0 1 0 222064639 123015168 28647 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30033 28647 118 243 0 29787 0
Current children cumulated CPU time (s) 1062.56
Current children cumulated vsize (KiB) 120132

[startup+1122.85 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=625696/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120264 CPUtime=1122.58
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35839 0 0 0 112228 30 0 0 25 0 1 0 222064639 123150336 28725 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589676 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30066 28725 118 243 0 29820 0
Current children cumulated CPU time (s) 1122.58
Current children cumulated vsize (KiB) 120264

[startup+1182.88 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=625760/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120264 CPUtime=1182.6
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35839 0 0 0 118229 31 0 0 25 0 1 0 222064639 123150336 28725 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30066 28725 118 243 0 29820 0
Current children cumulated CPU time (s) 1182.6
Current children cumulated vsize (KiB) 120264



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/78 15675
/proc/meminfo: memFree=625760/2055920 swapFree=4192812/4192956
[pid=15672] ppid=15670 vsize=120264 CPUtime=1200.01
/proc/15672/stat : 15672 (cmusat) R 15670 15672 14582 0 -1 4194304 35839 0 0 0 119970 31 0 0 25 0 1 0 222064639 123150336 28725 18446744073709551615 134512640 135508737 4294956624 18446744073709551615 134589601 0 0 4096 35 0 0 0 17 1 0 0
/proc/15672/statm: 30066 28725 118 243 0 29820 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 120264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.32
CPU time (s): 1200.04
CPU user time (s): 1199.71
CPU system time (s): 0.329949
CPU usage (%): 99.9764
Max. virtual memory (cumulated for all children) (KiB): 120264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.71
system time used= 0.329949
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35839
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 23822

runsolver used 1.47877 second user time and 2.74458 second system time

The end

Launcher Data (download as text)

Begin job on node3 on Wed Feb 21 01:24:58 UTC 2007

IDJOB= 302842
IDBENCH= 20093
IDSOLVER= 121
FILE ID= node3/302842-1172021098

PBS_JOBID= 3849144

Free space on /tmp= 66547 MiB

SOLVER NAME= CMUSAT 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/7SAT/v240/unif-k7-r85-v240-c20400-S660110840-06.cnf
COMMAND LINE= /tmp/evaluation/302842-1172021098/cmusat /tmp/evaluation/302842-1172021098/instance-302842-1172021098.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node3/watcher-302842-1172021098 -o ROOT/results/node3/solver-302842-1172021098 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/302842-1172021098/cmusat /tmp/evaluation/302842-1172021098/instance-302842-1172021098.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  4b21b8e0976302c1b0731a8b86b306d2

RANDOM SEED= 395122486

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node3.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        741184 kB
Buffers:         63392 kB
Cached:        1116612 kB
SwapCached:          0 kB
Active:         563588 kB
Inactive:       671052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        741184 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3072 kB
Writeback:           0 kB
Mapped:          73552 kB
Slab:            65760 kB
Committed_AS:  1080268 kB
PageTables:       1656 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66547 MiB

End job on node3 on Wed Feb 21 01:45:00 UTC 2007