Trace number 311697

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT BASE 2007-02-08? (TO) 1200.08 1200.41

General information on the benchmark

Namerandom/2+p/p0.8/v2405/
unif2p-p0.8-v2405-c7479-S1117386741-13-UNSAT.cnf
MD5SUMf92c9470ce530d69e9c5c87f2f1f8a3e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2404
Number of clauses7478
Sum of the clauses size20939
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21495
Number of clauses of size 35983
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node68/watcher-311697-1172574428 -o ROOT/results/node68/solver-311697-1172574428 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/311697-1172574428/cmusat_base /tmp/evaluation/311697-1172574428/instance-311697-1172574428.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 2158
/proc/meminfo: memFree=1801368/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=2480 CPUtime=0
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 216 0 0 0 0 0 0 0 18 0 1 0 277400418 2539520 198 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134564250 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 620 198 90 241 0 376 0

[startup+0.107606 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 2158
/proc/meminfo: memFree=1801368/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=3320 CPUtime=0.1
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 413 0 0 0 10 0 0 0 18 0 1 0 277400418 3399680 395 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560538 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 830 395 110 241 0 586 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 3320

[startup+0.516643 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 2158
/proc/meminfo: memFree=1801368/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=3980 CPUtime=0.51
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 624 0 0 0 51 0 0 0 21 0 1 0 277400418 4075520 606 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 995 606 110 241 0 751 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3980

[startup+1.34172 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1798864/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=4552 CPUtime=1.33
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 741 0 0 0 133 0 0 0 25 0 1 0 277400418 4661248 723 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134527119 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 1138 723 110 241 0 894 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 4552

[startup+2.97787 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1798416/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=5332 CPUtime=2.97
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 947 0 0 0 297 0 0 0 25 0 1 0 277400418 5459968 929 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560110 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 1333 929 110 241 0 1089 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 5332

[startup+6.25416 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1795728/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=7796 CPUtime=6.24
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 1538 0 0 0 624 0 0 0 25 0 1 0 277400418 7983104 1476 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 1949 1476 110 241 0 1705 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 7796

[startup+12.7097 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1795280/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=8364 CPUtime=12.7
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 1827 0 0 0 1269 1 0 0 25 0 1 0 277400418 8564736 1627 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 2091 1627 110 241 0 1847 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 8364

[startup+25.6109 s]
/proc/loadavg: 0.95 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1792848/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=10272 CPUtime=25.6
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 2611 0 0 0 2558 2 0 0 25 0 1 0 277400418 10518528 2185 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559842 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 2568 2185 110 241 0 2324 0
Current children cumulated CPU time (s) 25.6
Current children cumulated vsize (KiB) 10272

[startup+51.2192 s]
/proc/loadavg: 0.96 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1787984/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=15752 CPUtime=51.19
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 4283 0 0 0 5117 2 0 0 25 0 1 0 277400418 16130048 3406 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 3938 3406 110 241 0 3694 0
Current children cumulated CPU time (s) 51.19
Current children cumulated vsize (KiB) 15752

[startup+102.425 s]
/proc/loadavg: 0.98 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1781392/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=21968 CPUtime=102.38
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 6362 0 0 0 10234 4 0 0 25 0 1 0 277400418 22495232 5056 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 5492 5056 110 241 0 5248 0
Current children cumulated CPU time (s) 102.38
Current children cumulated vsize (KiB) 21968

[startup+162.446 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1771408/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=33576 CPUtime=162.39
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 9569 0 0 0 16234 5 0 0 25 0 1 0 277400418 34381824 7568 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 8394 7568 110 241 0 8150 0
Current children cumulated CPU time (s) 162.39
Current children cumulated vsize (KiB) 33576

[startup+222.466 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 2159
/proc/meminfo: memFree=1770768/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=33668 CPUtime=222.4
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 9971 0 0 0 22234 6 0 0 25 0 1 0 277400418 34476032 7703 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 8417 7703 110 241 0 8173 0
Current children cumulated CPU time (s) 222.4
Current children cumulated vsize (KiB) 33668

[startup+282.484 s]
/proc/loadavg: 1.07 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1768080/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=36256 CPUtime=282.4
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 10861 0 0 0 28233 7 0 0 25 0 1 0 277400418 37126144 8442 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559881 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 9064 8442 110 241 0 8820 0
Current children cumulated CPU time (s) 282.4
Current children cumulated vsize (KiB) 36256

[startup+342.504 s]
/proc/loadavg: 1.02 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1761680/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=42092 CPUtime=342.4
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 12704 0 0 0 34232 8 0 0 25 0 1 0 277400418 43102208 9940 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 10523 9940 110 241 0 10279 0
Current children cumulated CPU time (s) 342.4
Current children cumulated vsize (KiB) 42092

[startup+402.527 s]
/proc/loadavg: 1.04 1.01 1.00 2/65 2159
/proc/meminfo: memFree=1759504/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=44356 CPUtime=402.4
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 13283 0 0 0 40231 9 0 0 25 0 1 0 277400418 45420544 10519 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 11089 10519 110 241 0 10845 0
Current children cumulated CPU time (s) 402.4
Current children cumulated vsize (KiB) 44356

[startup+462.547 s]
/proc/loadavg: 1.01 1.01 1.00 2/65 2159
/proc/meminfo: memFree=1757264/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=46148 CPUtime=462.41
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 14014 0 0 0 46231 10 0 0 25 0 1 0 277400418 47255552 11054 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 11537 11054 110 241 0 11293 0
Current children cumulated CPU time (s) 462.41
Current children cumulated vsize (KiB) 46148

[startup+522.563 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1755216/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=48092 CPUtime=522.41
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 14735 0 0 0 52230 11 0 0 25 0 1 0 277400418 49246208 11561 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 12023 11561 110 241 0 11779 0
Current children cumulated CPU time (s) 522.41
Current children cumulated vsize (KiB) 48092

[startup+582.584 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1736656/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=70012 CPUtime=582.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 20538 0 0 0 58229 13 0 0 25 0 1 0 277400418 71692288 16194 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17503 16194 110 241 0 17259 0
Current children cumulated CPU time (s) 582.42
Current children cumulated vsize (KiB) 70012

[startup+642.603 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1736528/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=70172 CPUtime=642.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 20568 0 0 0 64229 13 0 0 25 0 1 0 277400418 71856128 16224 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559899 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17543 16224 110 241 0 17299 0
Current children cumulated CPU time (s) 642.42
Current children cumulated vsize (KiB) 70172

[startup+702.623 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1736016/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=70448 CPUtime=702.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 20706 0 0 0 70229 13 0 0 25 0 1 0 277400418 72138752 16362 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559914 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17612 16362 110 241 0 17368 0
Current children cumulated CPU time (s) 702.42
Current children cumulated vsize (KiB) 70448

[startup+762.639 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1735696/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=70736 CPUtime=762.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 21033 0 0 0 76229 13 0 0 25 0 1 0 277400418 72433664 16433 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560023 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17684 16433 110 241 0 17440 0
Current children cumulated CPU time (s) 762.42
Current children cumulated vsize (KiB) 70736

[startup+822.658 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1735568/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=70896 CPUtime=822.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 21071 0 0 0 82229 13 0 0 25 0 1 0 277400418 72597504 16471 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17724 16471 110 241 0 17480 0
Current children cumulated CPU time (s) 822.42
Current children cumulated vsize (KiB) 70896

[startup+882.678 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1735184/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=71056 CPUtime=882.43
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 21160 0 0 0 88230 13 0 0 25 0 1 0 277400418 72761344 16560 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17764 16560 110 241 0 17520 0
Current children cumulated CPU time (s) 882.43
Current children cumulated vsize (KiB) 71056

[startup+942.695 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1734672/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=71356 CPUtime=942.42
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 21558 0 0 0 94229 13 0 0 25 0 1 0 277400418 73068544 16678 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560486 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 17839 16678 110 241 0 17595 0
Current children cumulated CPU time (s) 942.42
Current children cumulated vsize (KiB) 71356

[startup+1002.71 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1733200/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=72676 CPUtime=1002.43
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 21938 0 0 0 100229 14 0 0 25 0 1 0 277400418 74420224 17058 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 18169 17058 110 241 0 17925 0
Current children cumulated CPU time (s) 1002.43
Current children cumulated vsize (KiB) 72676

[startup+1062.74 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1728720/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=76752 CPUtime=1062.44
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 23355 0 0 0 106228 16 0 0 25 0 1 0 277400418 78594048 18168 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560110 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 19188 18168 110 241 0 18944 0
Current children cumulated CPU time (s) 1062.44
Current children cumulated vsize (KiB) 76752

[startup+1122.76 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1728528/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=76936 CPUtime=1122.44
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 23396 0 0 0 112228 16 0 0 25 0 1 0 277400418 78782464 18209 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560618 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 19234 18209 110 241 0 18990 0
Current children cumulated CPU time (s) 1122.44
Current children cumulated vsize (KiB) 76936

[startup+1182.77 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1724112/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=81436 CPUtime=1182.44
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 24530 0 0 0 118226 18 0 0 25 0 1 0 277400418 83390464 19343 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 20359 19343 110 241 0 20115 0
Current children cumulated CPU time (s) 1182.44
Current children cumulated vsize (KiB) 81436



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1721360/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=83972 CPUtime=1200.06
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 25197 0 0 0 119986 20 0 0 25 0 1 0 277400418 85987328 20010 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 20993 20010 110 241 0 20749 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 83972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 2159
/proc/meminfo: memFree=1721360/2055920 swapFree=4183020/4192956
[pid=2158] ppid=2156 vsize=83972 CPUtime=1200.06
/proc/2158/stat : 2158 (cmusat_base) R 2156 2158 556 0 -1 4194304 25197 0 0 0 119986 20 0 0 25 0 1 0 277400418 85987328 20010 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/2158/statm: 20993 20010 110 241 0 20749 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 83972

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.41
CPU time (s): 1200.08
CPU user time (s): 1199.87
CPU system time (s): 0.213967
CPU usage (%): 99.9729
Max. virtual memory (cumulated for all children) (KiB): 83972

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.87
system time used= 0.213967
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25197
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1492

runsolver used 0.829873 second user time and 2.38164 second system time

The end

Launcher Data (download as text)

Begin job on node68 on Tue Feb 27 11:07:08 UTC 2007

IDJOB= 311697
IDBENCH= 20321
IDSOLVER= 120
FILE ID= node68/311697-1172574428

PBS_JOBID= 3971888

Free space on /tmp= 66558 MiB

SOLVER NAME= CMUSAT BASE 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/2+p/p0.8/v2405/unif2p-p0.8-v2405-c7479-S1117386741-13-UNSAT.cnf
COMMAND LINE= /tmp/evaluation/311697-1172574428/cmusat_base /tmp/evaluation/311697-1172574428/instance-311697-1172574428.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node68/watcher-311697-1172574428 -o ROOT/results/node68/solver-311697-1172574428 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/311697-1172574428/cmusat_base /tmp/evaluation/311697-1172574428/instance-311697-1172574428.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  f92c9470ce530d69e9c5c87f2f1f8a3e

RANDOM SEED= 160016970

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node68.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1801776 kB
Buffers:         32804 kB
Cached:         173008 kB
SwapCached:       4308 kB
Active:         114108 kB
Inactive:       101884 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1801776 kB
SwapTotal:     4192956 kB
SwapFree:      4183020 kB
Dirty:            2564 kB
Writeback:           0 kB
Mapped:          15472 kB
Slab:            24232 kB
Committed_AS:   729908 kB
PageTables:       1380 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66558 MiB

End job on node68 on Tue Feb 27 11:27:10 UTC 2007