Trace number 297429

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CMUSAT BASE 2007-02-08? (TO) 1200.05 1200.39

General information on the benchmark

Namerandom/OnTreshold/3SAT/v550/
unif-k3-r4.26-v550-c2343-S1238286461-19.SAT.shuffled.cnf
MD5SUMfeae85ae56b54fcbcde345d479230ced
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.12198
Satisfiable
(Un)Satisfiability was proved
Number of variables550
Number of clauses2343
Sum of the clauses size7029
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32343
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node67/watcher-297429-1171838346 -o ROOT/results/node67/solver-297429-1171838346 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/297429-1171838346/cmusat_base /tmp/evaluation/297429-1171838346/instance-297429-1171838346.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.95 3/64 31368
/proc/meminfo: memFree=575688/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=2308 CPUtime=0
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 170 0 0 0 0 0 0 0 18 0 1 0 203792205 2363392 152 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 135064935 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 577 152 90 241 0 333 0

[startup+0.106007 s]
/proc/loadavg: 0.92 0.98 0.95 3/64 31368
/proc/meminfo: memFree=575688/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=2736 CPUtime=0.1
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 305 0 0 0 10 0 0 0 18 0 1 0 203792205 2801664 287 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560110 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 684 287 111 241 0 440 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 2736

[startup+0.514049 s]
/proc/loadavg: 0.92 0.98 0.95 3/64 31368
/proc/meminfo: memFree=575688/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=3464 CPUtime=0.51
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 454 0 0 0 51 0 0 0 21 0 1 0 203792205 3547136 436 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560462 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 866 436 111 241 0 622 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 3464

[startup+1.33414 s]
/proc/loadavg: 0.92 0.98 0.95 2/65 31369
/proc/meminfo: memFree=574144/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=3616 CPUtime=1.33
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 520 0 0 0 133 0 0 0 25 0 1 0 203792205 3702784 502 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134561648 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 904 502 111 241 0 660 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 3616

[startup+2.97031 s]
/proc/loadavg: 0.92 0.98 0.95 2/65 31369
/proc/meminfo: memFree=573504/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=5392 CPUtime=2.96
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 906 0 0 0 296 0 0 0 25 0 1 0 203792205 5521408 888 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134552317 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 1348 888 111 241 0 1104 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 5392

[startup+6.24665 s]
/proc/loadavg: 0.93 0.98 0.95 2/65 31369
/proc/meminfo: memFree=572096/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=5736 CPUtime=6.23
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 1001 0 0 0 623 0 0 0 25 0 1 0 203792205 5873664 983 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559899 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 1434 983 111 241 0 1190 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 5736

[startup+12.7013 s]
/proc/loadavg: 0.93 0.98 0.95 2/65 31369
/proc/meminfo: memFree=568768/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=9152 CPUtime=12.68
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 1972 0 0 0 1268 0 0 0 25 0 1 0 203792205 9371648 1752 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134551520 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 2288 1752 111 241 0 2044 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 9152

[startup+25.5047 s]
/proc/loadavg: 0.95 0.98 0.95 2/65 31369
/proc/meminfo: memFree=567488/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=10564 CPUtime=25.48
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 2575 0 0 0 2548 0 0 0 25 0 1 0 203792205 10817536 2167 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 2641 2167 111 241 0 2397 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 10564

[startup+51.1114 s]
/proc/loadavg: 0.96 0.98 0.95 2/65 31371
/proc/meminfo: memFree=561344/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=17160 CPUtime=51.08
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 4574 0 0 0 5107 1 0 0 25 0 1 0 203792205 17571840 3605 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134564472 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 4290 3605 111 241 0 4046 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 17160

[startup+102.322 s]
/proc/loadavg: 0.98 0.98 0.95 2/65 31371
/proc/meminfo: memFree=557696/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=20208 CPUtime=102.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 5990 0 0 0 10226 3 0 0 25 0 1 0 203792205 20692992 4523 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559989 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 5052 4523 111 241 0 4808 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 20208

[startup+162.342 s]
/proc/loadavg: 0.99 0.98 0.95 2/65 31371
/proc/meminfo: memFree=547648/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=32084 CPUtime=162.28
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 9351 0 0 0 16225 3 0 0 25 0 1 0 203792205 32854016 7024 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560129 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 8021 7024 111 241 0 7777 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 32084

[startup+222.359 s]
/proc/loadavg: 0.99 0.98 0.95 2/65 31371
/proc/meminfo: memFree=546624/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=32828 CPUtime=222.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 9941 0 0 0 22225 4 0 0 25 0 1 0 203792205 33615872 7287 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560615 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 8207 7287 111 241 0 7963 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 32828

[startup+282.373 s]
/proc/loadavg: 0.99 0.98 0.95 2/65 31371
/proc/meminfo: memFree=545600/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=33572 CPUtime=282.28
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 10383 0 0 0 28224 4 0 0 25 0 1 0 203792205 34377728 7541 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560473 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 8393 7541 111 241 0 8149 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 33572

[startup+342.387 s]
/proc/loadavg: 1.07 1.00 0.96 2/65 31371
/proc/meminfo: memFree=542848/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=36068 CPUtime=342.28
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 11305 0 0 0 34223 5 0 0 25 0 1 0 203792205 36933632 8257 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 9017 8257 111 241 0 8773 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 36068

[startup+402.408 s]
/proc/loadavg: 1.03 1.00 0.96 2/65 31371
/proc/meminfo: memFree=540224/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=38568 CPUtime=402.28
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 12184 0 0 0 40222 6 0 0 25 0 1 0 203792205 39493632 8877 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560002 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 9642 8877 111 241 0 9398 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 38568

[startup+462.427 s]
/proc/loadavg: 1.01 1.00 0.96 2/65 31371
/proc/meminfo: memFree=538240/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=40408 CPUtime=462.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 12942 0 0 0 46222 7 0 0 25 0 1 0 203792205 41377792 9387 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559932 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 10102 9387 111 241 0 9858 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 40408

[startup+522.448 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=518208/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=64640 CPUtime=522.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 19371 0 0 0 52219 10 0 0 25 0 1 0 203792205 66191360 14371 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560110 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16160 14371 111 241 0 15916 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 64640

[startup+582.465 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=517696/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=64772 CPUtime=582.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 19499 0 0 0 58219 10 0 0 25 0 1 0 203792205 66326528 14499 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16193 14499 111 241 0 15949 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 64772

[startup+642.487 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=517120/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=65212 CPUtime=642.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 19936 0 0 0 64219 10 0 0 25 0 1 0 203792205 66777088 14637 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560538 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16303 14637 111 241 0 16059 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 65212

[startup+702.506 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=516864/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=65664 CPUtime=702.29
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 20039 0 0 0 70219 10 0 0 25 0 1 0 203792205 67239936 14707 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560009 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16416 14707 111 241 0 16172 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 65664

[startup+762.524 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=515776/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=66188 CPUtime=762.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 20632 0 0 0 76219 11 0 0 25 0 1 0 203792205 67776512 14939 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16547 14939 111 241 0 16303 0
Current children cumulated CPU time (s) 762.3
Current children cumulated vsize (KiB) 66188

[startup+822.543 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=515840/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=66320 CPUtime=822.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 20665 0 0 0 82219 11 0 0 25 0 1 0 203792205 67911680 14972 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16580 14972 111 241 0 16336 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 66320

[startup+882.56 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=515392/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=66320 CPUtime=882.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 20756 0 0 0 88219 11 0 0 25 0 1 0 203792205 67911680 15063 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134560538 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16580 15063 111 241 0 16336 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 66320

[startup+942.58 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=514816/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=66784 CPUtime=942.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 21262 0 0 0 94219 11 0 0 25 0 1 0 203792205 68386816 15208 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16696 15208 111 241 0 16452 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 66784

[startup+1002.6 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=514688/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=66912 CPUtime=1002.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 21314 0 0 0 100219 11 0 0 25 0 1 0 203792205 68517888 15227 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16728 15227 111 241 0 16484 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 66912

[startup+1062.62 s]
/proc/loadavg: 1.00 1.00 0.96 2/65 31371
/proc/meminfo: memFree=514368/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=67436 CPUtime=1062.31
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 21426 0 0 0 106220 11 0 0 25 0 1 0 203792205 69054464 15339 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559860 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16859 15339 111 241 0 16615 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 67436

[startup+1122.63 s]
/proc/loadavg: 1.06 1.02 0.96 2/65 31371
/proc/meminfo: memFree=513856/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=67436 CPUtime=1122.3
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 21549 0 0 0 112219 11 0 0 25 0 1 0 203792205 69054464 15462 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16859 15462 111 241 0 16615 0
Current children cumulated CPU time (s) 1122.3
Current children cumulated vsize (KiB) 67436

[startup+1182.65 s]
/proc/loadavg: 1.02 1.01 0.96 2/65 31371
/proc/meminfo: memFree=513344/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=67784 CPUtime=1182.31
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 22052 0 0 0 118220 11 0 0 25 0 1 0 203792205 69410816 15569 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559940 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16946 15569 111 241 0 16702 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 67784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.37 s]
/proc/loadavg: 1.01 1.01 0.96 2/65 31371
/proc/meminfo: memFree=513344/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=67784 CPUtime=1200.02
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 22061 0 0 0 119991 11 0 0 25 0 1 0 203792205 69410816 15578 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559914 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16946 15578 111 241 0 16702 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 67784

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.37 s]
/proc/loadavg: 1.01 1.01 0.96 2/65 31371
/proc/meminfo: memFree=513344/2055920 swapFree=4183772/4192956
[pid=31368] ppid=31366 vsize=67784 CPUtime=1200.02
/proc/31368/stat : 31368 (cmusat_base) R 31366 31368 29610 0 -1 4194304 22061 0 0 0 119991 11 0 0 25 0 1 0 203792205 69410816 15578 18446744073709551615 134512640 135500113 4294956704 18446744073709551615 134559914 0 0 4096 35 0 0 0 17 1 0 0
/proc/31368/statm: 16946 15578 111 241 0 16702 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 67784

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.39
CPU time (s): 1200.05
CPU user time (s): 1199.92
CPU system time (s): 0.12898
CPU usage (%): 99.9717
Max. virtual memory (cumulated for all children) (KiB): 67784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.92
system time used= 0.12898
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22061
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 2057

runsolver used 0.771882 second user time and 2.43763 second system time

The end

Launcher Data (download as text)

Begin job on node67 on Sun Feb 18 22:39:06 UTC 2007

IDJOB= 297429
IDBENCH= 19961
IDSOLVER= 120
FILE ID= node67/297429-1171838346

PBS_JOBID= 3839698

Free space on /tmp= 66561 MiB

SOLVER NAME= CMUSAT BASE 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v550/unif-k3-r4.26-v550-c2343-S1238286461-19.SAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/297429-1171838346/cmusat_base /tmp/evaluation/297429-1171838346/instance-297429-1171838346.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node67/watcher-297429-1171838346 -o ROOT/results/node67/solver-297429-1171838346 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/297429-1171838346/cmusat_base /tmp/evaluation/297429-1171838346/instance-297429-1171838346.cnf            

META MD5SUM SOLVER= af990fb12f8926fdd756b397adb3b5cf
MD5SUM BENCH=  feae85ae56b54fcbcde345d479230ced

RANDOM SEED= 90093360

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node67.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        576160 kB
Buffers:         49912 kB
Cached:        1309064 kB
SwapCached:       3608 kB
Active:         739944 kB
Inactive:       629028 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        576160 kB
SwapTotal:     4192956 kB
SwapFree:      4183772 kB
Dirty:            2476 kB
Writeback:           0 kB
Mapped:          15408 kB
Slab:            96800 kB
Committed_AS:   648676 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB

End job on node67 on Sun Feb 18 22:59:08 UTC 2007