Trace number 337398

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMP? (TO) 1200.16 601.917

General information on the benchmark

Namecrafted/Hard/contest03/others/
bqwh.60.1080.sat05-436.reshuffled-07.cnf
MD5SUM55013aff92da670c8aded0070c1f7bbe
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables6283
Number of clauses53810
Sum of the clauses size120037
Maximum clause length12
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 250644
Number of clauses of size 3222
Number of clauses of size 4438
Number of clauses of size 5649
Number of clauses of size over 51857

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/337398-1173666347/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.06/0.08	c Input file : '/tmp/evaluation/337398-1173666347/instance-337398-1173666347.cnf'
0.06/0.08	c [#vars: 6283, #clauses: 53810 , (2-12)-CNF]
0.09/0.13	c unit clauses propagate before processing (#clause: 53810)
0.09/0.13	c estimated distribution: 8 tasks
0.09/0.16	c [PID]: 8172 8173 8174 8175 8176 8177 8178
0.19/0.77	c [PID]: 8179
0.19/0.77	c real distribution: 8 tasks

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node66/watcher-337398-1173666347 -o ROOT/results/node66/solver-337398-1173666347 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/337398-1173666347/kcnfs-smp /tmp/evaluation/337398-1173666347/instance-337398-1173666347.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 8170
/proc/meminfo: memFree=1858384/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=180916 CPUtime=0
/proc/8170/stat : 8170 (kcnfs-smp) R 8168 8170 7028 0 -1 4194304 125 0 0 0 0 0 0 0 18 0 1 0 386592270 185257984 110 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134942508 0 0 4096 0 0 0 0 17 1 0 0
/proc/8170/statm: 45229 111 48 160 0 45067 0

[startup+0.067808 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 8170
/proc/meminfo: memFree=1858384/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=184480 CPUtime=0.06
/proc/8170/stat : 8170 (kcnfs-smp) R 8168 8170 7028 0 -1 4194304 1015 0 0 0 5 1 0 0 18 0 1 0 386592270 188907520 1000 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/8170/statm: 46120 1001 48 160 0 45958 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 184480

[startup+0.101814 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 8170
/proc/meminfo: memFree=1858384/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.09
/proc/8170/stat : 8170 (kcnfs-smp) R 8168 8170 7028 0 -1 4194304 1740 0 0 0 8 1 0 0 18 0 1 0 386592270 191741952 1724 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/8170/statm: 46812 1724 51 160 0 46650 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 187248

[startup+0.301867 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 8170
/proc/meminfo: memFree=1858384/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.16
/proc/8170/stat : 8170 (kcnfs-smp) R 8168 8170 7028 0 -1 4194304 4401 0 0 0 14 2 0 0 21 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 187248

[startup+0.701952 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 8170
/proc/meminfo: memFree=1858384/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.19
/proc/8170/stat : 8170 (kcnfs-smp) R 8168 8170 7028 0 -1 4194304 5550 0 0 0 16 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 187248

[startup+1.50211 s]
/proc/loadavg: 0.92 0.98 0.99 9/73 8179
/proc/meminfo: memFree=1826744/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187252 CPUtime=0.63
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 617 0 0 0 63 0 0 0 25 0 1 0 386592286 191746048 3603 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46813 3603 66 160 0 46651 0
[pid=8173] ppid=8170 vsize=187252 CPUtime=0.5
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 603 0 0 0 50 0 0 0 25 0 1 0 386592287 191746048 3603 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46813 3603 66 160 0 46651 0
[pid=8174] ppid=8170 vsize=187248 CPUtime=0.34
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 554 0 0 0 34 0 0 0 25 0 1 0 386592298 191741952 3601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46812 3601 66 160 0 46650 0
[pid=8175] ppid=8170 vsize=187248 CPUtime=0.31
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 551 0 0 0 31 0 0 0 25 0 1 0 386592304 191741952 3601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46812 3601 66 160 0 46650 0
[pid=8176] ppid=8170 vsize=187248 CPUtime=0.29
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 552 0 0 0 29 0 0 0 25 0 1 0 386592307 191741952 3601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720561 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46812 3601 66 160 0 46650 0
[pid=8177] ppid=8170 vsize=187248 CPUtime=0.24
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 548 0 0 0 24 0 0 0 25 0 1 0 386592338 191741952 3601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720624 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46812 3601 66 160 0 46650 0
[pid=8178] ppid=8170 vsize=187248 CPUtime=0.13
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 494 0 0 0 13 0 0 0 25 0 1 0 386592344 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720569 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46812 3600 66 160 0 46650 0
[pid=8179] ppid=8170 vsize=187248 CPUtime=0.1
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 483 0 0 0 10 0 0 0 25 0 1 0 386592347 191741952 3601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720561 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46812 3601 66 160 0 46650 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 1685240

[startup+3.10243 s]
/proc/loadavg: 0.92 0.98 0.99 9/73 8179
/proc/meminfo: memFree=1823992/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187256 CPUtime=1.03
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 663 0 0 0 103 0 0 0 25 0 1 0 386592286 191750144 3609 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46814 3609 66 160 0 46652 0
[pid=8173] ppid=8170 vsize=187256 CPUtime=0.9
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 654 0 0 0 90 0 0 0 25 0 1 0 386592287 191750144 3608 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46814 3608 66 160 0 46652 0
[pid=8174] ppid=8170 vsize=187252 CPUtime=0.74
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 628 0 0 0 74 0 0 0 25 0 1 0 386592298 191746048 3606 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46813 3606 66 160 0 46651 0
[pid=8175] ppid=8170 vsize=187252 CPUtime=0.71
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 630 0 0 0 71 0 0 0 25 0 1 0 386592304 191746048 3606 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720624 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46813 3606 66 160 0 46651 0
[pid=8176] ppid=8170 vsize=187252 CPUtime=0.69
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 633 0 0 0 69 0 0 0 25 0 1 0 386592307 191746048 3605 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46813 3605 66 160 0 46651 0
[pid=8177] ppid=8170 vsize=187252 CPUtime=0.64
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 627 0 0 0 64 0 0 0 25 0 1 0 386592338 191746048 3606 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708962 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46813 3606 66 160 0 46651 0
[pid=8178] ppid=8170 vsize=187252 CPUtime=0.52
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 609 0 0 0 52 0 0 0 25 0 1 0 386592344 191746048 3603 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720569 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46813 3603 66 160 0 46651 0
[pid=8179] ppid=8170 vsize=187252 CPUtime=0.49
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 610 0 0 0 49 0 0 0 25 0 1 0 386592347 191746048 3604 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46813 3604 66 160 0 46651 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 1685272

[startup+6.30208 s]
/proc/loadavg: 1.49 1.10 1.03 9/73 8179
/proc/meminfo: memFree=1821240/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187264 CPUtime=1.83
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 684 0 0 0 183 0 0 0 25 0 1 0 386592286 191758336 3614 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46816 3614 66 160 0 46654 0
[pid=8173] ppid=8170 vsize=187264 CPUtime=1.7
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 681 0 0 0 170 0 0 0 25 0 1 0 386592287 191758336 3614 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720569 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46816 3614 66 160 0 46654 0
[pid=8174] ppid=8170 vsize=187260 CPUtime=1.54
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 673 0 0 0 154 0 0 0 25 0 1 0 386592298 191754240 3611 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46815 3611 66 160 0 46653 0
[pid=8175] ppid=8170 vsize=187260 CPUtime=1.51
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 674 0 0 0 151 0 0 0 25 0 1 0 386592304 191754240 3612 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720483 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46815 3612 66 160 0 46653 0
[pid=8176] ppid=8170 vsize=187260 CPUtime=1.49
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 678 0 0 0 149 0 0 0 25 0 1 0 386592307 191754240 3612 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46815 3612 66 160 0 46653 0
[pid=8177] ppid=8170 vsize=187260 CPUtime=1.42
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 677 0 0 0 142 0 0 0 25 0 1 0 386592338 191754240 3612 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46815 3612 66 160 0 46653 0
[pid=8178] ppid=8170 vsize=187260 CPUtime=1.3
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 672 0 0 0 130 0 0 0 25 0 1 0 386592344 191754240 3611 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46815 3611 66 160 0 46653 0
[pid=8179] ppid=8170 vsize=187260 CPUtime=1.29
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 674 0 0 0 129 0 0 0 25 0 1 0 386592347 191754240 3612 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134569468 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46815 3612 66 160 0 46653 0
Current children cumulated CPU time (s) 12.28
Current children cumulated vsize (KiB) 1685336

[startup+12.7024 s]
/proc/loadavg: 2.01 1.21 1.07 9/73 8179
/proc/meminfo: memFree=1820280/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187280 CPUtime=3.43
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 703 0 0 0 343 0 0 0 25 0 1 0 386592286 191774720 3626 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46820 3626 66 160 0 46658 0
[pid=8173] ppid=8170 vsize=187280 CPUtime=3.3
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 700 0 0 0 330 0 0 0 25 0 1 0 386592287 191774720 3625 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46820 3625 66 160 0 46658 0
[pid=8174] ppid=8170 vsize=187276 CPUtime=3.14
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 697 0 0 0 314 0 0 0 25 0 1 0 386592298 191770624 3622 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720569 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46819 3622 66 160 0 46657 0
[pid=8175] ppid=8170 vsize=187276 CPUtime=3.11
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 698 0 0 0 311 0 0 0 25 0 1 0 386592304 191770624 3623 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567281 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46819 3623 66 160 0 46657 0
[pid=8176] ppid=8170 vsize=187280 CPUtime=3.09
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 698 0 0 0 309 0 0 0 25 0 1 0 386592307 191774720 3624 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720529 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46820 3624 66 160 0 46658 0
[pid=8177] ppid=8170 vsize=187276 CPUtime=2.98
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 697 0 0 0 298 0 0 0 25 0 1 0 386592338 191770624 3623 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46819 3623 66 160 0 46657 0
[pid=8178] ppid=8170 vsize=187276 CPUtime=2.9
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 696 0 0 0 290 0 0 0 25 0 1 0 386592344 191770624 3622 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46819 3622 66 160 0 46657 0
[pid=8179] ppid=8170 vsize=187276 CPUtime=2.89
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 697 0 0 0 289 0 0 0 25 0 1 0 386592347 191770624 3623 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46819 3623 66 160 0 46657 0
Current children cumulated CPU time (s) 25.04
Current children cumulated vsize (KiB) 1685468

[startup+25.5019 s]
/proc/loadavg: 3.40 1.56 1.18 9/73 8179
/proc/meminfo: memFree=1819512/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187316 CPUtime=6.63
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 732 0 0 0 663 0 0 0 25 0 1 0 386592286 191811584 3655 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567505 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46829 3655 67 160 0 46667 0
[pid=8173] ppid=8170 vsize=187316 CPUtime=6.49
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 732 0 0 0 649 0 0 0 25 0 1 0 386592287 191811584 3657 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46829 3657 67 160 0 46667 0

################
# More data... #
################

[pid=8174] ppid=8170 vsize=187320 CPUtime=115.52
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 753 0 0 0 11552 0 0 0 25 0 1 0 386592298 191815680 3678 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720354 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46830 3678 69 160 0 46668 0
[pid=8175] ppid=8170 vsize=187324 CPUtime=115.49
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 757 0 0 0 11549 0 0 0 25 0 1 0 386592304 191819776 3682 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46831 3682 69 160 0 46669 0
[pid=8176] ppid=8170 vsize=187320 CPUtime=114.88
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 11487 1 0 0 25 0 1 0 386592307 191815680 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720483 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46830 3679 69 160 0 46668 0
[pid=8177] ppid=8170 vsize=187320 CPUtime=114.82
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 752 0 0 0 11481 1 0 0 25 0 1 0 386592338 191815680 3677 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46830 3677 69 160 0 46668 0
[pid=8178] ppid=8170 vsize=187324 CPUtime=114.75
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 11474 1 0 0 25 0 1 0 386592344 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46831 3679 69 160 0 46669 0
[pid=8179] ppid=8170 vsize=187324 CPUtime=114.68
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 755 0 0 0 11467 1 0 0 25 0 1 0 386592347 191819776 3680 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46831 3680 69 160 0 46669 0
Current children cumulated CPU time (s) 921.73
Current children cumulated vsize (KiB) 1685828

[startup+522.303 s]
/proc/loadavg: 8.18 6.90 4.05 9/73 8179
/proc/meminfo: memFree=1818232/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187324 CPUtime=130.79
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 13079 0 0 0 25 0 1 0 386592286 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720569 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46831 3679 69 160 0 46669 0
[pid=8173] ppid=8170 vsize=187324 CPUtime=130.59
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 13059 0 0 0 25 0 1 0 386592287 191819776 3681 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708962 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46831 3681 69 160 0 46669 0
[pid=8174] ppid=8170 vsize=187320 CPUtime=130.52
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 753 0 0 0 13052 0 0 0 25 0 1 0 386592298 191815680 3678 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720276 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46830 3678 69 160 0 46668 0
[pid=8175] ppid=8170 vsize=187324 CPUtime=130.49
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 757 0 0 0 13049 0 0 0 25 0 1 0 386592304 191819776 3682 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46831 3682 69 160 0 46669 0
[pid=8176] ppid=8170 vsize=187320 CPUtime=129.78
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 12977 1 0 0 25 0 1 0 386592307 191815680 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720241 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46830 3679 69 160 0 46668 0
[pid=8177] ppid=8170 vsize=187320 CPUtime=129.72
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 752 0 0 0 12971 1 0 0 25 0 1 0 386592338 191815680 3677 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580056 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46830 3677 69 160 0 46668 0
[pid=8178] ppid=8170 vsize=187324 CPUtime=129.69
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 12968 1 0 0 25 0 1 0 386592344 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720348 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46831 3679 69 160 0 46669 0
[pid=8179] ppid=8170 vsize=187324 CPUtime=129.63
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 755 0 0 0 12962 1 0 0 25 0 1 0 386592347 191819776 3680 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46831 3680 69 160 0 46669 0
Current children cumulated CPU time (s) 1041.41
Current children cumulated vsize (KiB) 1685828

[startup+582.303 s]
/proc/loadavg: 8.14 7.11 4.30 9/73 8179
/proc/meminfo: memFree=1818232/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187324 CPUtime=145.79
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 14579 0 0 0 25 0 1 0 386592286 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580056 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46831 3679 69 160 0 46669 0
[pid=8173] ppid=8170 vsize=187324 CPUtime=145.57
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 14557 0 0 0 25 0 1 0 386592287 191819776 3681 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720659 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46831 3681 69 160 0 46669 0
[pid=8174] ppid=8170 vsize=187320 CPUtime=145.51
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 753 0 0 0 14551 0 0 0 25 0 1 0 386592298 191815680 3678 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46830 3678 69 160 0 46668 0
[pid=8175] ppid=8170 vsize=187324 CPUtime=145.49
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 757 0 0 0 14549 0 0 0 25 0 1 0 386592304 191819776 3682 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46831 3682 69 160 0 46669 0
[pid=8176] ppid=8170 vsize=187320 CPUtime=144.73
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14472 1 0 0 25 0 1 0 386592307 191815680 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46830 3679 69 160 0 46668 0
[pid=8177] ppid=8170 vsize=187320 CPUtime=144.62
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 752 0 0 0 14461 1 0 0 25 0 1 0 386592338 191815680 3677 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46830 3677 69 160 0 46668 0
[pid=8178] ppid=8170 vsize=187324 CPUtime=144.59
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14458 1 0 0 25 0 1 0 386592344 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572623 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46831 3679 69 160 0 46669 0
[pid=8179] ppid=8170 vsize=187324 CPUtime=144.57
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 755 0 0 0 14456 1 0 0 25 0 1 0 386592347 191819776 3680 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720511 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46831 3680 69 160 0 46669 0
Current children cumulated CPU time (s) 1161.07
Current children cumulated vsize (KiB) 1685828



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+601.903 s]
/proc/loadavg: 8.10 7.17 4.38 9/73 8179
/proc/meminfo: memFree=1818232/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187324 CPUtime=150.69
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 15069 0 0 0 25 0 1 0 386592286 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46831 3679 69 160 0 46669 0
[pid=8173] ppid=8170 vsize=187324 CPUtime=150.47
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 15047 0 0 0 25 0 1 0 386592287 191819776 3681 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46831 3681 69 160 0 46669 0
[pid=8174] ppid=8170 vsize=187320 CPUtime=150.41
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 753 0 0 0 15041 0 0 0 25 0 1 0 386592298 191815680 3678 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577693 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46830 3678 69 160 0 46668 0
[pid=8175] ppid=8170 vsize=187324 CPUtime=150.39
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 757 0 0 0 15039 0 0 0 25 0 1 0 386592304 191819776 3682 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46831 3682 69 160 0 46669 0
[pid=8176] ppid=8170 vsize=187320 CPUtime=149.57
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14956 1 0 0 25 0 1 0 386592307 191815680 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46830 3679 69 160 0 46668 0
[pid=8177] ppid=8170 vsize=187320 CPUtime=149.52
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 752 0 0 0 14951 1 0 0 25 0 1 0 386592338 191815680 3677 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46830 3677 69 160 0 46668 0
[pid=8178] ppid=8170 vsize=187324 CPUtime=149.48
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14947 1 0 0 25 0 1 0 386592344 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46831 3679 69 160 0 46669 0
[pid=8179] ppid=8170 vsize=187324 CPUtime=149.43
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 755 0 0 0 14942 1 0 0 25 0 1 0 386592347 191819776 3680 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720251 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46831 3680 69 160 0 46669 0
Current children cumulated CPU time (s) 1200.16
Current children cumulated vsize (KiB) 1685828

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+601.903 s]
/proc/loadavg: 8.10 7.17 4.38 9/73 8179
/proc/meminfo: memFree=1818232/2055920 swapFree=4183892/4192956
[pid=8170] ppid=8168 vsize=187248 CPUtime=0.2
/proc/8170/stat : 8170 (kcnfs-smp) S 8168 8170 7028 0 -1 4194304 6366 0 0 0 17 3 0 0 24 0 1 0 386592270 191741952 3600 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/8170/statm: 46812 3600 66 160 0 46650 0
[pid=8172] ppid=8170 vsize=187324 CPUtime=150.69
/proc/8172/stat : 8172 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 15069 0 0 0 25 0 1 0 386592286 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/8172/statm: 46831 3679 69 160 0 46669 0
[pid=8173] ppid=8170 vsize=187324 CPUtime=150.47
/proc/8173/stat : 8173 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 756 0 0 0 15047 0 0 0 25 0 1 0 386592287 191819776 3681 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/8173/statm: 46831 3681 69 160 0 46669 0
[pid=8174] ppid=8170 vsize=187320 CPUtime=150.41
/proc/8174/stat : 8174 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 753 0 0 0 15041 0 0 0 25 0 1 0 386592298 191815680 3678 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577693 0 0 4096 2 0 0 0 17 1 0 0
/proc/8174/statm: 46830 3678 69 160 0 46668 0
[pid=8175] ppid=8170 vsize=187324 CPUtime=150.39
/proc/8175/stat : 8175 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 757 0 0 0 15039 0 0 0 25 0 1 0 386592304 191819776 3682 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 1 0 0
/proc/8175/statm: 46831 3682 69 160 0 46669 0
[pid=8176] ppid=8170 vsize=187320 CPUtime=149.57
/proc/8176/stat : 8176 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14956 1 0 0 25 0 1 0 386592307 191815680 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/8176/statm: 46830 3679 69 160 0 46668 0
[pid=8177] ppid=8170 vsize=187320 CPUtime=149.52
/proc/8177/stat : 8177 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 752 0 0 0 14951 1 0 0 25 0 1 0 386592338 191815680 3677 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 0 0 0
/proc/8177/statm: 46830 3677 69 160 0 46668 0
[pid=8178] ppid=8170 vsize=187324 CPUtime=149.48
/proc/8178/stat : 8178 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 754 0 0 0 14947 1 0 0 25 0 1 0 386592344 191819776 3679 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/8178/statm: 46831 3679 69 160 0 46669 0
[pid=8179] ppid=8170 vsize=187324 CPUtime=149.43
/proc/8179/stat : 8179 (kcnfs-smp) R 8170 8170 7028 0 -1 4194368 755 0 0 0 14942 1 0 0 25 0 1 0 386592347 191819776 3680 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720251 0 0 4096 0 0 0 0 17 0 0 0
/proc/8179/statm: 46831 3680 69 160 0 46669 0
Current children cumulated CPU time (s) 1200.16
Current children cumulated vsize (KiB) 1685828

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 8170 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=179972 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=36994
CPU time returned by wait4() is 0.216966
while last known CPU time is 1200.16

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 601.917
CPU time (s): 1200.16
CPU user time (s): 1200.09
CPU system time (s): 0.07
CPU usage (%): 199.389
Max. virtual memory (cumulated for all children) (KiB): 1685828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.179972
system time used= 0.036994
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6366
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 21

runsolver used 0.78388 second user time and 1.87471 second system time

The end

Launcher Data (download as text)

Begin job on node66 on Mon Mar 12 02:25:47 UTC 2007

IDJOB= 337398
IDBENCH= 24698
IDSOLVER= 112
FILE ID= node66/337398-1173666347

PBS_JOBID= 4101425

Free space on /tmp= 66545 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/crafted/Hard/contest03/others/bqwh.60.1080.sat05-436.reshuffled-07.cnf
COMMAND LINE= /tmp/evaluation/337398-1173666347/kcnfs-smp /tmp/evaluation/337398-1173666347/instance-337398-1173666347.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node66/watcher-337398-1173666347 -o ROOT/results/node66/solver-337398-1173666347 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/337398-1173666347/kcnfs-smp /tmp/evaluation/337398-1173666347/instance-337398-1173666347.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  55013aff92da670c8aded0070c1f7bbe

RANDOM SEED= 771024578

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node66.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1858792 kB
Buffers:         24304 kB
Cached:         134972 kB
SwapCached:       3176 kB
Active:          61208 kB
Inactive:       108436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1858792 kB
SwapTotal:     4192956 kB
SwapFree:      4183892 kB
Dirty:            3880 kB
Writeback:           0 kB
Mapped:          15740 kB
Slab:            13488 kB
Committed_AS:   816524 kB
PageTables:       1376 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66545 MiB

End job on node66 on Mon Mar 12 02:35:51 UTC 2007