Trace number 3274936

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 35843.4 5100.02

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_11_3_4_cmp.cnf
MD5SUM3b5e80540ef2fcb09cfe50ac7e3686c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark333.04
Satisfiable
(Un)Satisfiability was proved
Number of variables8713
Number of clauses99699
Sum of the clauses size335345
Maximum clause length81
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210866
Number of clauses of size 367270
Number of clauses of size 410556
Number of clauses of size 510773
Number of clauses of size over 5234

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3274936-1304144360/watcher-3274936-1304144360 -o /tmp/evaluation-result-3274936-1304144360/solver-3274936-1304144360 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3274936-1304144360.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.26 4.05 4.01 2/168 31051
/proc/meminfo: memFree=30766632/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) R 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0

[startup+0.016737 s]
/proc/loadavg: 4.26 4.05 4.01 2/168 31051
/proc/meminfo: memFree=30766632/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100725 s]
/proc/loadavg: 4.26 4.05 4.01 2/168 31051
/proc/meminfo: memFree=30766632/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30066 s]
/proc/loadavg: 4.26 4.05 4.01 2/168 31051
/proc/meminfo: memFree=30766632/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700587 s]
/proc/loadavg: 4.26 4.05 4.01 2/168 31051
/proc/meminfo: memFree=30766632/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50045 s]
/proc/loadavg: 4.56 4.11 4.03 9/178 31066
/proc/meminfo: memFree=30589108/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 16 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
[pid=31052] ppid=31051 vsize=43208 CPUtime=1.48 cores=0
/proc/31052/stat : 31052 (cryptominisat) R 31051 31051 30983 0 -1 4202496 8240 0 0 0 148 0 0 0 20 0 1 0 526035667 44244992 6785 33554432000 4194304 4587354 140736210880000 18446744073709551615 4238299 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31052/statm: 10802 6785 326 96 0 7364 0
[pid=31053] ppid=31051 vsize=38720 CPUtime=1.48 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 7840 0 0 0 147 1 0 0 20 0 1 0 526035667 39649280 6974 33554432000 4194304 4785740 140735793307936 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 9680 6974 341 145 0 6725 0
[pid=31054] ppid=31051 vsize=468136 CPUtime=1.49 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4429 0 0 0 149 0 0 0 20 0 1 0 526035667 479371264 4326 33554432000 134512640 134534564 4286780272 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117034 4326 95 6 0 115700 0
[pid=31055] ppid=31051 vsize=176324 CPUtime=1.48 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 47962 0 0 0 143 5 0 0 20 0 1 0 526035667 180555776 39348 33554432000 4194304 4331988 140734748378864 18446744073709551615 274664469189 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 44081 39349 151 34 0 42523 0
[pid=31056] ppid=31051 vsize=144256 CPUtime=5.58 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 13094 1258 0 0 557 1 0 0 18 0 5 0 526035667 147718144 8124 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 36064 8124 164 40 0 34608 0
[pid=31056/tid=31063] ppid=31051 vsize=144256 CPUtime=1.36 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 1566 1258 0 0 136 0 0 0 25 0 5 0 526035680 147718144 8124 33554432000 4194304 4356188 140733430236992 18446744073709551615 4334609 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=144256 CPUtime=1.36 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 1332 1258 0 0 136 0 0 0 25 0 5 0 526035680 147718144 8124 33554432000 4194304 4356188 140733430236992 18446744073709551615 4241949 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=144256 CPUtime=1.36 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 1320 1258 0 0 136 0 0 0 23 0 5 0 526035680 147718144 8124 33554432000 4194304 4356188 140733430236992 18446744073709551615 4280864 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=144256 CPUtime=1.35 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 2251 1258 0 0 135 0 0 0 23 0 5 0 526035680 147718144 8124 33554432000 4194304 4356188 140733430236992 18446744073709551615 4233969 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.51
Current children cumulated vsize (KiB) 888968

[startup+3.10118 s]
/proc/loadavg: 4.56 4.11 4.03 9/178 31066
/proc/meminfo: memFree=30411664/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 6 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
[pid=31052] ppid=31051 vsize=80712 CPUtime=3.09 cores=0
/proc/31052/stat : 31052 (cryptominisat) R 31051 31051 30983 0 -1 4202496 10361 0 0 0 308 1 0 0 25 0 1 0 526035667 82649088 8897 33554432000 4194304 4587354 140736210880000 18446744073709551615 4238622 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31052/statm: 20178 8897 326 96 0 16740 0
[pid=31053] ppid=31051 vsize=54052 CPUtime=3.09 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 11673 0 0 0 307 2 0 0 25 0 1 0 526035667 55349248 10807 33554432000 4194304 4785740 140735793307936 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 13513 10807 341 145 0 10558 0
[pid=31054] ppid=31051 vsize=468136 CPUtime=3.09 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4429 0 0 0 309 0 0 0 25 0 1 0 526035667 479371264 4326 33554432000 134512640 134534564 4286780272 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117034 4326 95 6 0 115700 0
[pid=31055] ppid=31051 vsize=204792 CPUtime=3.09 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 87685 0 0 0 298 11 0 0 25 0 1 0 526035667 209707008 44845 33554432000 4194304 4331988 140734748378864 18446744073709551615 4257152 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 51198 44845 151 34 0 49640 0
[pid=31056] ppid=31051 vsize=156520 CPUtime=11.97 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 16166 1258 0 0 1196 1 0 0 18 0 5 0 526035667 160276480 11190 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 39130 11190 164 40 0 37674 0
[pid=31056/tid=31063] ppid=31051 vsize=156520 CPUtime=2.96 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 1566 1258 0 0 296 0 0 0 25 0 5 0 526035680 160276480 11190 33554432000 4194304 4356188 140733430236992 18446744073709551615 4241887 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=156520 CPUtime=2.96 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 1332 1258 0 0 296 0 0 0 25 0 5 0 526035680 160276480 11190 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=156520 CPUtime=2.96 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 3240 1258 0 0 296 0 0 0 25 0 5 0 526035680 160276480 11190 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=156520 CPUtime=2.95 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 3403 1258 0 0 295 0 0 0 25 0 5 0 526035680 160276480 11190 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.33
Current children cumulated vsize (KiB) 982536

[startup+6.30063 s]
/proc/loadavg: 5.16 4.24 4.08 11/178 31066
/proc/meminfo: memFree=30330584/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 0 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
[pid=31052] ppid=31051 vsize=498852 CPUtime=6.29 cores=0
/proc/31052/stat : 31052 (cryptominisat) R 31051 31051 30983 0 -1 4202496 27443 0 0 0 626 3 0 0 25 0 1 0 526035667 510824448 21869 33554432000 4194304 4587354 140736210880000 18446744073709551615 4357604 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31052/statm: 124713 21869 338 96 0 121275 0
[pid=31053] ppid=31051 vsize=61792 CPUtime=6.28 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 13554 0 0 0 626 2 0 0 25 0 1 0 526035667 63275008 12688 33554432000 4194304 4785740 140735793307936 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 15448 12688 341 145 0 12493 0
[pid=31054] ppid=31051 vsize=468136 CPUtime=6.29 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4429 0 0 0 629 0 0 0 25 0 1 0 526035667 479371264 4326 33554432000 134512640 134534564 4286780272 18446744073709551615 134528633 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117034 4326 95 6 0 115700 0
[pid=31055] ppid=31051 vsize=508896 CPUtime=6.29 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 190949 0 0 0 604 25 0 0 25 0 1 0 526035667 521109504 94719 33554432000 4194304 4331988 140734748378864 18446744073709551615 4261503 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 127224 94719 160 34 0 125666 0
[pid=31056] ppid=31051 vsize=159348 CPUtime=23.29 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 16876 1258 0 0 2318 11 0 0 18 0 5 0 526035667 163172352 11897 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 39837 11897 164 40 0 38381 0
[pid=31056/tid=31063] ppid=31051 vsize=159348 CPUtime=6.16 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 1566 1258 0 0 616 0 0 0 25 0 5 0 526035680 163172352 11897 33554432000 4194304 4356188 140733430236992 18446744073709551615 4212728 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=159348 CPUtime=5.65 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 1786 1258 0 0 565 0 0 0 25 0 5 0 526035680 163172352 11897 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=159348 CPUtime=5.21 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 3240 1258 0 0 512 9 0 0 25 0 5 0 526035680 163172352 11897 33554432000 4194304 4356188 140733430236992 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=159348 CPUtime=6.13 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 3659 1258 0 0 613 0 0 0 25 0 5 0 526035680 163172352 11897 33554432000 4194304 4356188 140733430236992 18446744073709551615 4241655 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.44
Current children cumulated vsize (KiB) 1715348

[startup+12.7005 s]
/proc/loadavg: 5.39 4.31 4.10 9/178 31066
/proc/meminfo: memFree=30259156/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 0 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
[pid=31052] ppid=31051 vsize=441680 CPUtime=12.67 cores=0
/proc/31052/stat : 31052 (cryptominisat) R 31051 31051 30983 0 -1 4202496 29868 0 0 0 1264 3 0 0 25 0 1 0 526035667 452280320 9284 33554432000 4194304 4587354 140736210880000 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31052/statm: 110420 9284 338 96 0 106982 0
[pid=31053] ppid=31051 vsize=74072 CPUtime=12.68 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 16487 0 0 0 1265 3 0 0 25 0 1 0 526035667 75849728 15621 33554432000 4194304 4785740 140735793307936 18446744073709551615 4278600 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 18518 15621 341 145 0 15563 0
[pid=31054] ppid=31051 vsize=468136 CPUtime=12.68 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4429 0 0 0 1268 0 0 0 25 0 1 0 526035667 479371264 4326 33554432000 134512640 134534564 4286780272 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117034 4326 95 6 0 115700 0
[pid=31055] ppid=31051 vsize=478300 CPUtime=12.68 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 227921 0 0 0 1237 31 0 0 25 0 1 0 526035667 489779200 87514 33554432000 4194304 4331988 140734748378864 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119575 87514 171 34 0 118017 0
[pid=31056] ppid=31051 vsize=159316 CPUtime=46.86 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 16877 1258 0 0 4675 11 0 0 18 0 5 0 526035667 163139584 11890 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 39829 11890 164 40 0 38373 0
[pid=31056/tid=31063] ppid=31051 vsize=159316 CPUtime=12.56 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 1567 1258 0 0 1256 0 0 0 25 0 5 0 526035680 163139584 11890 33554432000 4194304 4356188 140733430236992 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=159316 CPUtime=11.04 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 1786 1258 0 0 1104 0 0 0 25 0 5 0 526035680 163139584 11890 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=159316 CPUtime=10.62 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 3240 1258 0 0 1053 9 0 0 25 0 5 0 526035680 163139584 11890 33554432000 4194304 4356188 140733430236992 18446744073709551615 4210615 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=159316 CPUtime=12.49 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 3659 1258 0 0 1249 0 0 0 25 0 5 0 526035680 163139584 11890 33554432000 4194304 4356188 140733430236992 18446744073709551615 4242248 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 97.57
Current children cumulated vsize (KiB) 1639828

[startup+25.5013 s]
/proc/loadavg: 5.79 4.43 4.14 9/178 31066
/proc/meminfo: memFree=30224404/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=0 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 526035667 18763776 390 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9185180504758943743 0 0 17 0 0 0 0
/proc/31051/statm: 4581 390 341 23 0 91 0
[pid=31052] ppid=31051 vsize=459220 CPUtime=25.47 cores=0
/proc/31052/stat : 31052 (cryptominisat) R 31051 31051 30983 0 -1 4202496 59797 0 0 0 2539 8 0 0 25 0 1 0 526035667 470241280 9509 33554432000 4194304 4587354 140736210880000 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 34041.1
Current children cumulated vsize (KiB) 2012940

[startup+4902.3 s]
/proc/loadavg: 7.09 7.06 7.00 8/177 31208
/proc/meminfo: memFree=29488508/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=179.71 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 523 157810 0 0 0 0 17941 30 15 0 1 0 526035667 18763776 391 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9224195386380386304 0 0 17 0 0 0 0
/proc/31051/statm: 4581 391 342 23 0 91 0
[pid=31053] ppid=31051 vsize=592900 CPUtime=4901.95 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 136491 0 0 0 490149 46 0 0 25 0 1 0 526035667 607129600 135625 33554432000 4194304 4785740 140735793307936 18446744073709551615 4549596 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 148225 135625 341 145 0 145270 0
[pid=31054] ppid=31051 vsize=468140 CPUtime=4899.86 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4438 0 0 0 489896 90 0 0 25 0 1 0 526035667 479375360 4335 33554432000 134512640 134534564 4286780272 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117035 4335 103 6 0 115701 0
[pid=31055] ppid=31051 vsize=478384 CPUtime=4902.02 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 233766 0 0 0 490169 33 0 0 25 0 1 0 526035667 489865216 93359 33554432000 4194304 4331988 140734748378864 18446744073709551615 4263156 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119596 93359 175 34 0 118038 0
[pid=31056] ppid=31051 vsize=457240 CPUtime=19577.2 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 499759 1258 0 0 1957619 96 0 0 18 0 5 0 526035667 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 114310 86370 164 40 0 112854 0
[pid=31056/tid=31063] ppid=31051 vsize=457240 CPUtime=4901.89 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 113818 1258 0 0 490171 18 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4210610 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=457240 CPUtime=4899.83 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 123917 1258 0 0 489962 21 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=457240 CPUtime=4899.96 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 129725 1258 0 0 489965 31 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=457240 CPUtime=4875.32 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 125674 1258 0 0 487508 24 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34460.7
Current children cumulated vsize (KiB) 2014988

[startup+4962.3 s]
/proc/loadavg: 7.03 7.05 7.00 8/177 31210
/proc/meminfo: memFree=29488480/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=179.71 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 523 157810 0 0 0 0 17941 30 15 0 1 0 526035667 18763776 391 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9224195386380386304 0 0 17 0 0 0 0
/proc/31051/statm: 4581 391 342 23 0 91 0
[pid=31053] ppid=31051 vsize=593328 CPUtime=4961.94 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 136579 0 0 0 496148 46 0 0 25 0 1 0 526035667 607567872 135713 33554432000 4194304 4785740 140735793307936 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 148332 135713 341 145 0 145377 0
[pid=31054] ppid=31051 vsize=468140 CPUtime=4959.83 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4438 0 0 0 495893 90 0 0 25 0 1 0 526035667 479375360 4335 33554432000 134512640 134534564 4286780272 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117035 4335 103 6 0 115701 0
[pid=31055] ppid=31051 vsize=478384 CPUtime=4962.01 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 233766 0 0 0 496168 33 0 0 25 0 1 0 526035667 489865216 93359 33554432000 4194304 4331988 140734748378864 18446744073709551615 4287087 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119596 93359 175 34 0 118038 0
[pid=31056] ppid=31051 vsize=457240 CPUtime=19816.8 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 499759 1258 0 0 1981583 96 0 0 18 0 5 0 526035667 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 114310 86370 164 40 0 112854 0
[pid=31056/tid=31063] ppid=31051 vsize=457240 CPUtime=4961.88 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 113818 1258 0 0 496170 18 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=457240 CPUtime=4959.81 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 123917 1258 0 0 495960 21 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=457240 CPUtime=4959.95 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 129725 1258 0 0 495964 31 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4334538 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=457240 CPUtime=4934.98 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 125674 1258 0 0 493474 24 0 0 25 0 5 0 526035680 468213760 86370 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34880.3
Current children cumulated vsize (KiB) 2015416

[startup+5022.3 s]
/proc/loadavg: 7.01 7.04 7.00 8/177 31212
/proc/meminfo: memFree=29504452/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=179.71 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 523 157810 0 0 0 0 17941 30 15 0 1 0 526035667 18763776 391 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9224195386380386304 0 0 17 0 0 0 0
/proc/31051/statm: 4581 391 342 23 0 91 0
[pid=31053] ppid=31051 vsize=594820 CPUtime=5021.94 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 136908 0 0 0 502148 46 0 0 25 0 1 0 526035667 609095680 136042 33554432000 4194304 4785740 140735793307936 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 148705 136042 341 145 0 145750 0
[pid=31054] ppid=31051 vsize=468140 CPUtime=5019.81 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4438 0 0 0 501890 91 0 0 25 0 1 0 526035667 479375360 4335 33554432000 134512640 134534564 4286780272 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117035 4335 103 6 0 115701 0
[pid=31055] ppid=31051 vsize=478384 CPUtime=5022.01 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 233766 0 0 0 502168 33 0 0 25 0 1 0 526035667 489865216 93359 33554432000 4194304 4331988 140734748378864 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119596 93359 175 34 0 118038 0
[pid=31056] ppid=31051 vsize=438808 CPUtime=20056.5 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 508975 1258 0 0 2005549 97 0 0 18 0 5 0 526035667 449339392 81762 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 109702 81762 164 40 0 108246 0
[pid=31056/tid=31063] ppid=31051 vsize=438808 CPUtime=5021.89 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 122010 1258 0 0 502170 19 0 0 25 0 5 0 526035680 449339392 81762 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=438808 CPUtime=5019.82 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 124941 1258 0 0 501960 22 0 0 25 0 5 0 526035680 449339392 81762 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=438808 CPUtime=5019.95 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 129725 1258 0 0 501964 31 0 0 25 0 5 0 526035680 449339392 81762 33554432000 4194304 4356188 140733430236992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=438808 CPUtime=4994.66 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 125674 1258 0 0 499442 24 0 0 25 0 5 0 526035680 449339392 81762 33554432000 4194304 4356188 140733430236992 18446744073709551615 4334501 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35299.9
Current children cumulated vsize (KiB) 1998476

[startup+5082.3 s]
/proc/loadavg: 7.00 7.03 7.00 8/177 31213
/proc/meminfo: memFree=29522028/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=179.71 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 523 157810 0 0 0 0 17941 30 15 0 1 0 526035667 18763776 391 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9224195386380386304 0 0 17 0 0 0 0
/proc/31051/statm: 4581 391 342 23 0 91 0
[pid=31053] ppid=31051 vsize=595780 CPUtime=5081.94 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 137108 0 0 0 508148 46 0 0 25 0 1 0 526035667 610078720 136242 33554432000 4194304 4785740 140735793307936 18446744073709551615 4549596 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 148945 136242 341 145 0 145990 0
[pid=31054] ppid=31051 vsize=468140 CPUtime=5079.76 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4438 0 0 0 507885 91 0 0 25 0 1 0 526035667 479375360 4335 33554432000 134512640 134534564 4286780272 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117035 4335 103 6 0 115701 0
[pid=31055] ppid=31051 vsize=478384 CPUtime=5082.02 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 233766 0 0 0 508169 33 0 0 25 0 1 0 526035667 489865216 93359 33554432000 4194304 4331988 140734748378864 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119596 93359 175 34 0 118038 0
[pid=31056] ppid=31051 vsize=420376 CPUtime=20296.1 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 517167 1258 0 0 2029515 98 0 0 18 0 5 0 526035667 430465024 77154 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 105094 77154 164 40 0 103638 0
[pid=31056/tid=31063] ppid=31051 vsize=420376 CPUtime=5081.89 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 122010 1258 0 0 508170 19 0 0 25 0 5 0 526035680 430465024 77154 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=420376 CPUtime=5079.81 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 124941 1258 0 0 507959 22 0 0 25 0 5 0 526035680 430465024 77154 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=420376 CPUtime=5079.95 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 129725 1258 0 0 507964 31 0 0 25 0 5 0 526035680 430465024 77154 33554432000 4194304 4356188 140733430236992 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=420376 CPUtime=5054.33 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 133866 1258 0 0 505408 25 0 0 25 0 5 0 526035680 430465024 77154 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35719.6
Current children cumulated vsize (KiB) 1981004



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 7.00 7.02 7.00 8/177 31214
/proc/meminfo: memFree=29520652/32951132 swapFree=67111356/67111528
[pid=31051] ppid=31049 vsize=18324 CPUtime=179.71 cores=0-7
/proc/31051/stat : 31051 (ppfolio) S 31049 31051 30983 0 -1 4202496 523 157810 0 0 0 0 17941 30 15 0 1 0 526035667 18763776 391 33554432000 4194304 4287625 140736505746304 18446744073709551615 274664828431 0 0 4096 65536 9224195386380386304 0 0 17 0 0 0 0
/proc/31051/statm: 4581 391 342 23 0 91 0
[pid=31053] ppid=31051 vsize=595780 CPUtime=5099.65 cores=1
/proc/31053/stat : 31053 (clasp) R 31051 31051 30983 0 -1 4202496 137108 0 0 0 509919 46 0 0 25 0 1 0 526035667 610078720 136242 33554432000 4194304 4785740 140735793307936 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31053/statm: 148945 136242 341 145 0 145990 0
[pid=31054] ppid=31051 vsize=468140 CPUtime=5097.46 cores=2
/proc/31054/stat : 31054 (TNM) R 31051 31051 30983 0 -1 4202496 4438 0 0 0 509655 91 0 0 25 0 1 0 526035667 479375360 4335 33554432000 134512640 134534564 4286780272 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31054/statm: 117035 4335 103 6 0 115701 0
[pid=31055] ppid=31051 vsize=478384 CPUtime=5099.72 cores=3
/proc/31055/stat : 31055 (march_hi) R 31051 31051 30983 0 -1 4202496 233766 0 0 0 509939 33 0 0 25 0 1 0 526035667 489865216 93359 33554432000 4194304 4331988 140734748378864 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31055/statm: 119596 93359 175 34 0 118038 0
[pid=31056] ppid=31051 vsize=422424 CPUtime=20366.8 cores=4-7
/proc/31056/stat : 31056 (plingeling) S 31051 31051 30983 0 -1 4202496 517679 1258 0 0 2036587 98 0 0 18 0 5 0 526035667 432562176 77666 33554432000 4194304 4356188 140733430236992 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/31056/statm: 105606 77666 164 40 0 104150 0
[pid=31056/tid=31063] ppid=31051 vsize=422424 CPUtime=5099.59 cores=4-7
/proc/31056/task/31063/stat : 31063 (plingeling) R 31051 31051 30983 0 -1 4202560 122522 1258 0 0 509940 19 0 0 25 0 5 0 526035680 432562176 77666 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31056/tid=31064] ppid=31051 vsize=422424 CPUtime=5097.52 cores=4-7
/proc/31056/task/31064/stat : 31064 (plingeling) R 31051 31051 30983 0 -1 4202560 124941 1258 0 0 509730 22 0 0 25 0 5 0 526035680 432562176 77666 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31056/tid=31065] ppid=31051 vsize=422424 CPUtime=5097.66 cores=4-7
/proc/31056/task/31065/stat : 31065 (plingeling) R 31051 31051 30983 0 -1 4202560 129725 1258 0 0 509735 31 0 0 25 0 5 0 526035680 432562176 77666 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31056/tid=31066] ppid=31051 vsize=422424 CPUtime=5071.94 cores=4-7
/proc/31056/task/31066/stat : 31066 (plingeling) R 31051 31051 30983 0 -1 4202560 133866 1258 0 0 507169 25 0 0 25 0 5 0 526035680 432562176 77666 33554432000 4194304 4356188 140733430236992 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35843.4
Current children cumulated vsize (KiB) 1983052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31051 and gives
#  childrusage.ru_utime.tv_sec=5275
#  childrusage.ru_utime.tv_usec=964931
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=221814
# CPU time returned by wait4() is 5277.19
# while last known CPU time is 35843.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 35843.4
CPU user time (s): 35840.4
CPU system time (s): 2.98
CPU usage (%): 702.809
Max. virtual memory (cumulated for all children) (KiB): 17406912

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5275.96
system time used= 1.22181
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 162771
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 311
involuntary context switches= 9493

runsolver used 8.36373 second user time and 19.2801 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-30 08:19:20
IDJOB=3274936
IDBENCH=70910
IDSOLVER=1638
FILE ID=node131/3274936-1304144360
RUNJOBID= node131-1304144350-30997
PBS_JOBID= 13170853
Free space on /tmp= 72060 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_11_3_4_cmp.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3274936-1304144360/watcher-3274936-1304144360 -o /tmp/evaluation-result-3274936-1304144360/solver-3274936-1304144360 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3274936-1304144360.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3b5e80540ef2fcb09cfe50ac7e3686c1
RANDOM SEED=1651826027

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30767036 kB
Buffers:        236604 kB
Cached:        1572500 kB
SwapCached:        168 kB
Active:         199552 kB
Inactive:      1675144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30767036 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           12304 kB
Writeback:          16 kB
AnonPages:       65900 kB
Mapped:          14392 kB
Slab:           244596 kB
PageTables:       4232 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   186984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72048 MiB
End job on node131 at 2011-04-30 09:44:22