Trace number 3729948

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 1623.75 1621.36

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
liu/vdw/normalized-vdw_k4_l4_n360.opb
MD5SUMa399b3055416a9d1117a7f2bb11b2cef
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark817.196
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables1440
Total number of constraints86040
Number of constraints which are clauses85680
Number of constraints which are cardinality constraints (but not clauses)360
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint4
Maximum length of a constraint4
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 7
Number of bits of the biggest sum of numbers3
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.39/0.51	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.39/0.51	c INFO: solving HOME/instance-3729948-1338714154.opb
0.99/1.17	c INFO: parsing took 0.65 s
2.19/2.38	c INFO: features took 1.20 CPU seconds
2.29/2.40	c INFO: running clasp-1.3.7@0 for 45 with 1797 remaining (b = 0.15)
49.42/49.55	c INFO: running scip-2.0.1-spx@0 for 45 with 1750 remaining (b = 0.04)
103.28/103.40	c INFO: wrote minion input file to HOME/tmpcumbpi.minion
103.28/103.40	c INFO: running minion-0.12@0 for 45 with 1702 remaining (b = 0.03)
151.11/151.11	c INFO: running scip-2.0.1-clp@0 for 45 with 1649 remaining (b = 0.02)
200.35/200.32	c INFO: running clasp-1.3.7@47 for 45 with 1600 remaining (b = 0.01)
245.54/245.48	c INFO: running scip-2.0.1-clp@48 for 45 with 1555 remaining (b = 0.01)
291.91/291.77	c INFO: running clasp-1.3.7@92 for 136 with 1509 remaining (b = 0.03)
429.54/429.19	c INFO: running wbo1.4a@0 for 45 with 1371 remaining (b = 0.01)
476.30/475.87	c INFO: running scip-2.0.1-spx@47 for 45 with 1325 remaining (b = 0.01)
521.61/521.02	c INFO: running scip-2.0.1-spx@92 for 410 with 1280 remaining (b = 0.06)
934.29/933.04	c INFO: running wbo1.4b-fixed@0 for 45 with 869 remaining (b = 0.01)
984.15/982.86	c INFO: running bsolo_pb10-l1@0 for 91 with 819 remaining (b = 0.01)
1076.00/1074.52	c INFO: running scip-2.0.1-spx@504 for 547 with 728 remaining (b = 0.06)
1623.54/1621.16	c INFO: running sat4j-pb-v20101225@0 for 45 with 182 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3729948-1338714154/watcher-3729948-1338714154 -o /tmp/evaluation-result-3729948-1338714154/solver-3729948-1338714154 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3729948-1338714154.opb -seed 1330804621 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.11 1.70 1.53 3/180 28648
/proc/meminfo: memFree=26301032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/28648/stat : 28648 (python) D 28646 28648 27000 0 -1 4202496 758 0 0 0 0 0 0 0 20 0 1 0 337542816 15749120 631 33554432000 4194304 5683644 140733338920224 140733338860712 219513963408 0 0 16781312 2 18446744072100609316 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 3845 631 334 364 0 287 0

[startup+0.069267 s]
/proc/loadavg: 2.11 1.70 1.53 3/180 28648
/proc/meminfo: memFree=26301032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=50280 CPUtime=0.05 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 2114 0 0 0 4 1 0 0 20 0 1 0 337542816 51486720 1724 33554432000 4194304 5683644 140733338920224 140733338852216 219504800618 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 12570 1727 493 364 0 1208 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50280

[startup+0.100231 s]
/proc/loadavg: 2.11 1.70 1.53 3/180 28648
/proc/meminfo: memFree=26301032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=92392 CPUtime=0.08 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 3220 506 1 0 6 2 0 0 20 0 1 0 337542816 94609408 2540 33554432000 4194304 5683644 140733338920224 140733338872696 5178104 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/28648/statm: 23098 2540 816 364 0 1620 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 92392

[startup+0.300188 s]
/proc/loadavg: 2.11 1.70 1.53 3/180 28648
/proc/meminfo: memFree=26301032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=166948 CPUtime=0.22 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 6561 1009 1 0 17 5 0 0 20 0 1 0 337542816 170954752 4351 33554432000 4194304 5683644 140733338920224 140733338824456 219513595738 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 41737 4351 1227 364 0 3290 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 166948

[startup+0.700214 s]
/proc/loadavg: 2.11 1.70 1.53 3/180 28648
/proc/meminfo: memFree=26301032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=290564 CPUtime=0.59 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 11804 1009 1 0 49 10 0 0 20 0 1 0 337542816 297537536 9349 33554432000 4194304 5683644 140733338920224 140733338913176 139733092025334 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 72641 9349 1811 364 0 7870 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 290564

[startup+1.50018 s]
/proc/loadavg: 2.11 1.70 1.53 3/181 28653
/proc/meminfo: memFree=26260032/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=304188 CPUtime=1.39 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 17948 1009 1 0 128 11 0 0 20 0 1 0 337542816 311488512 12798 33554432000 4194304 5683644 140733338920224 140733338907048 139733258749715 0 0 16781312 33554434 0 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 76047 12798 1846 364 0 11276 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 304188

[startup+3.10019 s]
/proc/loadavg: 2.10 1.70 1.53 3/181 28653
/proc/meminfo: memFree=26253148/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=382008 CPUtime=2.29 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 18725 1009 1 0 218 11 0 0 20 0 2 0 337542816 391176192 13363 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 95502 13363 1901 364 0 30725 0
Current children cumulated CPU time (s) 2.29
Current children cumulated vsize (KiB) 382008
heavy processes:

[startup+6.30032 s]
/proc/loadavg: 2.10 1.70 1.53 3/184 28656
/proc/meminfo: memFree=26223484/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=382008 CPUtime=2.29 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 18725 1009 1 0 218 11 0 0 20 0 2 0 337542816 391176192 13363 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 95502 13363 1901 364 0 30725 0
[pid=28654] ppid=28648 vsize=306228 CPUtime=0 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 870 0 0 0 0 0 0 0 20 0 1 0 337543056 313577472 11818 33554432000 4194304 5683644 140733338920224 140733338911312 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 76557 11818 362 364 0 11780 0
[pid=28656] ppid=28654 vsize=20264 CPUtime=3.88 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) R 28654 28656 28656 0 -1 4202496 5328 0 0 0 387 1 0 0 20 0 1 0 337543057 20750336 4804 33554432000 134512640 136139019 4289685808 4289684672 134608381 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/28656/statm: 5066 4804 181 398 0 4666 0
[pid=28648/tid=28655] ppid=28646 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 337543057 391176192 13363 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 708500

[startup+12.7003 s]
/proc/loadavg: 2.09 1.71 1.54 3/187 28659
/proc/meminfo: memFree=25877108/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=382008 CPUtime=2.29 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 18725 1009 1 0 218 11 0 0 20 0 2 0 337542816 391176192 13363 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 95502 13363 1901 364 0 30725 0
[pid=28654] ppid=28648 vsize=306228 CPUtime=0 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 874 0 0 0 0 0 0 0 20 0 1 0 337543056 313577472 11818 33554432000 4194304 5683644 140733338920224 140733338911312 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 76557 11818 362 364 0 11780 0
[pid=28656] ppid=28654 vsize=28152 CPUtime=10.28 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) R 28654 28656 28656 0 -1 4202496 7281 0 0 0 1027 1 0 0 20 0 1 0 337543057 28827648 6757 33554432000 134512640 136139019 4289685808 4289684784 134883787 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/28656/statm: 7038 6757 181 398 0 6638 0
[pid=28648/tid=28655] ppid=28646 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 337543057 391176192 13363 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 716388

[startup+25.5003 s]
/proc/loadavg: 2.07 1.72 1.54 3/187 28659
/proc/meminfo: memFree=25867940/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=382008 CPUtime=2.29 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 18725 1009 1 0 218 11 0 0 20 0 2 0 337542816 391176192 13363 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 95502 13363 1901 364 0 30725 0
[pid=28654] ppid=28648 vsize=306228 CPUtime=0.03 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 886 0 0 0 2 1 0 0 20 0 1 0 337543056 313577472 11819 33554432000 4194304 5683644 140733338920224 140733338911312 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 76557 11819 363 364 0 11780 0
[pid=28656] ppid=28654 vsize=33428 CPUtime=23.07 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) R 28654 28656 28656 0 -1 4202496 8574 0 0 0 2306 1 0 0 20 0 1 0 337543057 34230272 8050 33554432000 134512640 136139019 4289685808 4289684848 134867640 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/28656/statm: 8357 8050 181 398 0 7957 0
[pid=28648/tid=28655] ppid=28646 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 337543057 391176192 13363 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 721664

[startup+51.1006 s]
/proc/loadavg: 2.11 1.76 1.56 3/191 28663
/proc/meminfo: memFree=25705188/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=457800 CPUtime=2.32 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 19661 1009 1 0 221 11 0 0 20 0 3 0 337542816 468787200 13372 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 114450 13372 1904 364 0 49670 0
[pid=28654] ppid=28648 vsize=382008 CPUtime=0.07 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 1107 0 0 0 4 3 0 0 20 0 2 0 337543056 391176192 11859 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 95502 11859 396 364 0 30725 0
[pid=28656] ppid=28654 vsize=43700 CPUtime=47.1 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) T 28654 28656 28656 0 -1 4202496 11118 0 0 0 4708 2 0 0 20 0 1 0 337543057 44748800 10594 33554432000 134512640 136139019 4289685808 4289684848 134867640 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28656/statm: 10925 10594 181 398 0 10525 0
[pid=28654/tid=28660] ppid=28648 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28654/task/28660/stat : 28660 (python) S 28648 28648 27000 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337547769 391176192 11859 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28661] ppid=28648 vsize=382020 CPUtime=0 cores=0,2,4,6
/proc/28661/stat : 28661 (python) S 28648 28648 27000 0 -1 4202560 750 0 0 0 0 0 0 0 20 0 1 0 337547772 391188480 11797 33554432000 4194304 5683644 140733338920224 140733338911312 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/28661/statm: 95505 11797 335 364 0 30725 0
[pid=28663] ppid=28661 vsize=230888 CPUtime=1.53 cores=0,2,4,6
/proc/28663/stat : 28663 (scip-2.0.1.linu) R 28661 28663 28663 0 -1 4202496 47863 0 0 0 138 15 0 0 20 0 1 0 337547772 236429312 55092 33554432000 4194304 13684479 140737282441904 140737282438712 5564384 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/28663/statm: 57722 55092 689 2317 0 55400 0
[pid=28648/tid=28655] ppid=28646 vsize=457800 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 3 0 337543057 468787200 13372 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28662] ppid=28646 vsize=457800 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28662/stat : 28662 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 3 0 337547772 468787200 13372 33554432000 4194304 5683644 140733338920224 139733074899504 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 1496416

[startup+102.307 s]
/proc/loadavg: 2.04 1.80 1.58 3/196 28668
/proc/meminfo: memFree=25081280/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=457804 CPUtime=6.93 cores=0,2,4,6
/proc/28648/stat : 28648 (python) R 28646 28648 27000 0 -1 4202496 20317 1009 1 0 680 13 0 0 20 0 3 0 337542816 468791296 13373 33554432000 4194304 5683644 140733338920224 140733338914544 4571061 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 114451 13373 1904 364 0 49671 0
[pid=28654] ppid=28648 vsize=382008 CPUtime=0.07 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 1107 0 0 0 4 3 0 0 20 0 2 0 337543056 391176192 11859 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 95502 11859 396 364 0 30725 0
[pid=28656] ppid=28654 vsize=43700 CPUtime=47.1 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) T 28654 28656 28656 0 -1 4202496 11118 0 0 0 4708 2 0 0 20 0 1 0 337543057 44748800 10594 33554432000 134512640 136139019 4289685808 4289684848 134867640 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28656/statm: 10925 10594 181 398 0 10525 0
[pid=28654/tid=28660] ppid=28648 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28654/task/28660/stat : 28660 (python) S 28648 28648 27000 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337547769 391176192 11859 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28661] ppid=28648 vsize=382020 CPUtime=0.07 cores=0,2,4,6
/proc/28661/stat : 28661 (python) S 28648 28648 27000 0 -1 4202560 1041 0 0 0 5 2 0 0 20 0 2 0 337547772 391188480 11846 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28661/statm: 95505 11846 383 364 0 30725 0
[pid=28663] ppid=28661 vsize=313064 CPUtime=48.11 cores=0,2,4,6
/proc/28663/stat : 28663 (scip-2.0.1.linu) T 28661 28663 28663 0 -1 4202496 60623 0 0 0 4790 21 0 0 20 0 1 0 337547772 320577536 74678 33554432000 4194304 13684479 140737282441904 140737282433720 7390866 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28663/statm: 78266 74678 743 2317 0 75944 0
[pid=28661/tid=28668] ppid=28648 vsize=382020 CPUtime=0 cores=0,2,4,6
/proc/28661/task/28668/stat : 28668 (python) S 28648 28648 27000 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337552586 391188480 11846 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28648/tid=28655] ppid=28646 vsize=457804 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 3 0 337543057 468791296 13373 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28662] ppid=28646 vsize=457804 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28662/stat : 28662 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 3 0 337547772 468791296 13373 33554432000 4194304 5683644 140733338920224 139733074899504 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1578596

[startup+162.301 s]
/proc/loadavg: 2.06 1.84 1.61 3/208 28681
/proc/meminfo: memFree=24086300/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=609384 CPUtime=8.04 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 21533 1009 1 0 791 13 0 0 20 0 5 0 337542816 624009216 13388 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28648/statm: 152346 13388 1908 364 0 87560 0
[pid=28654] ppid=28648 vsize=382008 CPUtime=0.07 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 1107 0 0 0 4 3 0 0 20 0 2 0 337543056 391176192 11859 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28654/statm: 95502 11859 396 364 0 30725 0
[pid=28656] ppid=28654 vsize=43700 CPUtime=47.1 cores=0,2,4,6

################
# More data... #
################

[pid=28861/tid=28873] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28873/stat : 28873 (java) S 28859 28861 28861 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 337704938 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291764892552 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28874] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28874/stat : 28874 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291763841296 219517343520 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28875] ppid=28859 vsize=9558408 CPUtime=0.01 cores=0,2,4,6
/proc/28861/task/28875/stat : 28875 (java) S 28859 28861 28861 0 -1 4202560 335 0 0 0 1 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291762789176 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28876] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28876/stat : 28876 (java) S 28859 28861 28861 0 -1 4202560 495 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291761736632 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28861/tid=28877] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28877/stat : 28877 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291760683768 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28861/tid=28878] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28878/stat : 28878 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291759631432 219517335465 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28655] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 32 1009 0 0 0 0 0 0 20 0 9 0 337543057 934453248 13928 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28648/tid=28662] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28662/stat : 28662 (python) S 28646 28648 27000 0 -1 4202560 31 1009 0 0 0 0 0 0 20 0 9 0 337547772 934453248 13928 33554432000 4194304 5683644 140733338920224 139733074899504 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28648/tid=28674] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28674/stat : 28674 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337553156 934453248 13928 33554432000 4194304 5683644 140733338920224 139733059973680 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28679] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28679/stat : 28679 (python) S 28646 28648 27000 0 -1 4202560 20 1009 0 0 0 0 0 0 20 0 9 0 337557927 934453248 13928 33554432000 4194304 5683644 140733338920224 139733049483824 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28648/tid=28688] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28688/stat : 28688 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337585735 934453248 13928 33554432000 4194304 5683644 140733338920224 139733038993968 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28704] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28704/stat : 28704 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337636121 934453248 13928 33554432000 4194304 5683644 140733338920224 139733028504112 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28708] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28708/stat : 28708 (python) S 28646 28648 27000 0 -1 4202560 22 1009 0 0 0 0 0 0 20 0 9 0 337641103 934453248 13928 33554432000 4194304 5683644 140733338920224 139733018014256 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28860] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28860/stat : 28860 (python) S 28646 28648 27000 0 -1 4202560 20 1009 0 0 0 0 0 0 20 0 9 0 337704932 934453248 13928 33554432000 4194304 5683644 140733338920224 139732533109296 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1623.75
Current children cumulated vsize (KiB) 16600540

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1621.3 s]
/proc/loadavg: 2.10 2.03 1.90 3/222 28878
/proc/meminfo: memFree=24861508/32873648 swapFree=7120/7120
[pid=28648] ppid=28646 vsize=912552 CPUtime=8.24 cores=0,2,4,6
/proc/28648/stat : 28648 (python) S 28646 28648 27000 0 -1 4202496 25461 1009 1 0 809 15 0 0 20 0 9 0 337542816 934453248 13928 33554432000 4194304 5683644 140733338920224 140733338915056 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28648/statm: 228138 13928 1916 364 0 163340 0
[pid=28654] ppid=28648 vsize=382008 CPUtime=0.41 cores=0,2,4,6
/proc/28654/stat : 28654 (python) S 28648 28648 27000 0 -1 4202560 1169 0 0 0 24 17 0 0 20 0 2 0 337543056 391176192 11860 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28654/statm: 95502 11860 397 364 0 30725 0
[pid=28656] ppid=28654 vsize=70864 CPUtime=229.59 cores=0,2,4,6
/proc/28656/stat : 28656 (clasp-1.3.7-x86) T 28654 28656 28656 0 -1 4202496 17734 0 0 0 22956 3 0 0 20 0 1 0 337543057 72564736 17264 33554432000 134512640 136139019 4289685808 4289684592 134871042 0 0 16781312 16386 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/28656/statm: 17716 17264 181 398 0 17316 0
[pid=28654/tid=28660] ppid=28648 vsize=382008 CPUtime=0 cores=0,2,4,6
/proc/28654/task/28660/stat : 28660 (python) S 28648 28648 27000 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 2 0 337547769 391176192 11860 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28661] ppid=28648 vsize=382020 CPUtime=1.97 cores=0,2,4,6
/proc/28661/stat : 28661 (python) S 28648 28648 27000 0 -1 4202560 1152 0 0 0 113 84 0 0 20 0 2 0 337547772 391188480 11846 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28661/statm: 95505 11846 383 364 0 30725 0
[pid=28663] ppid=28661 vsize=468372 CPUtime=1051.72 cores=0,2,4,6
/proc/28663/stat : 28663 (scip-2.0.1.linu) T 28661 28663 28663 0 -1 4202496 98585 0 0 0 105021 151 0 0 20 0 1 0 337547772 479612928 114394 33554432000 4194304 13684479 140737282441904 140737282435576 7390780 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/28663/statm: 117093 114394 817 2317 0 114771 0
[pid=28661/tid=28668] ppid=28648 vsize=382020 CPUtime=0 cores=0,2,4,6
/proc/28661/task/28668/stat : 28668 (python) S 28648 28648 27000 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337552586 391188480 11846 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28673] ppid=28648 vsize=457812 CPUtime=0.07 cores=0,2,4,6
/proc/28673/stat : 28673 (python) S 28648 28648 27000 0 -1 4202560 1070 0 0 0 4 3 0 0 20 0 2 0 337553156 468799488 11852 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28673/statm: 114453 11852 383 364 0 49670 0
[pid=28675] ppid=28673 vsize=262084 CPUtime=47.66 cores=0,2,4,6
/proc/28675/stat : 28675 (minion) T 28673 28675 28675 0 -1 4202496 54786 0 0 0 4759 7 0 0 20 0 1 0 337553156 268374016 58219 33554432000 134512640 165565024 4288624736 4288622048 158624694 0 0 16781312 8396802 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28675/statm: 65521 58219 345 7582 0 57936 0
[pid=28673/tid=28677] ppid=28648 vsize=457812 CPUtime=0 cores=0,2,4,6
/proc/28673/task/28677/stat : 28677 (python) S 28648 28648 27000 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 2 0 337557924 468799488 11852 33554432000 4194304 5683644 140733338920224 139733074899504 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28678] ppid=28648 vsize=533604 CPUtime=0.16 cores=0,2,4,6
/proc/28678/stat : 28678 (python) S 28648 28648 27000 0 -1 4202560 1131 0 0 0 9 7 0 0 20 0 2 0 337557927 546410496 11858 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28678/statm: 133401 11858 383 364 0 68615 0
[pid=28680] ppid=28678 vsize=337000 CPUtime=95.43 cores=0,2,4,6
/proc/28680/stat : 28680 (scip-2.0.1.linu) T 28678 28680 28680 0 -1 4202496 68208 0 0 0 9509 34 0 0 20 0 1 0 337557927 345088000 81670 33554432000 4194304 15243407 140734332643072 140734332637784 6951769 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28680/statm: 84250 81670 872 2698 0 81545 0
[pid=28678/tid=28685] ppid=28648 vsize=533604 CPUtime=0 cores=0,2,4,6
/proc/28678/task/28685/stat : 28685 (python) S 28648 28648 27000 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 337562846 546410496 11858 33554432000 4194304 5683644 140733338920224 139733059973680 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28687] ppid=28648 vsize=609396 CPUtime=0.08 cores=0,2,4,6
/proc/28687/stat : 28687 (python) S 28648 28648 27000 0 -1 4202560 1109 0 0 0 4 4 0 0 20 0 2 0 337585735 624021504 11864 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28687/statm: 152349 11864 383 364 0 87560 0
[pid=28689] ppid=28687 vsize=85396 CPUtime=46.64 cores=0,2,4,6
/proc/28689/stat : 28689 (wbo1.4a) T 28687 28689 28689 0 -1 4202496 22047 0 0 0 4644 20 0 0 20 0 1 0 337585736 87445504 20835 33554432000 134512640 135751879 4291649136 4291647308 134517428 0 0 16781312 3 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/28689/statm: 21349 20835 143 303 0 21044 0
[pid=28687/tid=28694] ppid=28648 vsize=609396 CPUtime=0 cores=0,2,4,6
/proc/28687/task/28694/stat : 28694 (python) S 28648 28648 27000 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 2 0 337590401 624021504 11864 33554432000 4194304 5683644 140733338920224 139733049483824 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28703] ppid=28648 vsize=685188 CPUtime=0.08 cores=0,2,4,6
/proc/28703/stat : 28703 (python) S 28648 28648 27000 0 -1 4202560 1119 0 0 0 5 3 0 0 20 0 2 0 337636121 701632512 11870 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/28703/statm: 171297 11870 383 364 0 106505 0
[pid=28705] ppid=28703 vsize=87436 CPUtime=49.77 cores=0,2,4,6
/proc/28705/stat : 28705 (wbo1.4b-fixed) T 28703 28705 28705 0 -1 4202496 22559 0 0 0 4955 22 0 0 20 0 1 0 337636121 89534464 21342 33554432000 134512640 135752315 4290248576 4290246576 134611727 0 0 16781312 3 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/28705/statm: 21859 21342 147 303 0 21554 0
[pid=28703/tid=28706] ppid=28648 vsize=685188 CPUtime=0 cores=0,2,4,6
/proc/28703/task/28706/stat : 28706 (python) S 28648 28648 27000 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 337641101 701632512 11870 33554432000 4194304 5683644 140733338920224 139733038993968 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28707] ppid=28648 vsize=760980 CPUtime=0.17 cores=0,2,4,6
/proc/28707/stat : 28707 (python) S 28648 28648 27000 0 -1 4202560 1139 0 0 0 8 9 0 0 20 0 2 0 337641103 779243520 11876 33554432000 4194304 5683644 140733338920224 140733338911872 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/28707/statm: 190245 11876 383 364 0 125450 0
[pid=28709] ppid=28707 vsize=170648 CPUtime=91.62 cores=0,2,4,6
/proc/28709/stat : 28709 (bsolo_pb10) T 28707 28709 28709 0 -1 4202496 42690 0 0 0 9140 22 0 0 20 0 1 0 337641103 174743552 40220 33554432000 134512640 137138936 4293887168 4293886096 134542187 0 0 16781312 16384 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/28709/statm: 42662 40220 190 642 0 42018 0
[pid=28707/tid=28715] ppid=28648 vsize=760980 CPUtime=0 cores=0,2,4,6
/proc/28707/task/28715/stat : 28715 (python) S 28648 28648 27000 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 337650267 779243520 11876 33554432000 4194304 5683644 140733338920224 139733028504112 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28859] ppid=28648 vsize=836772 CPUtime=0 cores=0,2,4,6
/proc/28859/stat : 28859 (python) S 28648 28648 27000 0 -1 4202560 829 0 0 0 0 0 0 0 20 0 1 0 337704932 856854528 11833 33554432000 4194304 5683644 140733338920224 140733338911312 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/28859/statm: 209193 11833 335 364 0 144395 0
[pid=28861] ppid=28859 vsize=9558408 CPUtime=0.14 cores=0,2,4,6
/proc/28861/stat : 28861 (java) S 28859 28861 28861 0 -1 4202496 4664 0 1 0 13 1 0 0 20 0 18 0 337704932 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140735771522096 219517321277 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28861/statm: 2389602 6125 2151 9 0 2380296 0
[pid=28861/tid=28862] ppid=28859 vsize=9558408 CPUtime=0.1 cores=0,2,4,6
/proc/28861/task/28862/stat : 28862 (java) R 28859 28861 28861 0 -1 4202560 2418 0 1 0 10 0 0 0 20 0 18 0 337704933 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291943362256 140291768134996 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28863] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28863/stat : 28863 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291904854440 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28864] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28864/stat : 28864 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291903801896 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28861/tid=28865] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28865/stat : 28865 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291902748840 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28861/tid=28866] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28866/stat : 28866 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291901696296 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28861/tid=28867] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28867/stat : 28867 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291900644264 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28868] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28868/stat : 28868 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291899591720 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28861/tid=28869] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28869/stat : 28869 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291898538664 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28861/tid=28870] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28870/stat : 28870 (java) S 28859 28861 28861 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 18 0 337704936 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291897486120 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28871] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28871/stat : 28871 (java) S 28859 28861 28861 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 337704937 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291766999400 219517335465 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28872] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28872/stat : 28872 (java) S 28859 28861 28861 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 18 0 337704938 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291765945720 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28873] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28873/stat : 28873 (java) S 28859 28861 28861 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 337704938 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291764892552 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28874] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28874/stat : 28874 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291763841296 219517343520 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28875] ppid=28859 vsize=9558408 CPUtime=0.01 cores=0,2,4,6
/proc/28861/task/28875/stat : 28875 (java) S 28859 28861 28861 0 -1 4202560 335 0 0 0 1 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291762789176 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28861/tid=28876] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28876/stat : 28876 (java) S 28859 28861 28861 0 -1 4202560 495 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291761736632 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28861/tid=28877] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28877/stat : 28877 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291760683768 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28861/tid=28878] ppid=28859 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/28861/task/28878/stat : 28878 (java) S 28859 28861 28861 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 337704940 9787809792 6125 33554432000 1073741824 1073778376 140735771530960 140291759631432 219517335465 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28655] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28655/stat : 28655 (python) S 28646 28648 27000 0 -1 4202560 32 1009 0 0 0 0 0 0 20 0 9 0 337543057 934453248 13928 33554432000 4194304 5683644 140733338920224 139733085389360 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28648/tid=28662] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28662/stat : 28662 (python) S 28646 28648 27000 0 -1 4202560 31 1009 0 0 0 0 0 0 20 0 9 0 337547772 934453248 13928 33554432000 4194304 5683644 140733338920224 139733074899504 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=28648/tid=28674] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28674/stat : 28674 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337553156 934453248 13928 33554432000 4194304 5683644 140733338920224 139733059973680 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28648/tid=28679] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28679/stat : 28679 (python) S 28646 28648 27000 0 -1 4202560 20 1009 0 0 0 0 0 0 20 0 9 0 337557927 934453248 13928 33554432000 4194304 5683644 140733338920224 139733049483824 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=28648/tid=28688] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28688/stat : 28688 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337585735 934453248 13928 33554432000 4194304 5683644 140733338920224 139733038993968 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28704] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28704/stat : 28704 (python) S 28646 28648 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 9 0 337636121 934453248 13928 33554432000 4194304 5683644 140733338920224 139733028504112 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28708] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28708/stat : 28708 (python) S 28646 28648 27000 0 -1 4202560 22 1009 0 0 0 0 0 0 20 0 9 0 337641103 934453248 13928 33554432000 4194304 5683644 140733338920224 139733018014256 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=28648/tid=28860] ppid=28646 vsize=912552 CPUtime=0 cores=0,2,4,6
/proc/28648/task/28860/stat : 28860 (python) S 28646 28648 27000 0 -1 4202560 20 1009 0 0 0 0 0 0 20 0 9 0 337704932 934453248 13928 33554432000 4194304 5683644 140733338920224 139732533109296 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1623.75
Current children cumulated vsize (KiB) 16600540

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28648 and gives
#  childrusage.ru_utime.tv_sec=8
#  childrusage.ru_utime.tv_usec=95769
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=158975
# CPU time returned by wait4() is 8.25474
# while last known CPU time is 1623.75
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1621.36
CPU time (s): 1623.75
CPU user time (s): 1619.73
CPU system time (s): 4.02
CPU usage (%): 100.147
Max. virtual memory (cumulated for all children) (KiB): 16600540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 8.09577
system time used= 0.158975
maximum resident set size= 56848
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26470
page faults= 1
swaps= 0
block input operations= 0
block output operations= 11232
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1135
involuntary context switches= 51

runsolver used 6.84996 second user time and 16.7744 second system time

The end

Launcher Data 

Begin job on node114 at 2012-06-03 11:02:34
IDJOB=3729948
IDBENCH=1372
IDSOLVER=2327
FILE ID=node114/3729948-1338714154
RUNJOBID= node114-1338713908-27016
PBS_JOBID= 14636748
Free space on /tmp= 70032 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/liu/vdw/normalized-vdw_k4_l4_n360.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3729948-1338714154/watcher-3729948-1338714154 -o /tmp/evaluation-result-3729948-1338714154/solver-3729948-1338714154 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3729948-1338714154.opb -seed 1330804621 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a399b3055416a9d1117a7f2bb11b2cef
RANDOM SEED=1330804621

node114.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5451.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26301692 kB
Buffers:          957280 kB
Cached:          4492628 kB
SwapCached:         2312 kB
Active:          3068152 kB
Inactive:        2516572 kB
Active(anon):     121832 kB
Inactive(anon):     8456 kB
Active(file):    2946320 kB
Inactive(file):  2508116 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108856 kB
SwapFree:       67103580 kB
Dirty:            105700 kB
Writeback:             0 kB
AnonPages:        133112 kB
Mapped:            18024 kB
Shmem:               128 kB
Slab:             848124 kB
SReclaimable:     290548 kB
SUnreclaim:       557576 kB
KernelStack:        1472 kB
PageTables:         5432 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     327912 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69992 MiB
End job on node114 at 2012-06-03 11:29:38