Trace number 3481846

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 391.06 411.491

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-mzzv11.opb
MD5SUMa74bcf40291587dc368e3a23fd278be9
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-10859
Best CPU time to get the best result obtained on this benchmark816.194
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -10639
Optimality of the best value was proved NO
Number of variables11247
Total number of constraints9744
Number of constraints which are clauses77
Number of constraints which are cardinality constraints (but not clauses)5755
Number of constraints which are nor clauses,nor cardinality constraints3912
Minimum length of a constraint2
Maximum length of a constraint68
Number of terms in the objective function 773
Biggest coefficient in the objective function 1000
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 76861
Number of bits of the sum of numbers in the objective function 17
Biggest number in a constraint 1999
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 76861
Number of bits of the biggest sum of numbers17
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.57/25.23	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.57/25.23	c INFO: solving HOME/instance-3481846-1307576357.opb
0.77/25.45	c INFO: parsing took 0.21 s
1.15/25.87	c INFO: features took 0.41 CPU seconds
1.15/25.89	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.19)
51.41/75.92	c INFO: running wbo1.4a@0 for 45 with 1749 remaining (b = 0.03)
100.09/124.59	c INFO: running scip-2.0.1-clp@0 for 45 with 1701 remaining (b = 0.02)
150.69/174.99	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1651 remaining (b = 0.00)
201.54/223.34	c INFO: running bsolo_pb10-l3@0 for 136 with 1601 remaining (b = 0.01)
343.17/364.69	c INFO: running wbo1.4a@48 for 45 with 1460 remaining (b = 0.00)
389.30/410.53	c INFO: running sat4j-pb-v20101225@0 for 91 with 1414 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481846-1307576357/watcher-3481846-1307576357 -o /tmp/evaluation-result-3481846-1307576357/solver-3481846-1307576357 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481846-1307576357.opb -seed 611056974 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.36 0.09 0.02 2/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=11796 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (runsolver) S 1440 1444 1406 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 1 0 869235571 12079104 50 33554432000 4194304 5432328 140736272604576 18446744073709551615 4881591 0 2147483391 4096 24578 18446744071700214583 0 0 17 4 0 0 0
/proc/1444/statm: 2949 50 31 303 0 2643 0

[startup+0.117734 s]
/proc/loadavg: 0.36 0.09 0.02 2/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=1840 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (python) D 1440 1444 1406 0 -1 4194304 47 0 0 0 0 0 0 0 18 0 1 0 869235571 1884160 1 33554432000 0 0 140735829624488 18446744073709551615 5055479 0 0 4096 0 18446744071562234166 0 0 17 6 0 0 1
/proc/1444/statm: 460 1 0 0 0 36 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1840

[startup+0.200768 s]
/proc/loadavg: 0.36 0.09 0.02 2/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=14252 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (python) D 1440 1444 1406 0 -1 4194304 193 0 2 0 0 0 0 0 18 0 1 0 869235571 14594048 130 33554432000 4194304 5683644 140735829615760 18446744073709551615 5398816 0 0 4096 0 18446744071562234166 0 0 17 6 0 0 5
/proc/1444/statm: 3563 130 102 364 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14252

[startup+0.300741 s]
/proc/loadavg: 0.36 0.09 0.02 2/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=14820 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 506 0 7 0 0 0 0 0 17 0 1 0 869235571 15175680 420 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516830053 0 2147483391 4096 0 18446744071699453118 0 0 17 6 0 0 11
/proc/1444/statm: 3705 420 259 364 0 192 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14820

[startup+0.700757 s]
/proc/loadavg: 0.36 0.09 0.02 2/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 718 0 7 0 0 0 0 0 16 0 1 0 869235571 15548416 615 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 15
/proc/1444/statm: 3796 615 321 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+1.50056 s]
/proc/loadavg: 0.36 0.09 0.02 2/425 1446
/proc/meminfo: memFree=26939272/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=15756 CPUtime=0 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 833 0 7 0 0 0 0 0 16 0 1 0 869235571 16134144 723 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 22
/proc/1444/statm: 3939 723 334 364 0 426 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15756

[startup+3.10023 s]
/proc/loadavg: 0.49 0.12 0.03 2/425 1446
/proc/meminfo: memFree=26934192/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=16400 CPUtime=0.02 cores=0,2,4,6
/proc/1444/stat : 1444 (python) D 1440 1444 1406 0 -1 4202496 1111 0 7 0 1 1 0 0 16 0 1 0 869235571 16793600 985 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516830053 0 0 16781312 2 0 0 0 17 2 0 0 36
/proc/1444/statm: 4100 985 409 364 0 587 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16400
heavy processes:

[startup+6.30067 s]
/proc/loadavg: 0.49 0.12 0.03 2/425 1446
/proc/meminfo: memFree=26935772/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=18892 CPUtime=0.03 cores=0,2,4,6
/proc/1444/stat : 1444 (python) D 1440 1444 1406 0 -1 4202496 1243 0 8 0 2 1 0 0 16 0 1 0 869235571 19345408 1105 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516832256 0 0 16781312 2 0 0 0 17 2 0 0 46
/proc/1444/statm: 4723 1105 421 364 0 692 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 18892
heavy processes:

[startup+12.7006 s]
/proc/loadavg: 0.45 0.12 0.03 2/425 1446
/proc/meminfo: memFree=26930388/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=36512 CPUtime=0.07 cores=0,2,4,6
/proc/1444/stat : 1444 (python) D 1440 1444 1406 0 -1 4202496 1601 0 14 0 4 3 0 0 16 0 1 0 869235571 37388288 1446 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516830053 0 0 16781312 2 0 0 0 17 2 0 0 82
/proc/1444/statm: 9128 1446 452 364 0 945 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 36512
heavy processes:

[startup+25.5012 s]
/proc/loadavg: 0.64 0.18 0.05 4/425 1454
/proc/meminfo: memFree=26859020/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=291044 CPUtime=0.85 cores=0,2,4,6
/proc/1444/stat : 1444 (python) R 1440 1444 1406 0 -1 4202496 12550 922 112 9 64 21 0 0 16 0 1 0 869235571 298029056 9107 33554432000 4194304 5683644 140735829615760 18446744073709551615 47099112256937 0 0 16781312 33554434 0 0 0 17 2 0 0 280
/proc/1444/statm: 72761 9107 1815 364 0 7654 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 291044
heavy processes:

[startup+51.1005 s]
/proc/loadavg: 1.24 0.35 0.12 4/431 1461
/proc/meminfo: memFree=26614952/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=301468 CPUtime=1.24 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 12874 922 112 9 103 21 0 0 18 0 2 0 869235571 308703232 9204 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 280
/proc/1444/statm: 75367 9204 1870 364 0 10254 0
[pid=1458] ppid=1444 vsize=291224 CPUtime=0.09 cores=0,2,4,6
/proc/1458/stat : 1458 (python) S 1444 1444 1406 0 -1 4202560 1003 0 0 0 5 4 0 0 15 0 1 0 869238161 298213376 7710 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516854287 0 0 16781312 33554946 4294934786 0 0 17 4 0 0 0
/proc/1458/statm: 72806 7710 380 364 0 7693 0
[pid=1460] ppid=1458 vsize=176756 CPUtime=25.18 cores=0,2,4,6
/proc/1460/stat : 1460 (scip-2.0.1.linu) R 1458 1460 1460 0 -1 4202496 42107 0 0 0 2482 36 0 0 25 0 1 0 869238161 180998144 41403 33554432000 4194304 13684479 140735409691456 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/1460/statm: 44189 41403 661 2317 0 41867 0
[pid=1444/tid=1459] ppid=1440 vsize=301468 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1459/stat : 1459 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 18 0 2 0 869238161 308703232 9204 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 26.51
Current children cumulated vsize (KiB) 769448
heavy processes:

[startup+102.301 s]
/proc/loadavg: 1.78 0.65 0.23 5/439 1470
/proc/meminfo: memFree=26387660/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=311724 CPUtime=1.27 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 13788 922 112 9 105 22 0 0 20 0 3 0 869235571 319205376 9211 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 280
/proc/1444/statm: 77931 9211 1873 364 0 12815 0
[pid=1458] ppid=1444 vsize=301468 CPUtime=0.19 cores=0,2,4,6
/proc/1458/stat : 1458 (python) S 1444 1444 1406 0 -1 4202560 1150 0 0 0 10 9 0 0 17 0 2 0 869238161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/1458/statm: 75367 7746 411 364 0 10254 0
[pid=1460] ppid=1458 vsize=226992 CPUtime=49.98 cores=0,2,4,6
/proc/1460/stat : 1460 (scip-2.0.1.linu) T 1458 1460 1460 0 -1 4202496 55475 0 0 0 4950 48 0 0 25 0 1 0 869238161 232439808 53140 33554432000 4194304 13684479 140735409691456 18446744073709551615 7456833 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/1460/statm: 56748 53140 756 2317 0 54426 0
[pid=1458/tid=1463] ppid=1444 vsize=301468 CPUtime=0 cores=0,2,4,6
/proc/1458/task/1463/stat : 1463 (python) S 1444 1444 1406 0 -1 4202560 40 0 0 0 0 0 0 0 17 0 2 0 869243161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453872511168 0 0 -1 4 0 0 0
[pid=1464] ppid=1444 vsize=301480 CPUtime=0.11 cores=0,2,4,6
/proc/1464/stat : 1464 (python) S 1444 1444 1406 0 -1 4202560 966 0 0 0 6 5 0 0 15 0 1 0 869243164 308715520 7706 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516854342 0 0 16781312 33554946 72556772316949206 0 0 17 6 0 0 0
/proc/1464/statm: 75370 7706 372 364 0 10254 0
[pid=1466] ppid=1464 vsize=96152 CPUtime=26.27 cores=0,2,4,6
/proc/1466/stat : 1466 (wbo1.4a) R 1464 1466 1466 0 -1 4202496 24693 0 0 0 2613 14 0 0 25 0 1 0 869243172 98459648 23492 33554432000 134512640 135751879 4291484816 18446744073709551615 134602977 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/1466/statm: 24038 23492 146 303 0 23733 0
[pid=1444/tid=1459] ppid=1440 vsize=311724 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1459/stat : 1459 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 18 0 3 0 869238161 319205376 9211 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1465] ppid=1440 vsize=311724 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1465/stat : 1465 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 20 0 3 0 869243164 319205376 9211 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 77.82
Current children cumulated vsize (KiB) 1237816
heavy processes:

[startup+162.301 s]
/proc/loadavg: 1.91 0.87 0.33 4/447 1480
/proc/meminfo: memFree=26081504/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=321980 CPUtime=1.3 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 14667 922 112 9 108 22 0 0 20 0 4 0 869235571 329707520 9217 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 280
/proc/1444/statm: 80495 9217 1875 364 0 15376 0
[pid=1458] ppid=1444 vsize=301468 CPUtime=0.19 cores=0,2,4,6
/proc/1458/stat : 1458 (python) S 1444 1444 1406 0 -1 4202560 1150 0 0 0 10 9 0 0 17 0 2 0 869238161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/1458/statm: 75367 7746 411 364 0 10254 0
[pid=1460] ppid=1458 vsize=226992 CPUtime=49.98 cores=0,2,4,6
/proc/1460/stat : 1460 (scip-2.0.1.linu) T 1458 1460 1460 0 -1 4202496 55475 0 0 0 4950 48 0 0 25 0 1 0 869238161 232439808 53140 33554432000 4194304 13684479 140735409691456 18446744073709551615 7456833 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/1460/statm: 56748 53140 756 2317 0 54426 0
[pid=1458/tid=1463] ppid=1444 vsize=301468 CPUtime=0 cores=0,2,4,6
/proc/1458/task/1463/stat : 1463 (python) S 1444 1444 1406 0 -1 4202560 40 0 0 0 0 0 0 0 17 0 2 0 869243161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453872511168 0 0 -1 4 0 0 0
[pid=1464] ppid=1444 vsize=301480 CPUtime=0.19 cores=0,2,4,6
/proc/1464/stat : 1464 (python) S 1444 1444 1406 0 -1 4202560 1134 0 0 0 10 9 0 0 17 0 2 0 869243164 308715520 7731 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/1464/statm: 75370 7731 396 364 0 10254 0
[pid=1466] ppid=1464 vsize=111920 CPUtime=48.55 cores=0,2,4,6
/proc/1466/stat : 1466 (wbo1.4a) T 1464 1466 1466 0 -1 4202496 28743 0 0 0 4832 23 0 0 25 0 1 0 869243172 114606080 27542 33554432000 134512640 135751879 4291484816 18446744073709551615 134517414 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/1466/statm: 27980 27542 146 303 0 27675 0
[pid=1464/tid=1472] ppid=1444 vsize=301480 CPUtime=0 cores=0,2,4,6
/proc/1464/task/1472/stat : 1472 (python) S 1444 1444 1406 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869248028 308715520 7731 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604446052169920 0 0 -1 4 0 0 0
[pid=1473] ppid=1444 vsize=311736 CPUtime=0.15 cores=0,2,4,6
/proc/1473/stat : 1473 (python) S 1444 1444 1406 0 -1 4202560 957 0 0 0 8 7 0 0 15 0 1 0 869248031 319217664 7710 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516854342 0 0 16781312 33554946 72556772316949206 0 0 17 6 0 0 0
/proc/1473/statm: 77934 7710 372 364 0 12815 0
[pid=1475] ppid=1473 vsize=217696 CPUtime=37.68 cores=0,2,4,6
/proc/1475/stat : 1475 (scip-2.0.1.linu) R 1473 1475 1475 0 -1 4202496 62624 0 0 0 3721 47 0 0 25 0 1 0 869248031 222920704 49455 33554432000 4194304 15243407 140734346365808 18446744073709551615 8126710 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/1475/statm: 54424 49455 860 2698 0 51719 0
[pid=1444/tid=1459] ppid=1440 vsize=321980 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1459/stat : 1459 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 18 0 4 0 869238161 329707520 9217 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1465] ppid=1440 vsize=321980 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1465/stat : 1465 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 20 0 4 0 869243164 329707520 9217 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1474] ppid=1440 vsize=321980 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1474/stat : 1474 (python) S 1440 1444 1406 0 -1 4202560 33 922 0 9 0 0 0 0 20 0 4 0 869248031 329707520 9217 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 138.04
Current children cumulated vsize (KiB) 1793272

[startup+222.318 s]
/proc/loadavg: 2.08 1.12 0.45 4/470 1505
/proc/meminfo: memFree=24431180/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=332236 CPUtime=1.32 cores=0,2,4,6

################
# More data... #
################

[pid=1444/tid=1465] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1465/stat : 1465 (python) S 1440 1444 1406 0 -1 4202560 32 922 0 9 0 0 0 0 18 0 7 0 869243164 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1474] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1474/stat : 1474 (python) S 1440 1444 1406 0 -1 4202560 33 922 0 9 0 0 0 0 20 0 7 0 869248031 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1484] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1484/stat : 1484 (python) S 1440 1444 1406 0 -1 4202560 31 922 0 9 0 0 0 0 20 0 7 0 869253071 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1508] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1508/stat : 1508 (python) S 1440 1444 1406 0 -1 4202560 29 922 0 9 0 0 0 0 18 0 7 0 869257906 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1525] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1525/stat : 1525 (python) S 1440 1444 1406 0 -1 4202560 32 922 0 9 0 0 0 0 20 0 7 0 869276625 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 391.06
Current children cumulated vsize (KiB) 20072156

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+411.402 s]
/proc/loadavg: 2.14 1.55 0.73 6/504 1544
/proc/meminfo: memFree=23698404/32951124 swapFree=43359760/67111528
[pid=1444] ppid=1440 vsize=352748 CPUtime=1.4 cores=0,2,4,6
/proc/1444/stat : 1444 (python) S 1440 1444 1406 0 -1 4202496 17397 922 112 9 117 23 0 0 20 0 7 0 869235571 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 280
/proc/1444/statm: 88187 9235 1881 364 0 23059 0
[pid=1458] ppid=1444 vsize=301468 CPUtime=0.19 cores=0,2,4,6
/proc/1458/stat : 1458 (python) S 1444 1444 1406 0 -1 4202560 1150 0 0 0 10 9 0 0 17 0 2 0 869238161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/1458/statm: 75367 7746 411 364 0 10254 0
[pid=1460] ppid=1458 vsize=226992 CPUtime=49.98 cores=0,2,4,6
/proc/1460/stat : 1460 (scip-2.0.1.linu) T 1458 1460 1460 0 -1 4202496 55475 0 0 0 4950 48 0 0 25 0 1 0 869238161 232439808 53140 33554432000 4194304 13684479 140735409691456 18446744073709551615 7456833 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/1460/statm: 56748 53140 756 2317 0 54426 0
[pid=1458/tid=1463] ppid=1444 vsize=301468 CPUtime=0 cores=0,2,4,6
/proc/1458/task/1463/stat : 1463 (python) S 1444 1444 1406 0 -1 4202560 40 0 0 0 0 0 0 0 17 0 2 0 869243161 308703232 7746 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453872511168 0 0 -1 4 0 0 0
[pid=1464] ppid=1444 vsize=301480 CPUtime=0.39 cores=0,2,4,6
/proc/1464/stat : 1464 (python) S 1444 1444 1406 0 -1 4202560 1171 0 0 0 21 18 0 0 15 0 2 0 869243164 308715520 7731 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/1464/statm: 75370 7731 396 364 0 10254 0
[pid=1466] ppid=1464 vsize=151112 CPUtime=94.37 cores=0,2,4,6
/proc/1466/stat : 1466 (wbo1.4a) T 1464 1466 1466 0 -1 4202496 38487 0 0 0 9399 38 0 0 25 0 1 0 869243172 154738688 37286 33554432000 134512640 135751879 4291484816 18446744073709551615 134616540 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/1466/statm: 37778 37286 146 303 0 37473 0
[pid=1464/tid=1472] ppid=1444 vsize=301480 CPUtime=0 cores=0,2,4,6
/proc/1464/task/1472/stat : 1472 (python) S 1444 1444 1406 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 869248028 308715520 7731 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604446052169920 0 0 -1 4 0 0 0
[pid=1473] ppid=1444 vsize=311736 CPUtime=0.2 cores=0,2,4,6
/proc/1473/stat : 1473 (python) S 1444 1444 1406 0 -1 4202560 1126 0 0 0 11 9 0 0 16 0 2 0 869248031 319217664 7735 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/1473/statm: 77934 7735 396 364 0 12815 0
[pid=1475] ppid=1473 vsize=218528 CPUtime=50.36 cores=0,2,4,6
/proc/1475/stat : 1475 (scip-2.0.1.linu) T 1473 1475 1475 0 -1 4202496 87205 0 0 0 4984 52 0 0 25 0 1 0 869248031 223772672 49977 33554432000 4194304 15243407 140734346365808 18446744073709551615 6951790 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/1475/statm: 54632 49977 860 2698 0 51927 0
[pid=1473/tid=1482] ppid=1444 vsize=311736 CPUtime=0 cores=0,2,4,6
/proc/1473/task/1482/stat : 1482 (python) S 1444 1444 1406 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869253068 319217664 7735 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604451364302976 0 0 -1 6 0 0 0
[pid=1483] ppid=1444 vsize=321992 CPUtime=0.17 cores=0,2,4,6
/proc/1483/stat : 1483 (python) S 1444 1444 1406 0 -1 4202560 1139 0 0 0 8 9 0 0 17 0 2 0 869253070 329719808 7739 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0
/proc/1483/statm: 80498 7739 396 364 0 15376 0
[pid=1485] ppid=1483 vsize=8548464 CPUtime=50.6 cores=0,2,4,6
/proc/1485/stat : 1485 (java) T 1483 1485 1485 0 -1 4202496 437974 0 114 0 5006 54 0 0 18 0 19 0 869253071 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 8
/proc/1485/statm: 2137116 402551 2250 9 0 2127857 0
[pid=1485/tid=1486] ppid=1483 vsize=8548464 CPUtime=47.84 cores=0,2,4,6
/proc/1485/task/1486/stat : 1486 (java) T 1483 1485 1485 0 -1 4202560 399439 0 55 0 4736 48 0 0 25 0 19 0 869253081 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 46912505885470 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 10
[pid=1485/tid=1487] ppid=1483 vsize=8548464 CPUtime=0.06 cores=0,2,4,6
/proc/1485/task/1487/stat : 1487 (java) T 1483 1485 1485 0 -1 4202560 4138 0 0 0 6 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1488] ppid=1483 vsize=8548464 CPUtime=0.05 cores=0,2,4,6
/proc/1485/task/1488/stat : 1488 (java) T 1483 1485 1485 0 -1 4202560 3082 0 0 0 5 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=1485/tid=1489] ppid=1483 vsize=8548464 CPUtime=0.06 cores=0,2,4,6
/proc/1485/task/1489/stat : 1489 (java) T 1483 1485 1485 0 -1 4202560 3966 0 0 0 6 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=1485/tid=1490] ppid=1483 vsize=8548464 CPUtime=0.02 cores=0,2,4,6
/proc/1485/task/1490/stat : 1490 (java) T 1483 1485 1485 0 -1 4202560 1597 0 0 0 2 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=1485/tid=1491] ppid=1483 vsize=8548464 CPUtime=0.04 cores=0,2,4,6
/proc/1485/task/1491/stat : 1491 (java) T 1483 1485 1485 0 -1 4202560 2377 0 0 0 4 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=1485/tid=1492] ppid=1483 vsize=8548464 CPUtime=0.02 cores=0,2,4,6
/proc/1485/task/1492/stat : 1492 (java) T 1483 1485 1485 0 -1 4202560 1199 0 0 0 2 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=1485/tid=1493] ppid=1483 vsize=8548464 CPUtime=0.06 cores=0,2,4,6
/proc/1485/task/1493/stat : 1493 (java) T 1483 1485 1485 0 -1 4202560 3204 0 0 0 6 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1494] ppid=1483 vsize=8548464 CPUtime=0.05 cores=0,2,4,6
/proc/1485/task/1494/stat : 1494 (java) T 1483 1485 1485 0 -1 4202560 2698 0 0 0 5 0 0 0 15 0 19 0 869253083 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1495] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1495/stat : 1495 (java) T 1483 1485 1485 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 19 0 869253086 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650752 0 0 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=1485/tid=1496] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1496/stat : 1496 (java) T 1483 1485 1485 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869253088 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=1485/tid=1497] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1497/stat : 1497 (java) T 1483 1485 1485 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869253088 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 8
[pid=1485/tid=1498] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1498/stat : 1498 (java) T 1483 1485 1485 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869253093 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528657841 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1499] ppid=1483 vsize=8548464 CPUtime=1.05 cores=0,2,4,6
/proc/1485/task/1499/stat : 1499 (java) T 1483 1485 1485 0 -1 4202560 9442 0 0 0 104 1 0 0 15 0 19 0 869253093 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1500] ppid=1483 vsize=8548464 CPUtime=1.23 cores=0,2,4,6
/proc/1485/task/1500/stat : 1500 (java) T 1483 1485 1485 0 -1 4202560 4747 0 2 0 123 0 0 0 15 0 19 0 869253093 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=1485/tid=1501] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1501/stat : 1501 (java) T 1483 1485 1485 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869253093 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=1485/tid=1502] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1502/stat : 1502 (java) T 1483 1485 1485 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869253093 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=1485/tid=1503] ppid=1483 vsize=8548464 CPUtime=0 cores=0,2,4,6
/proc/1485/task/1503/stat : 1503 (java) T 1483 1485 1485 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869253154 8753627136 402551 33554432000 1073741824 1073778376 140734134533648 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=1483/tid=1506] ppid=1444 vsize=321992 CPUtime=0 cores=0,2,4,6
/proc/1483/task/1506/stat : 1506 (python) S 1444 1444 1406 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869257903 329719808 7739 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453635614784 0 0 -1 2 0 0 0
[pid=1507] ppid=1444 vsize=332248 CPUtime=0.55 cores=0,2,4,6
/proc/1507/stat : 1507 (python) S 1444 1444 1406 0 -1 4202560 1183 0 0 0 26 29 0 0 16 0 2 0 869257906 340221952 7743 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/1507/statm: 83062 7743 396 364 0 17937 0
[pid=1509] ppid=1507 vsize=123092 CPUtime=141.11 cores=0,2,4,6
/proc/1509/stat : 1509 (bsolo_pb10) T 1507 1509 1509 0 -1 4202496 29545 0 0 0 14098 13 0 0 25 0 1 0 869257906 126046208 28303 33554432000 134512640 137138936 4291116064 18446744073709551615 134542787 0 0 16781312 16384 18446744071562691360 0 0 17 6 0 0 0
/proc/1509/statm: 30773 28303 192 642 0 30129 0
[pid=1507/tid=1521] ppid=1444 vsize=332248 CPUtime=0 cores=0,2,4,6
/proc/1507/task/1521/stat : 1521 (python) S 1444 1444 1406 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869272038 340221952 7743 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554946 18446604444194627968 0 0 -1 0 0 0 0
[pid=1524] ppid=1444 vsize=342504 CPUtime=0 cores=0,2,4,6
/proc/1524/stat : 1524 (python) S 1444 1444 1406 0 -1 4202560 842 0 0 0 0 0 0 0 15 0 1 0 869276624 350724096 7698 33554432000 4194304 5683644 140735829615760 18446744073709551615 246516854342 0 0 16781312 33554946 2459561490760335360 0 0 17 6 0 0 0
/proc/1524/statm: 85626 7698 348 364 0 20498 0
[pid=1526] ppid=1524 vsize=8539792 CPUtime=1.74 cores=0,2,4,6
/proc/1526/stat : 1526 (java) S 1524 1526 1526 0 -1 4202496 94587 0 1 0 162 12 0 0 20 0 19 0 869276625 8744747008 90589 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/1526/statm: 2134948 90589 2236 9 0 2125689 0
[pid=1526/tid=1527] ppid=1524 vsize=8539792 CPUtime=0.86 cores=0,2,4,6
/proc/1526/task/1527/stat : 1527 (java) R 1524 1526 1526 0 -1 4202560 82202 0 1 0 76 10 0 0 19 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 46912505878162 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=1526/tid=1528] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1528/stat : 1528 (java) S 1524 1526 1526 0 -1 4202560 720 0 0 0 0 0 0 0 17 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 0 0 0 0
[pid=1526/tid=1529] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1529/stat : 1529 (java) S 1524 1526 1526 0 -1 4202560 633 0 0 0 0 0 0 0 18 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1530] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1530/stat : 1530 (java) S 1524 1526 1526 0 -1 4202560 676 0 0 0 0 0 0 0 19 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 0 0 0 0
[pid=1526/tid=1531] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1531/stat : 1531 (java) S 1524 1526 1526 0 -1 4202560 426 0 0 0 0 0 0 0 20 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 0 0 0 0
[pid=1526/tid=1532] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1532/stat : 1532 (java) S 1524 1526 1526 0 -1 4202560 326 0 0 0 0 0 0 0 18 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 2 0 0 0
[pid=1526/tid=1533] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1533/stat : 1533 (java) S 1524 1526 1526 0 -1 4202560 88 0 0 0 0 0 0 0 20 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1534] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1534/stat : 1534 (java) S 1524 1526 1526 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1535] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1535/stat : 1535 (java) S 1524 1526 1526 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869276626 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1536] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1536/stat : 1536 (java) S 1524 1526 1526 0 -1 4202560 199 0 0 0 0 0 0 0 16 0 19 0 869276627 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650752 0 0 0 16800975 18446604449132069952 0 0 -1 2 0 0 0
[pid=1526/tid=1537] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1537/stat : 1537 (java) S 1524 1526 1526 0 -1 4202560 17 0 0 0 0 0 0 0 23 0 19 0 869276628 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1538] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1538/stat : 1538 (java) S 1524 1526 1526 0 -1 4202560 9 0 0 0 0 0 0 0 23 0 19 0 869276628 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 6 0 0 0
[pid=1526/tid=1539] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1539/stat : 1539 (java) S 1524 1526 1526 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869276630 8744747008 90649 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528657841 0 4 0 16800975 18446604449132069952 0 0 -1 2 0 0 0
[pid=1526/tid=1540] ppid=1524 vsize=8539792 CPUtime=0.43 cores=0,2,4,6
/proc/1526/task/1540/stat : 1540 (java) R 1524 1526 1526 0 -1 4202560 2982 0 0 0 43 0 0 0 16 0 19 0 869276630 8744747008 90650 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 47008022526159 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=1526/tid=1541] ppid=1524 vsize=8539792 CPUtime=0.43 cores=0,2,4,6
/proc/1526/task/1541/stat : 1541 (java) R 1524 1526 1526 0 -1 4202560 5000 0 0 0 43 0 0 0 16 0 19 0 869276630 8744747008 90650 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 47008020616566 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=1526/tid=1542] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1542/stat : 1542 (java) S 1524 1526 1526 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869276630 8744747008 90650 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650137 0 4 0 16800975 18446604449132069952 0 0 -1 2 0 0 0
[pid=1526/tid=1543] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1543/stat : 1543 (java) R 1524 1526 1526 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 869276630 8744747008 90650 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650752 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=1526/tid=1544] ppid=1524 vsize=8539792 CPUtime=0 cores=0,2,4,6
/proc/1526/task/1544/stat : 1544 (java) S 1524 1526 1526 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869276701 8744747008 90650 33554432000 1073741824 1073778376 140734498567216 18446744073709551615 246528650752 0 4 0 16800975 18446604449132069952 0 0 -1 0 0 0 0
[pid=1444/tid=1459] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1459/stat : 1459 (python) S 1440 1444 1406 0 -1 4202560 26 922 0 9 0 0 0 0 18 0 7 0 869238161 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1465] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1465/stat : 1465 (python) S 1440 1444 1406 0 -1 4202560 32 922 0 9 0 0 0 0 18 0 7 0 869243164 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 2 0 0 0
[pid=1444/tid=1474] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1474/stat : 1474 (python) S 1440 1444 1406 0 -1 4202560 33 922 0 9 0 0 0 0 20 0 7 0 869248031 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1484] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1484/stat : 1484 (python) S 1440 1444 1406 0 -1 4202560 31 922 0 9 0 0 0 0 20 0 7 0 869253071 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1508] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1508/stat : 1508 (python) S 1440 1444 1406 0 -1 4202560 29 922 0 9 0 0 0 0 18 0 7 0 869257906 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
[pid=1444/tid=1525] ppid=1440 vsize=352748 CPUtime=0 cores=0,2,4,6
/proc/1444/task/1525/stat : 1525 (python) S 1440 1444 1406 0 -1 4202560 32 922 0 9 0 0 0 0 20 0 7 0 869276625 361213952 9235 33554432000 4194304 5683644 140735829615760 18446744073709551615 246528657841 0 0 16781312 33554434 18446604444194629760 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 391.06
Current children cumulated vsize (KiB) 20072156

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1444 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=181820
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=239963
# CPU time returned by wait4() is 1.42178
# while last known CPU time is 391.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 411.491
CPU time (s): 391.06
CPU user time (s): 387.92
CPU system time (s): 3.14
CPU usage (%): 95.0349
Max. virtual memory (cumulated for all children) (KiB): 20072720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.18182
system time used= 0.239963
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18323
page faults= 121
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17866
involuntary context switches= 17

runsolver used 2.72358 second user time and 5.67814 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-09 01:39:17
IDJOB=3481846
IDBENCH=1875
IDSOLVER=1970
FILE ID=node134/3481846-1307576357
RUNJOBID= node134-1307576356-1424
PBS_JOBID= 13547665
Free space on /tmp= 74068 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-mzzv11.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481846-1307576357/watcher-3481846-1307576357 -o /tmp/evaluation-result-3481846-1307576357/solver-3481846-1307576357 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481846-1307576357.opb -seed 611056974 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a74bcf40291587dc368e3a23fd278be9
RANDOM SEED=611056974

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26947988 kB
Buffers:        141208 kB
Cached:         425132 kB
SwapCached:      10388 kB
Active:        5556572 kB
Inactive:       149304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26947988 kB
SwapTotal:    67111528 kB
SwapFree:     43359760 kB
Dirty:          206764 kB
Writeback:           0 kB
AnonPages:     5137104 kB
Mapped:          20640 kB
Slab:           140688 kB
PageTables:      89128 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 110746080 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73868 MiB
End job on node134 at 2011-06-09 01:46:27