Trace number 3481747

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 147.58 156.165

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
vtxcov/normalized-vtxcov_v2000_e4000_0.opb.PB06.opb
MD5SUMeb191f4787a2203be4bff8f6c7c8f66d
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1044
Best CPU time to get the best result obtained on this benchmark1797.1
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1037
Optimality of the best value was proved NO
Number of variables1961
Total number of constraints4000
Number of constraints which are clauses4000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1961
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1961
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1961
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.58/10.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.58/10.50	c INFO: solving HOME/instance-3481747-1307576440.opb
0.58/10.53	c INFO: parsing took 0.02 s
0.58/10.56	c INFO: features took 0.03 CPU seconds
0.67/10.60	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.49)
51.68/61.54	c INFO: running sat4j-pb-v20101225@0 for 45 with 1749 remaining (b = 0.35)
101.36/110.09	c INFO: running scip-2.0.1-clp@0 for 45 with 1700 remaining (b = 0.05)
147.46/156.08	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1654 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481747-1307576440/watcher-3481747-1307576440 -o /tmp/evaluation-result-3481747-1307576440/solver-3481747-1307576440 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481747-1307576440.opb -seed 1919133569 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 5/326 16114
/proc/meminfo: memFree=28497876/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/16112/stat : 16112 (runsolver) D 16110 16112 16077 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 1 0 947875058 12079104 53 33554432000 4194304 5432328 140734141112384 18446744073709551615 5055479 0 0 4096 24578 18446744071562234166 0 0 17 3 0 0 0
/proc/16112/statm: 2949 53 34 303 0 2643 0

[startup+0.01978 s]
/proc/loadavg: 0.00 0.00 0.00 5/326 16114
/proc/meminfo: memFree=28497876/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=1964 CPUtime=0 cores=1,3,5,7
/proc/16112/stat : 16112 (python) D 16110 16112 16077 0 -1 4194304 76 0 1 0 0 0 0 0 17 0 1 0 947875058 2011136 29 33554432000 4194304 5683644 140736314869024 18446744073709551615 260015473680 0 0 4096 0 18446744071562234166 0 0 17 3 0 0 0
/proc/16112/statm: 491 29 21 364 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1964

[startup+0.100758 s]
/proc/loadavg: 0.00 0.00 0.00 5/326 16114
/proc/meminfo: memFree=28497876/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/16112/stat : 16112 (python) R 16110 16112 16077 0 -1 4202496 644 0 6 0 0 0 0 0 17 0 1 0 947875058 15441920 545 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 2
/proc/16112/statm: 3770 545 312 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.300773 s]
/proc/loadavg: 0.00 0.00 0.00 5/326 16114
/proc/meminfo: memFree=28497876/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=15384 CPUtime=0 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 806 0 6 0 0 0 0 0 16 0 1 0 947875058 15753216 697 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020391860 0 2147483391 16781312 2 18446744071699945619 0 0 17 7 0 0 5
/proc/16112/statm: 3846 697 334 364 0 333 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15384

[startup+0.700689 s]
/proc/loadavg: 0.00 0.00 0.00 5/326 16114
/proc/meminfo: memFree=28497876/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=16540 CPUtime=0.03 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 1180 0 6 0 2 1 0 0 16 0 1 0 947875058 16936960 1047 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020391860 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 7
/proc/16112/statm: 4135 1047 417 364 0 622 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 16540

[startup+1.50054 s]
/proc/loadavg: 0.00 0.00 0.00 3/328 16116
/proc/meminfo: memFree=28484988/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=50304 CPUtime=0.1 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 1994 0 17 0 6 4 0 0 15 0 1 0 947875058 51511296 1770 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 12
/proc/16112/statm: 12576 1770 480 364 0 1276 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 50304

[startup+3.10021 s]
/proc/loadavg: 0.00 0.00 0.00 2/328 16116
/proc/meminfo: memFree=28476592/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=85624 CPUtime=0.12 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 2645 0 21 0 7 5 0 0 16 0 1 0 947875058 87678976 2383 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020391860 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 18
/proc/16112/statm: 21406 2383 715 364 0 1623 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 85624
heavy processes:

[startup+6.30067 s]
/proc/loadavg: 0.16 0.03 0.01 2/328 16124
/proc/meminfo: memFree=28474928/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=106644 CPUtime=0.18 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 4256 919 33 9 11 7 0 0 15 0 1 0 947875058 109203456 2813 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 40
/proc/16112/statm: 26661 2813 871 364 0 1909 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 106644
heavy processes:

[startup+12.7005 s]
/proc/loadavg: 0.47 0.10 0.03 3/334 16130
/proc/meminfo: memFree=28342488/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=293808 CPUtime=0.67 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 9687 919 113 9 43 24 0 0 18 0 2 0 947875058 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 146
/proc/16112/statm: 73452 7307 1870 364 0 8339 0
[pid=16126] ppid=16112 vsize=283564 CPUtime=0 cores=1,3,5,7
/proc/16126/stat : 16126 (python) S 16112 16112 16077 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 947876118 290369536 5786 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416015 0 0 16781312 33554946 3588620805610668032 0 0 17 7 0 0 0
/proc/16126/statm: 70891 5786 352 364 0 5778 0
[pid=16129] ppid=16126 vsize=59548 CPUtime=2.07 cores=1,3,5,7
/proc/16129/stat : 16129 (scip-2.0.1.linu) R 16126 16129 16129 0 -1 4202496 13363 0 0 0 200 7 0 0 19 0 1 0 947876119 60977152 12612 33554432000 4194304 13684479 140733649764128 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/16129/statm: 14887 12612 768 2317 0 12565 0
[pid=16112/tid=16128] ppid=16110 vsize=293808 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16128/stat : 16128 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 18 0 2 0 947876119 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 636920
heavy processes:

[startup+25.5012 s]
/proc/loadavg: 0.89 0.21 0.07 3/334 16130
/proc/meminfo: memFree=28181412/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=293808 CPUtime=0.67 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 9687 919 113 9 43 24 0 0 18 0 2 0 947875058 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 146
/proc/16112/statm: 73452 7307 1870 364 0 8339 0
[pid=16126] ppid=16112 vsize=283564 CPUtime=0.03 cores=1,3,5,7
/proc/16126/stat : 16126 (python) S 16112 16112 16077 0 -1 4202560 924 0 0 0 1 2 0 0 15 0 1 0 947876118 290369536 5812 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416015 0 0 16781312 33554946 1779148416631177216 0 0 17 7 0 0 0
/proc/16126/statm: 70891 5812 376 364 0 5778 0
[pid=16129] ppid=16126 vsize=136492 CPUtime=14.88 cores=1,3,5,7
/proc/16129/stat : 16129 (scip-2.0.1.linu) R 16126 16129 16129 0 -1 4202496 33335 0 0 0 1460 28 0 0 25 0 1 0 947876119 139767808 31719 33554432000 4194304 13684479 140733649764128 18446744073709551615 7420589 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/16129/statm: 34123 31719 791 2317 0 31801 0
[pid=16112/tid=16128] ppid=16110 vsize=293808 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16128/stat : 16128 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 18 0 2 0 947876119 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 15.58
Current children cumulated vsize (KiB) 713864
heavy processes:

[startup+51.1005 s]
/proc/loadavg: 1.27 0.35 0.12 3/334 16131
/proc/meminfo: memFree=28179316/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=293808 CPUtime=0.67 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 9687 919 113 9 43 24 0 0 18 0 2 0 947875058 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 146
/proc/16112/statm: 73452 7307 1870 364 0 8339 0
[pid=16126] ppid=16112 vsize=283564 CPUtime=0.09 cores=1,3,5,7
/proc/16126/stat : 16126 (python) S 16112 16112 16077 0 -1 4202560 935 0 0 0 4 5 0 0 15 0 1 0 947876118 290369536 5812 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416015 0 0 16781312 33554946 5623753486446373613 0 0 17 7 0 0 0
/proc/16126/statm: 70891 5812 376 364 0 5778 0
[pid=16129] ppid=16126 vsize=137336 CPUtime=40.48 cores=1,3,5,7
/proc/16129/stat : 16129 (scip-2.0.1.linu) R 16126 16129 16129 0 -1 4202496 33391 0 0 0 3969 79 0 0 25 0 1 0 947876119 140632064 31775 33554432000 4194304 13684479 140733649764128 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/16129/statm: 34334 31775 794 2317 0 32012 0
[pid=16112/tid=16128] ppid=16110 vsize=293808 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16128/stat : 16128 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 18 0 2 0 947876119 300859392 7307 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 41.24
Current children cumulated vsize (KiB) 714708

[startup+102.314 s]
/proc/loadavg: 1.68 0.60 0.21 3/378 16177
/proc/meminfo: memFree=27780948/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=304568 CPUtime=0.7 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 10540 919 113 9 46 24 0 0 20 0 3 0 947875058 311877632 7440 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 146
/proc/16112/statm: 76142 7440 1873 364 0 11026 0
[pid=16126] ppid=16112 vsize=293808 CPUtime=0.14 cores=1,3,5,7
/proc/16126/stat : 16126 (python) S 16112 16112 16077 0 -1 4202560 1101 0 0 0 6 8 0 0 17 0 2 0 947876118 300859392 5848 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/16126/statm: 73452 5848 407 364 0 8339 0
[pid=16129] ppid=16126 vsize=137336 CPUtime=50.89 cores=1,3,5,7
/proc/16129/stat : 16129 (scip-2.0.1.linu) T 16126 16129 16129 0 -1 4202496 33393 0 0 0 4990 99 0 0 25 0 1 0 947876119 140632064 31777 33554432000 4194304 13684479 140733649764128 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/16129/statm: 34334 31777 794 2317 0 32012 0
[pid=16126/tid=16148] ppid=16112 vsize=293808 CPUtime=0 cores=1,3,5,7
/proc/16126/task/16148/stat : 16148 (python) S 16112 16112 16077 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 947881209 300859392 5848 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604459998462912 0 0 -1 5 0 0 0
[pid=16149] ppid=16112 vsize=294324 CPUtime=0.12 cores=1,3,5,7
/proc/16149/stat : 16149 (python) S 16112 16112 16077 0 -1 4202560 1030 0 0 0 5 7 0 0 15 0 1 0 947881212 301387776 5942 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416070 0 0 16781312 33554946 4294934791 0 0 17 1 0 0 0
/proc/16149/statm: 73581 5942 379 364 0 8465 0
[pid=16151] ppid=16149 vsize=8538024 CPUtime=41.75 cores=1,3,5,7
/proc/16151/stat : 16151 (java) S 16149 16151 16151 0 -1 4202496 57170 0 3 0 4167 8 0 0 17 0 19 0 947881212 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16151/statm: 2134506 49078 2255 9 0 2125247 0
[pid=16151/tid=16152] ppid=16149 vsize=8538024 CPUtime=40.31 cores=1,3,5,7
/proc/16151/task/16152/stat : 16152 (java) R 16149 16151 16151 0 -1 4202560 14944 0 1 0 4029 2 0 0 25 0 19 0 947881214 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 46912505725520 0 4 0 16800975 0 0 0 -1 5 0 0 1
[pid=16151/tid=16153] ppid=16149 vsize=8538024 CPUtime=0.02 cores=1,3,5,7
/proc/16151/task/16153/stat : 16153 (java) S 16149 16151 16151 0 -1 4202560 2832 0 0 0 2 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0
[pid=16151/tid=16154] ppid=16149 vsize=8538024 CPUtime=0.02 cores=1,3,5,7
/proc/16151/task/16154/stat : 16154 (java) S 16149 16151 16151 0 -1 4202560 2308 0 0 0 2 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 3 0 0 0
[pid=16151/tid=16155] ppid=16149 vsize=8538024 CPUtime=0.02 cores=1,3,5,7
/proc/16151/task/16155/stat : 16155 (java) S 16149 16151 16151 0 -1 4202560 4272 0 0 0 2 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 3 0 0 0
[pid=16151/tid=16156] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16156/stat : 16156 (java) S 16149 16151 16151 0 -1 4202560 2753 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 1 0 0 0
[pid=16151/tid=16157] ppid=16149 vsize=8538024 CPUtime=0.03 cores=1,3,5,7
/proc/16151/task/16157/stat : 16157 (java) S 16149 16151 16151 0 -1 4202560 6125 0 0 0 3 0 0 0 16 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0
[pid=16151/tid=16158] ppid=16149 vsize=8538024 CPUtime=0.03 cores=1,3,5,7
/proc/16151/task/16158/stat : 16158 (java) S 16149 16151 16151 0 -1 4202560 2267 0 0 0 3 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 3 0 0 0
[pid=16151/tid=16159] ppid=16149 vsize=8538024 CPUtime=0.02 cores=1,3,5,7
/proc/16151/task/16159/stat : 16159 (java) S 16149 16151 16151 0 -1 4202560 1143 0 0 0 2 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0
[pid=16151/tid=16160] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16160/stat : 16160 (java) S 16149 16151 16151 0 -1 4202560 6906 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0
[pid=16151/tid=16166] ppid=16149 vsize=8538024 CPUtime=0.24 cores=1,3,5,7
/proc/16151/task/16166/stat : 16166 (java) S 16149 16151 16151 0 -1 4202560 7884 0 0 0 24 0 0 0 16 0 19 0 947881216 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032212480 0 0 0 16800975 18446604459998463808 0 0 -1 5 0 0 0
[pid=16151/tid=16167] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16167/stat : 16167 (java) S 16149 16151 16151 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 947881216 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 5 0 0 0
[pid=16151/tid=16168] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16168/stat : 16168 (java) S 16149 16151 16151 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 947881216 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0
[pid=16151/tid=16169] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16169/stat : 16169 (java) S 16149 16151 16151 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 947881218 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032219569 0 4 0 16800975 18446604459998463808 0 0 -1 5 0 0 0
[pid=16151/tid=16170] ppid=16149 vsize=8538024 CPUtime=0.44 cores=1,3,5,7
/proc/16151/task/16170/stat : 16170 (java) S 16149 16151 16151 0 -1 4202560 1819 0 0 0 44 0 0 0 15 0 19 0 947881218 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 1 0 0 0
[pid=16151/tid=16171] ppid=16149 vsize=8538024 CPUtime=0.42 cores=1,3,5,7
/proc/16151/task/16171/stat : 16171 (java) S 16149 16151 16151 0 -1 4202560 2523 0 2 0 42 0 0 0 15 0 19 0 947881218 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 5 0 0 0
[pid=16151/tid=16172] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16172/stat : 16172 (java) S 16149 16151 16151 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947881218 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446604459998463808 0 0 -1 5 0 0 0
[pid=16151/tid=16173] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16173/stat : 16173 (java) S 16149 16151 16151 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 947881218 8742936576 49078 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032212480 0 4 0 16800975 18446604459998463808 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/16185/stat : 16185 (scip-2.0.1.linu) T 16183 16185 16185 0 -1 4202496 44169 0 0 0 4575 21 0 0 25 0 1 0 947886067 138113024 31122 33554432000 4194304 15243407 140736542179920 18446744073709551615 8112900 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/16185/statm: 33719 31122 906 2698 0 31014 0
[pid=16183/tid=16187] ppid=16112 vsize=304348 CPUtime=0 cores=1,3,5,7
/proc/16183/task/16187/stat : 16187 (python) S 16112 16112 16077 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 947890664 311652352 5897 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604458945696192 0 0 -1 7 0 0 0
[pid=16188] ppid=16112 vsize=315044 CPUtime=0 cores=1,3,5,7
/proc/16188/stat : 16188 (python) S 16112 16112 16077 0 -1 4202560 749 0 0 0 0 0 0 0 18 0 1 0 947890666 322605056 5953 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416070 0 0 16781312 33554946 4523369847165255940 0 0 17 7 0 0 0
/proc/16188/statm: 78761 5953 346 364 0 13639 0
[pid=16190] ppid=16188 vsize=8460068 CPUtime=0.02 cores=1,3,5,7
/proc/16190/stat : 16190 (java) S 16188 16190 16190 0 -1 4202496 3549 0 1 0 1 1 0 0 17 0 13 0 947890667 8663109632 3007 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032198629 0 0 0 16784584 18446744073709551615 0 0 17 1 0 0 0
/proc/16190/statm: 2115017 3008 1669 9 0 2105765 0
[pid=16190/tid=16191] ppid=16188 vsize=8460068 CPUtime=0.01 cores=1,3,5,7
/proc/16190/task/16191/stat : 16191 (java) R 16188 16190 16190 0 -1 4202560 2197 0 1 0 1 0 0 0 21 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 47190027418451 0 4 0 16784584 0 0 0 -1 1 0 0 0
[pid=16190/tid=16192] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16192/stat : 16192 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 5 0 0 0
[pid=16190/tid=16193] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16193/stat : 16193 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16194] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16194/stat : 16194 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3044 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16195] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16195/stat : 16195 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3045 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16196] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16196/stat : 16196 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16197] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16197/stat : 16197 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16198] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16198/stat : 16198 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16199] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16199/stat : 16199 (java) S 16188 16190 16190 0 -1 4202560 2 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16200] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16200/stat : 16200 (java) S 16188 16190 16190 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 13 0 947890669 8663109632 3047 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032212480 0 0 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16201] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16201/stat : 16201 (java) S 16188 16190 16190 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 13 0 947890670 8663109632 3047 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16202] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16202/stat : 16202 (java) S 16188 16190 16190 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 13 0 947890670 8663109632 3048 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16112/tid=16128] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16128/stat : 16128 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 18 0 5 0 947876119 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
[pid=16112/tid=16150] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16150/stat : 16150 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 20 0 5 0 947881212 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
[pid=16112/tid=16184] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16184/stat : 16184 (python) S 16110 16112 16077 0 -1 4202560 112 919 0 9 0 0 0 0 20 0 5 0 947886067 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 5 0 0 0
[pid=16112/tid=16189] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16189/stat : 16189 (python) S 16110 16112 16077 0 -1 4202560 34 919 0 9 0 0 0 0 20 0 5 0 947890666 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 147.58
Current children cumulated vsize (KiB) 18803116

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+156.101 s]
/proc/loadavg: 1.87 0.83 0.31 3/399 16199
/proc/meminfo: memFree=27512708/32951124 swapFree=67056304/67111528
[pid=16112] ppid=16110 vsize=325288 CPUtime=0.75 cores=1,3,5,7
/proc/16112/stat : 16112 (python) S 16110 16112 16077 0 -1 4202496 12365 919 113 9 50 25 0 0 19 0 5 0 947875058 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 146
/proc/16112/statm: 81322 7488 1877 364 0 16200 0
[pid=16126] ppid=16112 vsize=293808 CPUtime=0.14 cores=1,3,5,7
/proc/16126/stat : 16126 (python) S 16112 16112 16077 0 -1 4202560 1101 0 0 0 6 8 0 0 17 0 2 0 947876118 300859392 5848 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/16126/statm: 73452 5848 407 364 0 8339 0
[pid=16129] ppid=16126 vsize=137336 CPUtime=50.89 cores=1,3,5,7
/proc/16129/stat : 16129 (scip-2.0.1.linu) T 16126 16129 16129 0 -1 4202496 33393 0 0 0 4990 99 0 0 25 0 1 0 947876119 140632064 31777 33554432000 4194304 13684479 140733649764128 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/16129/statm: 34334 31777 794 2317 0 32012 0
[pid=16126/tid=16148] ppid=16112 vsize=293808 CPUtime=0 cores=1,3,5,7
/proc/16126/task/16148/stat : 16148 (python) S 16112 16112 16077 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 947881209 300859392 5848 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604459998462912 0 0 -1 5 0 0 0
[pid=16149] ppid=16112 vsize=294324 CPUtime=0.14 cores=1,3,5,7
/proc/16149/stat : 16149 (python) S 16112 16112 16077 0 -1 4202560 1158 0 0 0 6 8 0 0 16 0 2 0 947881212 301387776 5967 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/16149/statm: 73581 5967 403 364 0 8465 0
[pid=16151] ppid=16149 vsize=8538024 CPUtime=49.55 cores=1,3,5,7
/proc/16151/stat : 16151 (java) T 16149 16151 16151 0 -1 4202496 58395 0 3 0 4946 9 0 0 15 0 19 0 947881212 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/16151/statm: 2134506 49863 2255 9 0 2125247 0
[pid=16151/tid=16152] ppid=16149 vsize=8538024 CPUtime=48 cores=1,3,5,7
/proc/16151/task/16152/stat : 16152 (java) T 16149 16151 16151 0 -1 4202560 14946 0 1 0 4798 2 0 0 25 0 19 0 947881214 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 46912505746892 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 1
[pid=16151/tid=16153] ppid=16149 vsize=8538024 CPUtime=0.03 cores=1,3,5,7
/proc/16151/task/16153/stat : 16153 (java) T 16149 16151 16151 0 -1 4202560 3250 0 0 0 3 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16154] ppid=16149 vsize=8538024 CPUtime=0.03 cores=1,3,5,7
/proc/16151/task/16154/stat : 16154 (java) T 16149 16151 16151 0 -1 4202560 2309 0 0 0 3 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=16151/tid=16155] ppid=16149 vsize=8538024 CPUtime=0.03 cores=1,3,5,7
/proc/16151/task/16155/stat : 16155 (java) T 16149 16151 16151 0 -1 4202560 4272 0 0 0 3 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16156] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16156/stat : 16156 (java) T 16149 16151 16151 0 -1 4202560 2753 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=16151/tid=16157] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16157/stat : 16157 (java) T 16149 16151 16151 0 -1 4202560 6485 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16158] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16158/stat : 16158 (java) T 16149 16151 16151 0 -1 4202560 2711 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=16151/tid=16159] ppid=16149 vsize=8538024 CPUtime=0.02 cores=1,3,5,7
/proc/16151/task/16159/stat : 16159 (java) T 16149 16151 16151 0 -1 4202560 1143 0 0 0 2 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=16151/tid=16160] ppid=16149 vsize=8538024 CPUtime=0.04 cores=1,3,5,7
/proc/16151/task/16160/stat : 16160 (java) T 16149 16151 16151 0 -1 4202560 6906 0 0 0 4 0 0 0 15 0 19 0 947881215 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16166] ppid=16149 vsize=8538024 CPUtime=0.28 cores=1,3,5,7
/proc/16151/task/16166/stat : 16166 (java) T 16149 16151 16151 0 -1 4202560 7884 0 0 0 28 0 0 0 15 0 19 0 947881216 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032212480 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=16151/tid=16167] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16167/stat : 16167 (java) T 16149 16151 16151 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 947881216 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=16151/tid=16168] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16168/stat : 16168 (java) T 16149 16151 16151 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 947881216 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16169] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16169/stat : 16169 (java) T 16149 16151 16151 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 947881218 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032219569 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=16151/tid=16170] ppid=16149 vsize=8538024 CPUtime=0.44 cores=1,3,5,7
/proc/16151/task/16170/stat : 16170 (java) T 16149 16151 16151 0 -1 4202560 1819 0 0 0 44 0 0 0 15 0 19 0 947881218 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=16151/tid=16171] ppid=16149 vsize=8538024 CPUtime=0.42 cores=1,3,5,7
/proc/16151/task/16171/stat : 16171 (java) T 16149 16151 16151 0 -1 4202560 2523 0 2 0 42 0 0 0 15 0 19 0 947881218 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=16151/tid=16172] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16172/stat : 16172 (java) T 16149 16151 16151 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 947881218 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=16151/tid=16173] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16173/stat : 16173 (java) T 16149 16151 16151 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 947881218 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032212480 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=16151/tid=16175] ppid=16149 vsize=8538024 CPUtime=0 cores=1,3,5,7
/proc/16151/task/16175/stat : 16175 (java) T 16149 16151 16151 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 947881249 8742936576 49863 33554432000 1073741824 1073778376 140737233908400 18446744073709551615 260032212480 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=16149/tid=16182] ppid=16112 vsize=294324 CPUtime=0 cores=1,3,5,7
/proc/16149/task/16182/stat : 16182 (python) S 16112 16112 16077 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 947886064 301387776 5967 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604466125517056 0 0 -1 1 0 0 0
[pid=16183] ppid=16112 vsize=304348 CPUtime=0.13 cores=1,3,5,7
/proc/16183/stat : 16183 (python) S 16112 16112 16077 0 -1 4202560 1184 0 0 0 6 7 0 0 16 0 2 0 947886067 311652352 5897 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16183/statm: 76087 5897 403 364 0 10968 0
[pid=16185] ppid=16183 vsize=134876 CPUtime=45.96 cores=1,3,5,7
/proc/16185/stat : 16185 (scip-2.0.1.linu) T 16183 16185 16185 0 -1 4202496 44169 0 0 0 4575 21 0 0 25 0 1 0 947886067 138113024 31122 33554432000 4194304 15243407 140736542179920 18446744073709551615 8112900 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/16185/statm: 33719 31122 906 2698 0 31014 0
[pid=16183/tid=16187] ppid=16112 vsize=304348 CPUtime=0 cores=1,3,5,7
/proc/16183/task/16187/stat : 16187 (python) S 16112 16112 16077 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 947890664 311652352 5897 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604458945696192 0 0 -1 7 0 0 0
[pid=16188] ppid=16112 vsize=315044 CPUtime=0 cores=1,3,5,7
/proc/16188/stat : 16188 (python) S 16112 16112 16077 0 -1 4202560 749 0 0 0 0 0 0 0 18 0 1 0 947890666 322605056 5953 33554432000 4194304 5683644 140736314869024 18446744073709551615 260020416070 0 0 16781312 33554946 4523369847165255940 0 0 17 7 0 0 0
/proc/16188/statm: 78761 5953 346 364 0 13639 0
[pid=16190] ppid=16188 vsize=8460068 CPUtime=0.02 cores=1,3,5,7
/proc/16190/stat : 16190 (java) S 16188 16190 16190 0 -1 4202496 3549 0 1 0 1 1 0 0 17 0 13 0 947890667 8663109632 3007 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032198629 0 0 0 16784584 18446744073709551615 0 0 17 1 0 0 0
/proc/16190/statm: 2115017 3008 1669 9 0 2105765 0
[pid=16190/tid=16191] ppid=16188 vsize=8460068 CPUtime=0.01 cores=1,3,5,7
/proc/16190/task/16191/stat : 16191 (java) R 16188 16190 16190 0 -1 4202560 2197 0 1 0 1 0 0 0 21 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 47190027418451 0 4 0 16784584 0 0 0 -1 1 0 0 0
[pid=16190/tid=16192] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16192/stat : 16192 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 5 0 0 0
[pid=16190/tid=16193] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16193/stat : 16193 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3042 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16194] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16194/stat : 16194 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3044 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16195] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16195/stat : 16195 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3045 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16196] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16196/stat : 16196 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16197] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16197/stat : 16197 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16198] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16198/stat : 16198 (java) S 16188 16190 16190 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16199] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16199/stat : 16199 (java) S 16188 16190 16190 0 -1 4202560 2 0 0 0 0 0 0 0 19 0 13 0 947890668 8663109632 3046 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16200] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16200/stat : 16200 (java) S 16188 16190 16190 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 13 0 947890669 8663109632 3047 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032212480 0 0 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16201] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16201/stat : 16201 (java) S 16188 16190 16190 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 13 0 947890670 8663109632 3047 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16190/tid=16202] ppid=16188 vsize=8460068 CPUtime=0 cores=1,3,5,7
/proc/16190/task/16202/stat : 16202 (java) S 16188 16190 16190 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 13 0 947890670 8663109632 3048 33554432000 1073741824 1073778376 140733635827872 18446744073709551615 260032211865 0 4 0 16784584 18446604468119935808 0 0 -1 1 0 0 0
[pid=16112/tid=16128] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16128/stat : 16128 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 18 0 5 0 947876119 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
[pid=16112/tid=16150] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16150/stat : 16150 (python) S 16110 16112 16077 0 -1 4202560 30 919 0 9 0 0 0 0 20 0 5 0 947881212 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 7 0 0 0
[pid=16112/tid=16184] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16184/stat : 16184 (python) S 16110 16112 16077 0 -1 4202560 112 919 0 9 0 0 0 0 20 0 5 0 947886067 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 5 0 0 0
[pid=16112/tid=16189] ppid=16110 vsize=325288 CPUtime=0 cores=1,3,5,7
/proc/16112/task/16189/stat : 16189 (python) S 16110 16112 16077 0 -1 4202560 34 919 0 9 0 0 0 0 20 0 5 0 947890666 333094912 7488 33554432000 4194304 5683644 140736314869024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604471093442688 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 147.58
Current children cumulated vsize (KiB) 18803116

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16112 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=509922
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=261960
# CPU time returned by wait4() is 0.771882
# while last known CPU time is 147.58
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 156.165
CPU time (s): 147.58
CPU user time (s): 145.8
CPU system time (s): 1.78
CPU usage (%): 94.5026
Max. virtual memory (cumulated for all children) (KiB): 18803116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.509922
system time used= 0.26196
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13285
page faults= 122
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18877
involuntary context switches= 84

runsolver used 0.581911 second user time and 1.2958 second system time

The end

Launcher Data 

Begin job on node110 at 2011-06-09 01:40:40
IDJOB=3481747
IDBENCH=1984
IDSOLVER=1970
FILE ID=node110/3481747-1307576440
RUNJOBID= node110-1307576440-16096
PBS_JOBID= 13547695
Free space on /tmp= 74084 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/vtxcov/normalized-vtxcov_v2000_e4000_0.opb.PB06.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481747-1307576440/watcher-3481747-1307576440 -o /tmp/evaluation-result-3481747-1307576440/solver-3481747-1307576440 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481747-1307576440.opb -seed 1919133569 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eb191f4787a2203be4bff8f6c7c8f66d
RANDOM SEED=1919133569

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28500344 kB
Buffers:        160064 kB
Cached:         438308 kB
SwapCached:       8464 kB
Active:        4038704 kB
Inactive:       164436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28500344 kB
SwapTotal:    67111528 kB
SwapFree:     67056304 kB
Dirty:          203904 kB
Writeback:           0 kB
AnonPages:     3603152 kB
Mapped:          26780 kB
Slab:           155800 kB
PageTables:      27020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75584160 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73884 MiB
End job on node110 at 2011-06-09 01:43:23