Trace number 3481606

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 710.5 703.808

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_500_60_4.opb
MD5SUMd34b8195c337caa741dffbe26b4db95e
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-43
Best CPU time to get the best result obtained on this benchmark1797.18
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -44
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)74916
Sum of products size (including duplicates)149832
Number of different products37458
Sum of products size74916

Solver Data 

0.37/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/0.68	c INFO: solving HOME/instance-3481606-1307578509.opb
0.95/1.24	c INFO: wrote linearized instance to HOME/tmpRyiFZa.opb
1.46/1.78	c INFO: parsing took 0.54 s
2.67/2.99	c INFO: features took 1.20 CPU seconds
2.77/3.02	c INFO: running scip-2.0.1-spx@0 for 45 with 1797 remaining (b = 0.08)
51.84/51.92	c INFO: running wbo1.4a@0 for 45 with 1749 remaining (b = 0.02)
100.44/100.39	c INFO: running scip-2.0.1-clp@0 for 45 with 1700 remaining (b = 0.01)
149.82/149.44	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1652 remaining (b = 0.01)
198.49/195.34	c INFO: running scip-2.0.1-spx@48 for 45 with 1604 remaining (b = 0.01)
244.87/241.60	c INFO: running scip-2.0.1-spx@94 for 228 with 1558 remaining (b = 0.03)
475.21/470.70	c INFO: running scip-2.0.1-clp@48 for 45 with 1329 remaining (b = 0.01)
521.63/516.95	c INFO: running clasp-1.3.7@0 for 91 with 1283 remaining (b = 0.01)
618.41/613.22	c INFO: running scip-2.0.1-clp@94 for 91 with 1186 remaining (b = 0.01)
708.26/702.71	c INFO: running sat4j-pb-v20101225@0 for 91 with 1097 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481606-1307578509/watcher-3481606-1307578509 -o /tmp/evaluation-result-3481606-1307578509/solver-3481606-1307578509 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481606-1307578509.opb -seed 2076812952 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.27 2.16 1.87 3/724 23179
/proc/meminfo: memFree=20507132/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=16236 CPUtime=0 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 1000 0 0 0 0 0 0 0 22 0 1 0 850267310 16625664 872 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039653376 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/23179/statm: 4059 872 371 364 0 546 0

[startup+0.022953 s]
/proc/loadavg: 2.27 2.16 1.87 3/724 23179
/proc/meminfo: memFree=20507132/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=16240 CPUtime=0.01 cores=0,2,4,6
/proc/23179/stat : 23179 (python) R 23177 23179 21589 0 -1 4202496 1063 0 0 0 1 0 0 0 22 0 1 0 850267310 16629760 934 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039655168 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23179/statm: 4060 934 381 364 0 547 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16240

[startup+0.100908 s]
/proc/loadavg: 2.27 2.16 1.87 3/724 23179
/proc/meminfo: memFree=20507132/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=85616 CPUtime=0.06 cores=0,2,4,6
/proc/23179/stat : 23179 (python) R 23177 23179 21589 0 -1 4202496 2665 0 0 0 5 1 0 0 22 0 1 0 850267310 87670784 2381 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039651173 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23179/statm: 21404 2381 715 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85616

[startup+0.300914 s]
/proc/loadavg: 2.27 2.16 1.87 3/724 23179
/proc/meminfo: memFree=20507132/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=123740 CPUtime=0.19 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 5357 928 1 0 14 5 0 0 17 0 1 0 850267310 126709760 3744 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039651333 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/23179/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 123740

[startup+0.700788 s]
/proc/loadavg: 2.27 2.16 1.87 3/724 23179
/proc/meminfo: memFree=20507132/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=282404 CPUtime=0.43 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 9206 928 1 0 33 10 0 0 16 0 1 0 850267310 289181696 6937 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675407 0 0 16781312 2 3012085917876748288 0 0 17 4 0 0 0
/proc/23179/statm: 70601 6937 1777 364 0 5494 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 282404

[startup+1.50073 s]
/proc/loadavg: 2.27 2.16 1.87 3/726 23185
/proc/meminfo: memFree=20480440/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=297300 CPUtime=1.26 cores=0,2,4,6
/proc/23179/stat : 23179 (python) R 23177 23179 21589 0 -1 4202496 14731 1593 1 0 60 12 49 5 18 0 1 0 850267310 304435200 10597 33554432000 4194304 5683644 140735219817792 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23179/statm: 74325 10597 1782 364 0 9218 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 297300

[startup+3.10038 s]
/proc/loadavg: 2.33 2.17 1.87 3/725 23185
/proc/meminfo: memFree=20458252/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=315204 CPUtime=2.79 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 22128 1593 1 0 212 13 49 5 22 0 2 0 850267310 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 78801 12641 1871 364 0 13688 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 315204

[startup+6.30085 s]
/proc/loadavg: 2.30 2.17 1.87 5/728 23188
/proc/meminfo: memFree=20136704/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=315204 CPUtime=2.79 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 22128 1593 1 0 212 13 49 5 22 0 2 0 850267310 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 78801 12641 1871 364 0 13688 0
[pid=23186] ppid=23179 vsize=304960 CPUtime=0 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 725 0 0 0 0 0 0 0 15 0 1 0 850267612 312279040 11084 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675407 0 0 16781312 33554946 10198908132256612611 0 0 17 4 0 0 0
/proc/23186/statm: 76240 11084 318 364 0 11127 0
[pid=23188] ppid=23186 vsize=348904 CPUtime=3.29 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) R 23186 23188 23188 0 -1 4202496 84782 0 0 0 312 17 0 0 25 0 1 0 850267613 357277696 80437 33554432000 4194304 13684479 140734282252272 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23188/statm: 87226 80437 1123 2317 0 84904 0
[pid=23179/tid=23187] ppid=23177 vsize=315204 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 26 1593 0 0 0 0 49 5 22 0 2 0 850267613 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.08
Current children cumulated vsize (KiB) 969068

[startup+12.7007 s]
/proc/loadavg: 2.28 2.17 1.87 5/728 23188
/proc/meminfo: memFree=20116632/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=315204 CPUtime=2.79 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 22128 1593 1 0 212 13 49 5 22 0 2 0 850267310 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 78801 12641 1871 364 0 13688 0
[pid=23186] ppid=23179 vsize=304960 CPUtime=0.04 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 867 0 0 0 2 2 0 0 15 0 1 0 850267612 312279040 11108 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675407 0 0 16781312 33554946 72409437758827195 0 0 17 4 0 0 0
/proc/23186/statm: 76240 11108 342 364 0 11127 0
[pid=23188] ppid=23186 vsize=358560 CPUtime=9.66 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) R 23186 23188 23188 0 -1 4202496 89473 0 0 0 948 18 0 0 25 0 1 0 850267613 367165440 84528 33554432000 4194304 13684479 140734282252272 18446744073709551615 7020222 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23188/statm: 89640 84528 855 2317 0 87318 0
[pid=23179/tid=23187] ppid=23177 vsize=315204 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 26 1593 0 0 0 0 49 5 22 0 2 0 850267613 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.49
Current children cumulated vsize (KiB) 978724

[startup+25.5014 s]
/proc/loadavg: 2.23 2.16 1.87 4/728 23188
/proc/meminfo: memFree=20107740/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=315204 CPUtime=2.79 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 22128 1593 1 0 212 13 49 5 22 0 2 0 850267310 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 78801 12641 1871 364 0 13688 0
[pid=23186] ppid=23179 vsize=304960 CPUtime=0.09 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 872 0 0 0 5 4 0 0 15 0 1 0 850267612 312279040 11108 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675407 0 0 16781312 33554946 72409437758827195 0 0 17 4 0 0 0
/proc/23186/statm: 76240 11108 342 364 0 11127 0
[pid=23188] ppid=23186 vsize=358560 CPUtime=22.45 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) R 23186 23188 23188 0 -1 4202496 89475 0 0 0 2226 19 0 0 25 0 1 0 850267613 367165440 84529 33554432000 4194304 13684479 140734282252272 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23188/statm: 89640 84529 854 2317 0 87318 0
[pid=23179/tid=23187] ppid=23177 vsize=315204 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 26 1593 0 0 0 0 49 5 22 0 2 0 850267613 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.33
Current children cumulated vsize (KiB) 978724

[startup+51.1008 s]
/proc/loadavg: 2.15 2.14 1.88 4/728 23189
/proc/meminfo: memFree=20097304/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=315204 CPUtime=2.79 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 22128 1593 1 0 212 13 49 5 22 0 2 0 850267310 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 78801 12641 1871 364 0 13688 0
[pid=23186] ppid=23179 vsize=304960 CPUtime=0.21 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 884 0 0 0 11 10 0 0 15 0 1 0 850267612 312279040 11108 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675407 0 0 16781312 33554946 72409437758827195 0 0 17 4 0 0 0
/proc/23186/statm: 76240 11108 342 364 0 11127 0
[pid=23188] ppid=23186 vsize=367248 CPUtime=48.02 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) R 23186 23188 23188 0 -1 4202496 91989 0 0 0 4781 21 0 0 25 0 1 0 850267613 376061952 86997 33554432000 4194304 13684479 140734282252272 18446744073709551615 7354541 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23188/statm: 91812 86997 812 2317 0 89490 0
[pid=23179/tid=23187] ppid=23177 vsize=315204 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 26 1593 0 0 0 0 49 5 22 0 2 0 850267613 322768896 12641 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 987412

[startup+102.301 s]
/proc/loadavg: 2.06 2.12 1.88 5/736 23198
/proc/meminfo: memFree=19833896/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=335716 CPUtime=2.83 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 23858 1593 1 0 216 13 49 5 20 0 4 0 850267310 343773184 12654 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 83929 12654 1876 364 0 18810 0
[pid=23186] ppid=23179 vsize=315204 CPUtime=0.23 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 1088 0 0 0 12 11 0 0 16 0 2 0 850267612 322768896 11176 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/23186/statm: 78801 11176 405 364 0 13688 0
[pid=23188] ppid=23186 vsize=376124 CPUtime=48.82 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) T 23186 23188 23188 0 -1 4202496 94039 0 0 0 4861 21 0 0 25 0 1 0 850267613 385150976 89047 33554432000 4194304 13684479 140734282252272 18446744073709551615 7399875 0 0 16781312 2 18446744071562691360 0 0 17 6 0 0 0
/proc/23188/statm: 94031 89047 812 2317 0 91709 0
[pid=23186/tid=23190] ppid=23179 vsize=315204 CPUtime=0 cores=0,2,4,6
/proc/23186/task/23190/stat : 23190 (python) S 23179 23179 21589 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 850272500 322768896 11176 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604451014796352 0 0 -1 4 0 0 0
[pid=23191] ppid=23179 vsize=315216 CPUtime=0.27 cores=0,2,4,6
/proc/23191/stat : 23191 (python) S 23179 23179 21589 0 -1 4202560 1190 0 0 0 14 13 0 0 16 0 2 0 850272503 322781184 11167 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23191/statm: 78804 11167 396 364 0 13688 0
[pid=23193] ppid=23191 vsize=105944 CPUtime=48.41 cores=0,2,4,6
/proc/23193/stat : 23193 (wbo1.4a) T 23191 23193 23193 0 -1 4202496 29171 0 0 0 4826 15 0 0 25 0 1 0 850272503 108486656 25867 33554432000 134512640 135751879 4288432992 18446744073709551615 134518928 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/23193/statm: 26486 25867 146 303 0 26181 0
[pid=23191/tid=23195] ppid=23179 vsize=315216 CPUtime=0 cores=0,2,4,6
/proc/23191/task/23195/stat : 23195 (python) S 23179 23179 21589 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 850277347 322781184 11167 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604450022201216 0 0 -1 6 0 0 0
[pid=23196] ppid=23179 vsize=325472 CPUtime=0 cores=0,2,4,6
/proc/23196/stat : 23196 (python) S 23179 23179 21589 0 -1 4202560 875 0 0 0 0 0 0 0 15 0 1 0 850277350 333283328 11100 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675462 0 0 16781312 33554946 4334949975487119619 0 0 17 6 0 0 0
/proc/23196/statm: 81368 11100 326 364 0 16249 0
[pid=23198] ppid=23196 vsize=200796 CPUtime=1.89 cores=0,2,4,6
/proc/23198/stat : 23198 (scip-2.0.1.linu) R 23196 23198 23198 0 -1 4202496 49075 0 0 0 174 15 0 0 25 0 1 0 850277350 205615104 47475 33554432000 4194304 15243407 140736643270720 18446744073709551615 13229463 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/23198/statm: 50199 47488 793 2698 0 47494 0
[pid=23179/tid=23187] ppid=23177 vsize=335716 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 26 1593 0 0 0 0 49 5 22 0 4 0 850267613 343773184 12654 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
[pid=23179/tid=23192] ppid=23177 vsize=335716 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23192/stat : 23192 (python) S 23177 23179 21589 0 -1 4202560 27 1593 0 0 0 0 49 5 20 0 4 0 850272503 343773184 12654 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
[pid=23179/tid=23197] ppid=23177 vsize=335716 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23197/stat : 23197 (python) S 23177 23179 21589 0 -1 4202560 27 1593 0 0 0 0 49 5 20 0 4 0 850277350 343773184 12654 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 102.45
Current children cumulated vsize (KiB) 1974472

[startup+162.302 s]
/proc/loadavg: 2.02 2.09 1.89 5/758 23222
/proc/meminfo: memFree=18530064/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=345972 CPUtime=2.87 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 24767 1593 1 0 219 14 49 5 20 0 5 0 850267310 354275328 12660 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23179/statm: 86493 12660 1878 364 0 21371 0
[pid=23186] ppid=23179 vsize=315204 CPUtime=0.23 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 1088 0 0 0 12 11 0 0 16 0 2 0 850267612 322768896 11176 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/23186/statm: 78801 11176 405 364 0 13688 0
[pid=23188] ppid=23186 vsize=376124 CPUtime=48.82 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) T 23186 23188 23188 0 -1 4202496 94039 0 0 0 4861 21 0 0 25 0 1 0 850267613 385150976 89047 33554432000 4194304 13684479 140734282252272 18446744073709551615 7399875 0 0 16781312 2 18446744071562691360 0 0 17 6 0 0 0
/proc/23188/statm: 94031 89047 812 2317 0 91709 0
[pid=23186/tid=23190] ppid=23179 vsize=315204 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=23179/tid=23197] ppid=23177 vsize=356228 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23197/stat : 23197 (python) S 23177 23179 21589 0 -1 4202560 35 1593 0 0 0 0 49 5 18 0 6 0 850277350 364777472 12666 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 4 0 0 0
[pid=23179/tid=23203] ppid=23177 vsize=356228 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23203/stat : 23203 (python) S 23177 23179 21589 0 -1 4202560 24 1593 0 0 0 0 49 5 20 0 6 0 850282255 364777472 12666 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 4 0 0 0
[pid=23179/tid=23376] ppid=23177 vsize=356228 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23376/stat : 23376 (python) S 23177 23179 21589 0 -1 4202560 28 1593 0 0 0 0 49 5 20 0 6 0 850319006 364777472 12666 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 707.95
Current children cumulated vsize (KiB) 11458016



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+703.713 s]
/proc/loadavg: 2.00 2.05 1.94 7/807 23419
/proc/meminfo: memFree=16692452/32951124 swapFree=39903648/67111528
[pid=23179] ppid=23177 vsize=366484 CPUtime=3 cores=0,2,4,6
/proc/23179/stat : 23179 (python) S 23177 23179 21589 0 -1 4202496 26825 1593 1 0 232 14 49 5 20 0 7 0 850267310 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/23179/statm: 91621 12672 1882 364 0 26493 0
[pid=23186] ppid=23179 vsize=315204 CPUtime=1.57 cores=0,2,4,6
/proc/23186/stat : 23186 (python) S 23179 23179 21589 0 -1 4202560 1174 0 0 0 79 78 0 0 15 0 2 0 850267612 322768896 11177 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23186/statm: 78801 11177 406 364 0 13688 0
[pid=23188] ppid=23186 vsize=390876 CPUtime=324.14 cores=0,2,4,6
/proc/23188/stat : 23188 (scip-2.0.1.linu) T 23186 23188 23188 0 -1 4202496 97891 0 0 0 32378 36 0 0 25 0 1 0 850267613 400257024 92874 33554432000 4194304 13684479 140734282252272 18446744073709551615 7391338 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/23188/statm: 97719 92874 812 2317 0 95397 0
[pid=23186/tid=23190] ppid=23179 vsize=315204 CPUtime=0 cores=0,2,4,6
/proc/23186/task/23190/stat : 23190 (python) S 23179 23179 21589 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 850272500 322768896 11177 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604451014796352 0 0 -1 4 0 0 0
[pid=23191] ppid=23179 vsize=315216 CPUtime=0.27 cores=0,2,4,6
/proc/23191/stat : 23191 (python) S 23179 23179 21589 0 -1 4202560 1190 0 0 0 14 13 0 0 16 0 2 0 850272503 322781184 11167 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23191/statm: 78804 11167 396 364 0 13688 0
[pid=23193] ppid=23191 vsize=105944 CPUtime=48.41 cores=0,2,4,6
/proc/23193/stat : 23193 (wbo1.4a) T 23191 23193 23193 0 -1 4202496 29171 0 0 0 4826 15 0 0 25 0 1 0 850272503 108486656 25867 33554432000 134512640 135751879 4288432992 18446744073709551615 134518928 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/23193/statm: 26486 25867 146 303 0 26181 0
[pid=23191/tid=23195] ppid=23179 vsize=315216 CPUtime=0 cores=0,2,4,6
/proc/23191/task/23195/stat : 23195 (python) S 23179 23179 21589 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 850277347 322781184 11167 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604450022201216 0 0 -1 6 0 0 0
[pid=23196] ppid=23179 vsize=325472 CPUtime=0.95 cores=0,2,4,6
/proc/23196/stat : 23196 (python) S 23179 23179 21589 0 -1 4202560 1249 0 0 0 48 47 0 0 15 0 2 0 850277350 333283328 11171 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23196/statm: 81368 11171 396 364 0 16249 0
[pid=23198] ppid=23196 vsize=356552 CPUtime=184.72 cores=0,2,4,6
/proc/23198/stat : 23198 (scip-2.0.1.linu) T 23196 23198 23198 0 -1 4202496 378868 0 0 0 18396 76 0 0 25 0 1 0 850277350 365109248 74447 33554432000 4194304 15243407 140736643270720 18446744073709551615 8113024 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/23198/statm: 89138 74447 908 2698 0 86433 0
[pid=23196/tid=23201] ppid=23179 vsize=325472 CPUtime=0 cores=0,2,4,6
/proc/23196/task/23201/stat : 23201 (python) S 23179 23179 21589 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 850282252 333283328 11171 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604451686228416 0 0 -1 6 0 0 0
[pid=23202] ppid=23179 vsize=335728 CPUtime=0.23 cores=0,2,4,6
/proc/23202/stat : 23202 (python) S 23179 23179 21589 0 -1 4202560 1136 0 0 0 11 12 0 0 17 0 2 0 850282255 343785472 11169 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0
/proc/23202/statm: 83932 11169 390 364 0 18810 0
[pid=23204] ppid=23202 vsize=8548004 CPUtime=48.41 cores=0,2,4,6
/proc/23204/stat : 23204 (java) T 23202 23204 23204 0 -1 4202496 546979 0 1 0 4774 67 0 0 18 0 19 0 850282255 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/23204/statm: 2137001 541644 2247 9 0 2127742 0
[pid=23204/tid=23205] ppid=23202 vsize=8548004 CPUtime=45.63 cores=0,2,4,6
/proc/23204/task/23205/stat : 23205 (java) T 23202 23204 23204 0 -1 4202560 484290 0 1 0 4506 57 0 0 25 0 19 0 850282256 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 46912505975161 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23204/tid=23206] ppid=23202 vsize=8548004 CPUtime=0.06 cores=0,2,4,6
/proc/23204/task/23206/stat : 23206 (java) T 23202 23204 23204 0 -1 4202560 4885 0 0 0 6 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23204/tid=23207] ppid=23202 vsize=8548004 CPUtime=0.12 cores=0,2,4,6
/proc/23204/task/23207/stat : 23207 (java) T 23202 23204 23204 0 -1 4202560 8688 0 0 0 12 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23204/tid=23208] ppid=23202 vsize=8548004 CPUtime=0.12 cores=0,2,4,6
/proc/23204/task/23208/stat : 23208 (java) T 23202 23204 23204 0 -1 4202560 8553 0 0 0 11 1 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23204/tid=23209] ppid=23202 vsize=8548004 CPUtime=0.04 cores=0,2,4,6
/proc/23204/task/23209/stat : 23209 (java) T 23202 23204 23204 0 -1 4202560 2888 0 0 0 4 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23204/tid=23210] ppid=23202 vsize=8548004 CPUtime=0.03 cores=0,2,4,6
/proc/23204/task/23210/stat : 23210 (java) T 23202 23204 23204 0 -1 4202560 2939 0 0 0 3 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23204/tid=23211] ppid=23202 vsize=8548004 CPUtime=0.06 cores=0,2,4,6
/proc/23204/task/23211/stat : 23211 (java) T 23202 23204 23204 0 -1 4202560 4576 0 0 0 6 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23204/tid=23212] ppid=23202 vsize=8548004 CPUtime=0.09 cores=0,2,4,6
/proc/23204/task/23212/stat : 23212 (java) T 23202 23204 23204 0 -1 4202560 6872 0 0 0 9 0 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23204/tid=23213] ppid=23202 vsize=8548004 CPUtime=0.13 cores=0,2,4,6
/proc/23204/task/23213/stat : 23213 (java) T 23202 23204 23204 0 -1 4202560 9126 0 0 0 12 1 0 0 15 0 19 0 850282257 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23204/tid=23214] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23214/stat : 23214 (java) T 23202 23204 23204 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 850282258 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471872 0 0 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23204/tid=23215] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23215/stat : 23215 (java) T 23202 23204 23204 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850282258 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23204/tid=23216] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23216/stat : 23216 (java) T 23202 23204 23204 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 850282258 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23204/tid=23217] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23217/stat : 23217 (java) T 23202 23204 23204 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850282261 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051478961 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23204/tid=23218] ppid=23202 vsize=8548004 CPUtime=1.15 cores=0,2,4,6
/proc/23204/task/23218/stat : 23218 (java) T 23202 23204 23204 0 -1 4202560 6093 0 0 0 115 0 0 0 15 0 19 0 850282261 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23204/tid=23219] ppid=23202 vsize=8548004 CPUtime=0.85 cores=0,2,4,6
/proc/23204/task/23219/stat : 23219 (java) T 23202 23204 23204 0 -1 4202560 5404 0 0 0 84 1 0 0 15 0 19 0 850282261 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23204/tid=23220] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23220/stat : 23220 (java) T 23202 23204 23204 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850282261 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23204/tid=23221] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23221/stat : 23221 (java) T 23202 23204 23204 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 850282261 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471872 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23204/tid=23222] ppid=23202 vsize=8548004 CPUtime=0 cores=0,2,4,6
/proc/23204/task/23222/stat : 23222 (java) T 23202 23204 23204 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850282343 8753156096 541644 33554432000 1073741824 1073778376 140735337926816 18446744073709551615 212051471872 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23202/tid=23224] ppid=23179 vsize=335728 CPUtime=0 cores=0,2,4,6
/proc/23202/task/23224/stat : 23224 (python) S 23179 23179 21589 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 850286842 343785472 11169 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604442840922048 0 0 -1 2 0 0 0
[pid=23375] ppid=23179 vsize=345984 CPUtime=0.48 cores=0,2,4,6
/proc/23375/stat : 23375 (python) S 23179 23179 21589 0 -1 4202560 1185 0 0 0 25 23 0 0 16 0 2 0 850319006 354287616 11173 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/23375/statm: 86496 11173 390 364 0 21371 0
[pid=23377] ppid=23375 vsize=62808 CPUtime=96.22 cores=0,2,4,6
/proc/23377/stat : 23377 (clasp-1.3.7-x86) T 23375 23377 23377 0 -1 4202496 16447 0 0 0 9619 3 0 0 25 0 1 0 850319006 64315392 15424 33554432000 134512640 136139019 4294262592 18446744073709551615 134626584 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/23377/statm: 15702 15424 189 398 0 15302 0
[pid=23375/tid=23391] ppid=23179 vsize=345984 CPUtime=0 cores=0,2,4,6
/proc/23375/task/23391/stat : 23391 (python) S 23179 23179 21589 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 850328631 354287616 11173 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554946 18446604452981156544 0 0 -1 0 0 0 0
[pid=23399] ppid=23179 vsize=356240 CPUtime=0 cores=0,2,4,6
/proc/23399/stat : 23399 (python) S 23179 23179 21589 0 -1 4202560 808 0 0 0 0 0 0 0 18 0 1 0 850337582 364789760 11105 33554432000 4194304 5683644 140735219817792 18446744073709551615 212039675462 0 0 16781312 33554946 4294934787 0 0 17 6 0 0 0
/proc/23399/statm: 89060 11105 319 364 0 23932 0
[pid=23401] ppid=23399 vsize=8539920 CPUtime=2.1 cores=0,2,4,6
/proc/23401/stat : 23401 (java) S 23399 23401 23401 0 -1 4202496 59001 0 1 0 201 9 0 0 20 0 19 0 850337582 8744878080 55947 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/23401/statm: 2134980 55947 2240 9 0 2125721 0
[pid=23401/tid=23402] ppid=23399 vsize=8539920 CPUtime=0.91 cores=0,2,4,6
/proc/23401/task/23402/stat : 23402 (java) R 23399 23401 23401 0 -1 4202560 35228 0 1 0 85 6 0 0 18 0 19 0 850337583 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 47542641197909 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23401/tid=23403] ppid=23399 vsize=8539920 CPUtime=0.04 cores=0,2,4,6
/proc/23401/task/23403/stat : 23403 (java) S 23399 23401 23401 0 -1 4202560 3292 0 0 0 4 0 0 0 16 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23404] ppid=23399 vsize=8539920 CPUtime=0.09 cores=0,2,4,6
/proc/23401/task/23404/stat : 23404 (java) S 23399 23401 23401 0 -1 4202560 6538 0 0 0 9 0 0 0 16 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 0 0 0 0
[pid=23401/tid=23405] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23405/stat : 23405 (java) S 23399 23401 23401 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 0 0 0 0
[pid=23401/tid=23406] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23406/stat : 23406 (java) S 23399 23401 23401 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23407] ppid=23399 vsize=8539920 CPUtime=0.04 cores=0,2,4,6
/proc/23401/task/23407/stat : 23407 (java) S 23399 23401 23401 0 -1 4202560 3287 0 0 0 4 0 0 0 17 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23408] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23408/stat : 23408 (java) S 23399 23401 23401 0 -1 4202560 6 0 0 0 0 0 0 0 16 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23409] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23409/stat : 23409 (java) S 23399 23401 23401 0 -1 4202560 299 0 0 0 0 0 0 0 17 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 4 0 0 0
[pid=23401/tid=23410] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23410/stat : 23410 (java) S 23399 23401 23401 0 -1 4202560 192 0 0 0 0 0 0 0 17 0 19 0 850337584 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 0 0 0 0
[pid=23401/tid=23411] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23411/stat : 23411 (java) S 23399 23401 23401 0 -1 4202560 73 0 0 0 0 0 0 0 17 0 19 0 850337585 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471872 0 0 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23412] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23412/stat : 23412 (java) S 23399 23401 23401 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850337585 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23413] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23413/stat : 23413 (java) S 23399 23401 23401 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 850337585 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23414] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23414/stat : 23414 (java) S 23399 23401 23401 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850337588 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051478961 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23415] ppid=23399 vsize=8539920 CPUtime=0.44 cores=0,2,4,6
/proc/23401/task/23415/stat : 23415 (java) R 23399 23401 23401 0 -1 4202560 3229 0 0 0 44 0 0 0 16 0 19 0 850337588 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 47542640059545 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23401/tid=23416] ppid=23399 vsize=8539920 CPUtime=0.52 cores=0,2,4,6
/proc/23401/task/23416/stat : 23416 (java) R 23399 23401 23401 0 -1 4202560 5467 0 0 0 51 1 0 0 15 0 19 0 850337588 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 47542643870304 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23401/tid=23417] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23417/stat : 23417 (java) S 23399 23401 23401 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850337588 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471257 0 4 0 16800975 18446604450248401024 0 0 -1 6 0 0 0
[pid=23401/tid=23418] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23418/stat : 23418 (java) S 23399 23401 23401 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850337588 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471872 0 4 0 16800975 18446604450248401024 0 0 -1 4 0 0 0
[pid=23401/tid=23419] ppid=23399 vsize=8539920 CPUtime=0 cores=0,2,4,6
/proc/23401/task/23419/stat : 23419 (java) S 23399 23401 23401 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850337681 8744878080 55952 33554432000 1073741824 1073778376 140735125964464 18446744073709551615 212051471872 0 4 0 16800975 18446604450248401024 0 0 -1 0 0 0 0
[pid=23179/tid=23187] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23187/stat : 23187 (python) S 23177 23179 21589 0 -1 4202560 32 1593 0 0 0 0 49 5 18 0 7 0 850267613 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
[pid=23179/tid=23192] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23192/stat : 23192 (python) S 23177 23179 21589 0 -1 4202560 27 1593 0 0 0 0 49 5 20 0 7 0 850272503 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 6 0 0 0
[pid=23179/tid=23197] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23197/stat : 23197 (python) S 23177 23179 21589 0 -1 4202560 35 1593 0 0 0 0 49 5 18 0 7 0 850277350 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 4 0 0 0
[pid=23179/tid=23203] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23203/stat : 23203 (python) S 23177 23179 21589 0 -1 4202560 24 1593 0 0 0 0 49 5 20 0 7 0 850282255 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 4 0 0 0
[pid=23179/tid=23376] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23376/stat : 23376 (python) S 23177 23179 21589 0 -1 4202560 28 1593 0 0 0 0 49 5 20 0 7 0 850319006 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 0 0 0 0
[pid=23179/tid=23400] ppid=23177 vsize=366484 CPUtime=0.54 cores=0,2,4,6
/proc/23179/task/23400/stat : 23400 (python) S 23177 23179 21589 0 -1 4202560 31 1593 0 0 0 0 49 5 20 0 7 0 850337582 375279616 12672 33554432000 4194304 5683644 140735219817792 18446744073709551615 212051478961 0 0 16781312 33554434 18446604442004641920 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 710.5
Current children cumulated vsize (KiB) 20364432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23179 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=813572
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=200969
# CPU time returned by wait4() is 3.01454
# while last known CPU time is 710.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 703.808
CPU time (s): 710.5
CPU user time (s): 706.52
CPU system time (s): 3.98
CPU usage (%): 100.951
Max. virtual memory (cumulated for all children) (KiB): 20364432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.81357
system time used= 0.200969
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28421
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30545
involuntary context switches= 972

runsolver used 6.22905 second user time and 12.5471 second system time

The end

Launcher Data 

Begin job on node146 at 2011-06-09 02:15:10
IDJOB=3481606
IDBENCH=48273
IDSOLVER=1970
FILE ID=node146/3481606-1307578509
RUNJOBID= node146-1307576353-21610
PBS_JOBID= 13547653
Free space on /tmp= 73576 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_500_60_4.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481606-1307578509/watcher-3481606-1307578509 -o /tmp/evaluation-result-3481606-1307578509/solver-3481606-1307578509 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481606-1307578509.opb -seed 2076812952 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d34b8195c337caa741dffbe26b4db95e
RANDOM SEED=2076812952

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20507164 kB
Buffers:        171828 kB
Cached:         828876 kB
SwapCached:      15612 kB
Active:       11833276 kB
Inactive:       268372 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20507164 kB
SwapTotal:    67111528 kB
SwapFree:     39903648 kB
Dirty:          102920 kB
Writeback:           0 kB
AnonPages:    11097584 kB
Mapped:          77708 kB
Slab:           145224 kB
PageTables:     125636 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 175137224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node146 at 2011-06-09 02:26:56