Trace number 3481716

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 495.34 491.692

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/
market-split/normalized-market-split_5_40_2.opb
MD5SUM4618b6422bdc12197131d1d37f567363
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables41
Total number of constraints11
Number of constraints which are clauses1
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10
Minimum length of a constraint1
Maximum length of a constraint40
Number of terms in the objective function 1
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1
Number of bits of the sum of numbers in the objective function 1
Biggest number in a constraint 1196
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 3589
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.41/0.71	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.41/0.71	c INFO: solving HOME/instance-3481716-1307577321.opb
0.41/0.71	c INFO: parsing took 0.00 s
0.41/0.71	c INFO: features took 0.00 CPU seconds
0.41/0.74	c INFO: running clasp-1.3.7@0 for 45 with 1799 remaining (b = 0.51)
48.75/48.94	c INFO: running scip-2.0.1-spx@0 for 45 with 1751 remaining (b = 0.11)
104.62/104.39	c INFO: running wbo1.4a@0 for 45 with 1704 remaining (b = 0.03)
151.91/151.42	c INFO: running scip-2.0.1-clp@0 for 45 with 1658 remaining (b = 0.01)
207.76/206.84	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1609 remaining (b = 0.01)
257.42/255.01	c INFO: running bsolo_pb10-l3@0 for 136 with 1560 remaining (b = 0.01)
398.52/395.60	c INFO: running wbo1.4a@46 for 45 with 1420 remaining (b = 0.00)
448.81/445.77	c INFO: running clasp-1.3.7@48 for 45 with 1370 remaining (b = 0.00)
494.20/490.97	c INFO: running sat4j-pb-v20101225@0 for 91 with 1325 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481716-1307577321/watcher-3481716-1307577321 -o /tmp/evaluation-result-3481716-1307577321/solver-3481716-1307577321 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481716-1307577321.opb -seed 1300517719 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.92 1.29 2/468 31550
/proc/meminfo: memFree=28401660/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=16244 CPUtime=0 cores=1,3,5,7
/proc/31550/stat : 31550 (python) R 31548 31550 31366 0 -1 4202496 1003 0 0 0 0 0 0 0 20 0 1 0 869330137 16633856 875 33554432000 4194304 5683644 140737137170960 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31550/statm: 4061 878 372 364 0 548 0

[startup+0.079558 s]
/proc/loadavg: 1.92 1.92 1.29 2/468 31550
/proc/meminfo: memFree=28401660/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=45820 CPUtime=0.05 cores=1,3,5,7
/proc/31550/stat : 31550 (python) R 31548 31550 31366 0 -1 4202496 1925 0 0 0 4 1 0 0 17 0 1 0 869330137 46919680 1697 33554432000 4194304 5683644 140737137170960 18446744073709551615 4567031 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31550/statm: 11455 1697 470 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 45820

[startup+0.100551 s]
/proc/loadavg: 1.92 1.92 1.29 2/468 31550
/proc/meminfo: memFree=28401660/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=85624 CPUtime=0.07 cores=1,3,5,7
/proc/31550/stat : 31550 (python) R 31548 31550 31366 0 -1 4202496 2663 0 0 0 5 2 0 0 17 0 1 0 869330137 87678976 2382 33554432000 4194304 5683644 140737137170960 18446744073709551615 5387103 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31550/statm: 21406 2382 715 364 0 1623 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 85624

[startup+0.30056 s]
/proc/loadavg: 1.92 1.92 1.29 2/468 31550
/proc/meminfo: memFree=28401660/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=123744 CPUtime=0.17 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 5358 933 1 0 11 6 0 0 16 0 1 0 869330137 126713856 3744 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122710021 0 2147483391 16781312 2 0 0 0 17 1 0 0 0
/proc/31550/statm: 30936 3744 987 364 0 2768 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123744

[startup+0.700467 s]
/proc/loadavg: 1.92 1.92 1.29 2/468 31550
/proc/meminfo: memFree=28401660/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=273720 CPUtime=0.41 cores=1,3,5,7
/proc/31550/stat : 31550 (python) R 31548 31550 31366 0 -1 4202496 8810 933 1 0 29 12 0 0 15 0 1 0 869330137 280289280 6759 33554432000 4194304 5683644 140737137170960 18446744073709551615 4448079 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31550/statm: 68430 6759 1720 364 0 5463 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 273720

[startup+1.5003 s]
/proc/loadavg: 1.92 1.92 1.29 3/472 31558
/proc/meminfo: memFree=28375216/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=293072 CPUtime=0.45 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 9623 933 1 0 33 12 0 0 17 0 2 0 869330137 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/31550/statm: 73268 7137 1870 364 0 8155 0
[pid=31556] ppid=31550 vsize=282828 CPUtime=0 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 696 0 0 0 0 0 0 0 18 0 1 0 869330211 289615872 5612 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734095 0 0 16781312 33554946 4481258895418818820 0 0 17 1 0 0 0
/proc/31556/statm: 70707 5612 349 364 0 5594 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=0.75 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) R 31556 31558 31558 0 -1 4202496 460 0 0 0 75 0 0 0 20 0 1 0 869330211 1904640 204 33554432000 134512640 136139019 4294258704 18446744073709551615 134883821 0 0 16781312 16386 0 0 0 17 3 0 0 0
/proc/31558/statm: 465 204 183 398 0 65 0
[pid=31550/tid=31557] ppid=31548 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 2 0 869330211 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 577760

[startup+3.101 s]
/proc/loadavg: 1.92 1.92 1.29 3/472 31558
/proc/meminfo: memFree=28374224/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=293072 CPUtime=0.45 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 9623 933 1 0 33 12 0 0 17 0 2 0 869330137 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/31550/statm: 73268 7137 1870 364 0 8155 0
[pid=31556] ppid=31550 vsize=282828 CPUtime=0 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 719 0 0 0 0 0 0 0 15 0 1 0 869330211 289615872 5615 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734095 0 0 16781312 33554946 4481274013703700740 0 0 17 1 0 0 0
/proc/31556/statm: 70707 5615 352 364 0 5594 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=2.35 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) R 31556 31558 31558 0 -1 4202496 461 0 0 0 235 0 0 0 25 0 1 0 869330211 1904640 205 33554432000 134512640 136139019 4294258704 18446744073709551615 134831224 0 0 16781312 16386 0 0 0 17 3 0 0 0
/proc/31558/statm: 465 205 183 398 0 65 0
[pid=31550/tid=31557] ppid=31548 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 2 0 869330211 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 577760

[startup+6.30042 s]
/proc/loadavg: 2.17 1.97 1.30 3/472 31558
/proc/meminfo: memFree=28370256/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=293072 CPUtime=0.45 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 9623 933 1 0 33 12 0 0 17 0 2 0 869330137 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/31550/statm: 73268 7137 1870 364 0 8155 0
[pid=31556] ppid=31550 vsize=282828 CPUtime=0 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 860 0 0 0 0 0 0 0 15 0 1 0 869330211 289615872 5639 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734095 0 0 16781312 33554946 4481274013703700740 0 0 17 1 0 0 0
/proc/31556/statm: 70707 5639 376 364 0 5594 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=5.55 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) R 31556 31558 31558 0 -1 4202496 462 0 0 0 555 0 0 0 25 0 1 0 869330211 1904640 206 33554432000 134512640 136139019 4294258704 18446744073709551615 134632442 0 0 16781312 16386 0 0 0 17 3 0 0 0
/proc/31558/statm: 465 206 183 398 0 65 0
[pid=31550/tid=31557] ppid=31548 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 2 0 869330211 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6
Current children cumulated vsize (KiB) 577760

[startup+12.7003 s]
/proc/loadavg: 2.15 1.97 1.31 3/472 31558
/proc/meminfo: memFree=28369512/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=293072 CPUtime=0.45 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 9623 933 1 0 33 12 0 0 17 0 2 0 869330137 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/31550/statm: 73268 7137 1870 364 0 8155 0
[pid=31556] ppid=31550 vsize=282828 CPUtime=0.02 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 866 0 0 0 1 1 0 0 15 0 1 0 869330211 289615872 5639 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734095 0 0 16781312 33554946 5623311482772007832 0 0 17 1 0 0 0
/proc/31556/statm: 70707 5639 376 364 0 5594 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=11.95 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) R 31556 31558 31558 0 -1 4202496 462 0 0 0 1195 0 0 0 25 0 1 0 869330211 1904640 206 33554432000 134512640 136139019 4294258704 18446744073709551615 134832207 0 0 16781312 16386 0 0 0 17 3 0 0 0
/proc/31558/statm: 465 206 183 398 0 65 0
[pid=31550/tid=31557] ppid=31548 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 2 0 869330211 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.42
Current children cumulated vsize (KiB) 577760

[startup+25.5009 s]
/proc/loadavg: 2.12 1.97 1.32 3/472 31559
/proc/meminfo: memFree=28364312/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=293072 CPUtime=0.45 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 9623 933 1 0 33 12 0 0 17 0 2 0 869330137 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/31550/statm: 73268 7137 1870 364 0 8155 0
[pid=31556] ppid=31550 vsize=282828 CPUtime=0.08 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 872 0 0 0 3 5 0 0 15 0 1 0 869330211 289615872 5639 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734095 0 0 16781312 33554946 5623606151888251800 0 0 17 5 0 0 0
/proc/31556/statm: 70707 5639 376 364 0 5594 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=24.75 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) R 31556 31558 31558 0 -1 4202496 462 0 0 0 2475 0 0 0 25 0 1 0 869330211 1904640 206 33554432000 134512640 136139019 4294258704 18446744073709551615 134876508 0 0 16781312 16386 0 0 0 17 3 0 0 0
/proc/31558/statm: 465 206 183 398 0 65 0
[pid=31550/tid=31557] ppid=31548 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 2 0 869330211 300105728 7137 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 577760

[startup+51.1013 s]
/proc/loadavg: 2.15 1.99 1.34 3/476 31563
/proc/meminfo: memFree=28331736/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=303860 CPUtime=0.47 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 10488 933 1 0 35 12 0 0 19 0 3 0 869330137 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/31550/statm: 75965 7262 1873 364 0 10849 0
[pid=31556] ppid=31550 vsize=293072 CPUtime=0.17 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 1102 0 0 0 8 9 0 0 17 0 2 0 869330211 300105728 5680 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31556/statm: 73268 5680 412 364 0 8155 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=48.16 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) T 31556 31558 31558 0 -1 4202496 463 0 0 0 4816 0 0 0 25 0 1 0 869330211 1904640 207 33554432000 134512640 136139019 4294258704 18446744073709551615 134832351 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/31558/statm: 465 207 183 398 0 65 0
[pid=31556/tid=31560] ppid=31550 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31556/task/31560/stat : 31560 (python) S 31550 31550 31366 0 -1 4202560 42 0 0 0 0 0 0 0 17 0 2 0 869335029 300105728 5680 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604455299712064 0 0 -1 7 0 0 0
[pid=31561] ppid=31550 vsize=293616 CPUtime=0 cores=1,3,5,7
/proc/31561/stat : 31561 (python) S 31550 31550 31366 0 -1 4202560 812 0 0 0 0 0 0 0 15 0 1 0 869335031 300662784 5734 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734150 0 0 16781312 33554946 1089343765149122560 0 0 17 3 0 0 0
/proc/31561/statm: 73404 5734 349 364 0 8288 0
[pid=31563] ppid=31561 vsize=26832 CPUtime=2.15 cores=1,3,5,7
/proc/31563/stat : 31563 (scip-2.0.1.linu) R 31561 31563 31563 0 -1 4202496 5877 0 0 0 165 50 0 0 18 0 1 0 869335031 27475968 4406 33554432000 4194304 13684479 140734067577616 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31563/statm: 6708 4406 804 2317 0 4386 0
[pid=31550/tid=31557] ppid=31548 vsize=303860 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 3 0 869330211 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
[pid=31550/tid=31562] ppid=31548 vsize=303860 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31562/stat : 31562 (python) S 31548 31550 31366 0 -1 4202560 28 933 0 0 0 0 0 0 19 0 3 0 869335031 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 919240

[startup+102.318 s]
/proc/loadavg: 2.06 1.99 1.37 3/476 31565
/proc/meminfo: memFree=28257616/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=303860 CPUtime=0.47 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 10488 933 1 0 35 12 0 0 19 0 3 0 869330137 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/31550/statm: 75965 7262 1873 364 0 10849 0
[pid=31556] ppid=31550 vsize=293072 CPUtime=0.17 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 1102 0 0 0 8 9 0 0 17 0 2 0 869330211 300105728 5680 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31556/statm: 73268 5680 412 364 0 8155 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=48.16 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) T 31556 31558 31558 0 -1 4202496 463 0 0 0 4816 0 0 0 25 0 1 0 869330211 1904640 207 33554432000 134512640 136139019 4294258704 18446744073709551615 134832351 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/31558/statm: 465 207 183 398 0 65 0
[pid=31556/tid=31560] ppid=31550 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31556/task/31560/stat : 31560 (python) S 31550 31550 31366 0 -1 4202560 42 0 0 0 0 0 0 0 17 0 2 0 869335029 300105728 5680 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604455299712064 0 0 -1 7 0 0 0
[pid=31561] ppid=31550 vsize=293940 CPUtime=0.47 cores=1,3,5,7
/proc/31561/stat : 31561 (python) S 31550 31550 31366 0 -1 4202560 1165 0 0 0 32 15 0 0 15 0 1 0 869335031 300994560 5846 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734150 0 0 16781312 33554946 2054374615358111744 0 0 17 5 0 0 0
/proc/31561/statm: 73485 5846 376 364 0 8369 0
[pid=31563] ppid=31561 vsize=74060 CPUtime=53.36 cores=1,3,5,7
/proc/31563/stat : 31563 (scip-2.0.1.linu) R 31561 31563 31563 0 -1 4202496 17635 0 0 0 4488 848 0 0 18 0 1 0 869335031 75837440 16164 33554432000 4194304 13684479 140734067577616 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/31563/statm: 18515 16164 804 2317 0 16193 0
[pid=31550/tid=31557] ppid=31548 vsize=303860 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 25 933 0 0 0 0 0 0 17 0 3 0 869330211 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
[pid=31550/tid=31562] ppid=31548 vsize=303860 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31562/stat : 31562 (python) S 31548 31550 31366 0 -1 4202560 28 933 0 0 0 0 0 0 19 0 3 0 869335031 311152640 7262 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 3 0 0 0

################
# More data... #
################


Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+491.602 s]
/proc/loadavg: 2.00 2.00 1.58 4/532 31640
/proc/meminfo: memFree=27157256/32951124 swapFree=41082008/67111528
[pid=31550] ppid=31548 vsize=355084 CPUtime=0.65 cores=1,3,5,7
/proc/31550/stat : 31550 (python) S 31548 31550 31366 0 -1 4202496 14950 933 1 0 52 13 0 0 19 0 8 0 869330137 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/31550/statm: 88771 7265 1883 364 0 23640 0
[pid=31556] ppid=31550 vsize=293072 CPUtime=0.35 cores=1,3,5,7
/proc/31556/stat : 31556 (python) S 31550 31550 31366 0 -1 4202560 1128 0 0 0 17 18 0 0 15 0 2 0 869330211 300105728 5681 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31556/statm: 73268 5681 413 364 0 8155 0
[pid=31558] ppid=31556 vsize=1860 CPUtime=93.34 cores=1,3,5,7
/proc/31558/stat : 31558 (clasp-1.3.7-x86) T 31556 31558 31558 0 -1 4202496 463 0 0 0 9334 0 0 0 25 0 1 0 869330211 1904640 207 33554432000 134512640 136139019 4294258704 18446744073709551615 134831239 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/31558/statm: 465 207 183 398 0 65 0
[pid=31556/tid=31560] ppid=31550 vsize=293072 CPUtime=0 cores=1,3,5,7
/proc/31556/task/31560/stat : 31560 (python) S 31550 31550 31366 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 869335029 300105728 5681 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604455299712064 0 0 -1 7 0 0 0
[pid=31561] ppid=31550 vsize=293940 CPUtime=0.5 cores=1,3,5,7
/proc/31561/stat : 31561 (python) S 31550 31550 31366 0 -1 4202560 1328 0 0 0 34 16 0 0 16 0 2 0 869335031 300994560 5873 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/31561/statm: 73485 5873 399 364 0 8369 0
[pid=31563] ppid=31561 vsize=75048 CPUtime=55.41 cores=1,3,5,7
/proc/31563/stat : 31563 (scip-2.0.1.linu) T 31561 31563 31563 0 -1 4202496 17916 0 0 0 4664 877 0 0 18 0 1 0 869335031 76849152 16445 33554432000 4194304 13684479 140734067577616 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/31563/statm: 18762 16445 804 2317 0 16440 0
[pid=31561/tid=31566] ppid=31550 vsize=293940 CPUtime=0 cores=1,3,5,7
/proc/31561/task/31566/stat : 31566 (python) S 31550 31550 31366 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869340573 300994560 5873 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604470721048704 0 0 -1 5 0 0 0
[pid=31567] ppid=31550 vsize=303636 CPUtime=0.39 cores=1,3,5,7
/proc/31567/stat : 31567 (python) S 31550 31550 31366 0 -1 4202560 1117 0 0 0 19 20 0 0 16 0 2 0 869340576 310923264 5724 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31567/statm: 75909 5724 397 364 0 10790 0
[pid=31569] ppid=31567 vsize=138508 CPUtime=97.13 cores=1,3,5,7
/proc/31569/stat : 31569 (wbo1.4a) T 31567 31569 31569 0 -1 4202496 34377 0 0 0 9587 126 0 0 25 0 1 0 869340576 141832192 34118 33554432000 134512640 135751879 4290524288 18446744073709551615 134517428 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/31569/statm: 34627 34118 143 303 0 34322 0
[pid=31567/tid=31571] ppid=31550 vsize=303636 CPUtime=0 cores=1,3,5,7
/proc/31567/task/31571/stat : 31571 (python) S 31550 31550 31366 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869345277 310923264 5724 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604455308529984 0 0 -1 5 0 0 0
[pid=31572] ppid=31550 vsize=314308 CPUtime=0.47 cores=1,3,5,7
/proc/31572/stat : 31572 (python) S 31550 31550 31366 0 -1 4202560 1271 0 0 0 29 18 0 0 17 0 2 0 869345280 321851392 5821 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/31572/statm: 78577 5821 398 364 0 13455 0
[pid=31574] ppid=31572 vsize=69660 CPUtime=55.37 cores=1,3,5,7
/proc/31574/stat : 31574 (scip-2.0.1.linu) T 31572 31574 31574 0 -1 4202496 16344 0 0 0 4875 662 0 0 18 0 1 0 869345280 71331840 14323 33554432000 4194304 15243407 140734584297872 18446744073709551615 13354455 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/31574/statm: 17415 14323 929 2698 0 14710 0
[pid=31572/tid=31576] ppid=31550 vsize=314308 CPUtime=0 cores=1,3,5,7
/proc/31572/task/31576/stat : 31576 (python) S 31550 31550 31366 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 869350819 321851392 5821 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604464177230016 0 0 -1 1 0 0 0
[pid=31577] ppid=31550 vsize=324564 CPUtime=0.18 cores=1,3,5,7
/proc/31577/stat : 31577 (python) S 31550 31550 31366 0 -1 4202560 1117 0 0 0 9 9 0 0 16 0 2 0 869350821 332353536 5844 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31577/statm: 81141 5844 397 364 0 16016 0
[pid=31579] ppid=31577 vsize=8544720 CPUtime=49.43 cores=1,3,5,7
/proc/31579/stat : 31579 (java) T 31577 31579 31579 0 -1 4202496 132595 0 117 0 4922 21 0 0 15 0 19 0 869350822 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134516709 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 19
/proc/31579/statm: 2136180 110928 2243 9 0 2126921 0
[pid=31579/tid=31580] ppid=31577 vsize=8544720 CPUtime=47.34 cores=1,3,5,7
/proc/31579/task/31580/stat : 31580 (java) T 31577 31579 31579 0 -1 4202560 95807 0 59 0 4721 13 0 0 25 0 19 0 869350844 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 46912505553316 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 10
[pid=31579/tid=31581] ppid=31577 vsize=8544720 CPUtime=0.1 cores=1,3,5,7
/proc/31579/task/31581/stat : 31581 (java) T 31577 31579 31579 0 -1 4202560 3208 0 0 0 10 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31582] ppid=31577 vsize=8544720 CPUtime=0.11 cores=1,3,5,7
/proc/31579/task/31582/stat : 31582 (java) T 31577 31579 31579 0 -1 4202560 3555 0 0 0 11 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=31579/tid=31583] ppid=31577 vsize=8544720 CPUtime=0.07 cores=1,3,5,7
/proc/31579/task/31583/stat : 31583 (java) T 31577 31579 31579 0 -1 4202560 2200 0 0 0 7 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=31579/tid=31584] ppid=31577 vsize=8544720 CPUtime=0.11 cores=1,3,5,7
/proc/31579/task/31584/stat : 31584 (java) T 31577 31579 31579 0 -1 4202560 2948 0 0 0 11 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31585] ppid=31577 vsize=8544720 CPUtime=0.09 cores=1,3,5,7
/proc/31579/task/31585/stat : 31585 (java) T 31577 31579 31579 0 -1 4202560 2906 0 0 0 9 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31586] ppid=31577 vsize=8544720 CPUtime=0.09 cores=1,3,5,7
/proc/31579/task/31586/stat : 31586 (java) T 31577 31579 31579 0 -1 4202560 3203 0 0 0 9 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31587] ppid=31577 vsize=8544720 CPUtime=0.1 cores=1,3,5,7
/proc/31579/task/31587/stat : 31587 (java) T 31577 31579 31579 0 -1 4202560 3198 0 0 0 10 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31588] ppid=31577 vsize=8544720 CPUtime=0.1 cores=1,3,5,7
/proc/31579/task/31588/stat : 31588 (java) T 31577 31579 31579 0 -1 4202560 3730 0 0 0 10 0 0 0 15 0 19 0 869350846 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31589] ppid=31577 vsize=8544720 CPUtime=0.05 cores=1,3,5,7
/proc/31579/task/31589/stat : 31589 (java) T 31577 31579 31579 0 -1 4202560 538 0 0 0 4 1 0 0 15 0 19 0 869350849 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134530560 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31590] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31590/stat : 31590 (java) T 31577 31579 31579 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869350851 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31591] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31591/stat : 31591 (java) T 31577 31579 31579 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869350851 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31592] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31592/stat : 31592 (java) T 31577 31579 31579 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869350856 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134537649 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31593] ppid=31577 vsize=8544720 CPUtime=0.62 cores=1,3,5,7
/proc/31579/task/31593/stat : 31593 (java) T 31577 31579 31579 0 -1 4202560 6086 0 0 0 62 0 0 0 15 0 19 0 869350856 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31594] ppid=31577 vsize=8544720 CPUtime=0.52 cores=1,3,5,7
/proc/31579/task/31594/stat : 31594 (java) T 31577 31579 31579 0 -1 4202560 3878 0 2 0 52 0 0 0 15 0 19 0 869350856 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31595] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31595/stat : 31595 (java) T 31577 31579 31579 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869350856 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31579/tid=31596] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31596/stat : 31596 (java) T 31577 31579 31579 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869350856 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134530560 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=31579/tid=31597] ppid=31577 vsize=8544720 CPUtime=0 cores=1,3,5,7
/proc/31579/task/31597/stat : 31597 (java) T 31577 31579 31579 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869350868 8749793280 110928 33554432000 1073741824 1073778376 140735403133712 18446744073709551615 228134530560 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=31577/tid=31600] ppid=31550 vsize=324564 CPUtime=0 cores=1,3,5,7
/proc/31577/task/31600/stat : 31600 (python) S 31550 31550 31366 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869355636 332353536 5844 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604454413906048 0 0 -1 7 0 0 0
[pid=31601] ppid=31550 vsize=334820 CPUtime=0.53 cores=1,3,5,7
/proc/31601/stat : 31601 (python) S 31550 31550 31366 0 -1 4202560 1170 0 0 0 27 26 0 0 19 0 2 0 869355638 342855680 5848 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/31601/statm: 83705 5848 397 364 0 18577 0
[pid=31603] ppid=31601 vsize=20908 CPUtime=140.54 cores=1,3,5,7
/proc/31603/stat : 31603 (bsolo_pb10) T 31601 31603 31603 0 -1 4202496 1103 0 0 0 14030 24 0 0 25 0 1 0 869355639 21409792 831 33554432000 134512640 137138936 4293070448 18446744073709551615 136500757 0 0 16781312 16384 18446744071562691360 0 0 17 1 0 0 0
/proc/31603/statm: 5227 831 192 642 0 4583 0
[pid=31601/tid=31616] ppid=31550 vsize=334820 CPUtime=0 cores=1,3,5,7
/proc/31601/task/31616/stat : 31616 (python) S 31550 31550 31366 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 869369695 342855680 5848 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554946 18446604464177230912 0 0 -1 1 0 0 0
[pid=31620] ppid=31550 vsize=344840 CPUtime=0 cores=1,3,5,7
/proc/31620/stat : 31620 (python) S 31550 31550 31366 0 -1 4202560 822 0 0 0 0 0 0 0 15 0 1 0 869379234 353116160 5727 33554432000 4194304 5683644 140737137170960 18446744073709551615 228122734150 0 0 16781312 33554946 4294934790 0 0 17 1 0 0 0
/proc/31620/statm: 86210 5727 349 364 0 21079 0
[pid=31622] ppid=31620 vsize=8543600 CPUtime=1.05 cores=1,3,5,7
/proc/31622/stat : 31622 (java) S 31620 31622 31622 0 -1 4202496 21348 0 1 0 102 3 0 0 20 0 19 0 869379235 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134516709 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/31622/statm: 2135900 17746 2228 9 0 2126641 0
[pid=31622/tid=31623] ppid=31620 vsize=8543600 CPUtime=0.62 cores=1,3,5,7
/proc/31622/task/31623/stat : 31623 (java) R 31620 31622 31622 0 -1 4202560 12169 0 1 0 61 1 0 0 19 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 46912505554526 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=31622/tid=31624] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31624/stat : 31624 (java) S 31620 31622 31622 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 7 0 0 0
[pid=31622/tid=31625] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31625/stat : 31625 (java) S 31620 31622 31622 0 -1 4202560 65 0 0 0 0 0 0 0 19 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 3 0 0 0
[pid=31622/tid=31626] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31626/stat : 31626 (java) S 31620 31622 31622 0 -1 4202560 88 0 0 0 0 0 0 0 20 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31627] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31627/stat : 31627 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 7 0 0 0
[pid=31622/tid=31628] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31628/stat : 31628 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31629] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31629/stat : 31629 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31630] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31630/stat : 31630 (java) S 31620 31622 31622 0 -1 4202560 2 0 0 0 0 0 0 0 21 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 3 0 0 0
[pid=31622/tid=31631] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31631/stat : 31631 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869379236 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31632] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31632/stat : 31632 (java) S 31620 31622 31622 0 -1 4202560 200 0 0 0 0 0 0 0 21 0 19 0 869379238 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134530560 0 0 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31633] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31633/stat : 31633 (java) S 31620 31622 31622 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 19 0 869379238 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31634] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31634/stat : 31634 (java) S 31620 31622 31622 0 -1 4202560 9 0 0 0 0 0 0 0 21 0 19 0 869379238 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31635] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31635/stat : 31635 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869379240 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134537649 0 4 0 16800975 18446604457126648896 0 0 -1 3 0 0 0
[pid=31622/tid=31636] ppid=31620 vsize=8543600 CPUtime=0.21 cores=1,3,5,7
/proc/31622/task/31636/stat : 31636 (java) S 31620 31622 31622 0 -1 4202560 4804 0 0 0 21 0 0 0 16 0 19 0 869379240 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31637] ppid=31620 vsize=8543600 CPUtime=0.17 cores=1,3,5,7
/proc/31622/task/31637/stat : 31637 (java) S 31620 31622 31622 0 -1 4202560 2578 0 0 0 17 0 0 0 16 0 19 0 869379240 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31622/tid=31638] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31638/stat : 31638 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869379240 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134529945 0 4 0 16800975 18446604457126648896 0 0 -1 3 0 0 0
[pid=31622/tid=31639] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31639/stat : 31639 (java) S 31620 31622 31622 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869379240 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134530560 0 4 0 16800975 18446604457126648896 0 0 -1 5 0 0 0
[pid=31622/tid=31640] ppid=31620 vsize=8543600 CPUtime=0 cores=1,3,5,7
/proc/31622/task/31640/stat : 31640 (java) S 31620 31622 31622 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869379248 8748646400 17746 33554432000 1073741824 1073778376 140735834473520 18446744073709551615 228134530560 0 4 0 16800975 18446604457126648896 0 0 -1 1 0 0 0
[pid=31550/tid=31557] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31557/stat : 31557 (python) S 31548 31550 31366 0 -1 4202560 30 933 0 0 0 0 0 0 15 0 8 0 869330211 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
[pid=31550/tid=31562] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31562/stat : 31562 (python) S 31548 31550 31366 0 -1 4202560 28 933 0 0 0 0 0 0 19 0 8 0 869335031 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 3 0 0 0
[pid=31550/tid=31568] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31568/stat : 31568 (python) S 31548 31550 31366 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 8 0 869340576 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 3 0 0 0
[pid=31550/tid=31573] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31573/stat : 31573 (python) S 31548 31550 31366 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 8 0 869345280 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 5 0 0 0
[pid=31550/tid=31578] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31578/stat : 31578 (python) S 31548 31550 31366 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 8 0 869350822 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 5 0 0 0
[pid=31550/tid=31602] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31602/stat : 31602 (python) S 31548 31550 31366 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 869355639 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 7 0 0 0
[pid=31550/tid=31621] ppid=31548 vsize=355084 CPUtime=0 cores=1,3,5,7
/proc/31550/task/31621/stat : 31621 (python) S 31548 31550 31366 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 8 0 869379235 363606016 7265 33554432000 4194304 5683644 140737137170960 18446744073709551615 228134537649 0 0 16781312 33554434 18446604470494312256 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 495.34
Current children cumulated vsize (KiB) 19958568

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31550 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=523920
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=143978
# CPU time returned by wait4() is 0.667898
# while last known CPU time is 495.34
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 491.692
CPU time (s): 495.34
CPU user time (s): 477.01
CPU system time (s): 18.33
CPU usage (%): 100.742
Max. virtual memory (cumulated for all children) (KiB): 19958568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.52392
system time used= 0.143978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15888
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2883
involuntary context switches= 29

runsolver used 3.23451 second user time and 7.03193 second system time

The end

Launcher Data 

Begin job on node138 at 2011-06-09 01:55:21
IDJOB=3481716
IDBENCH=2903
IDSOLVER=1970
FILE ID=node138/3481716-1307577321
RUNJOBID= node138-1307576355-31385
PBS_JOBID= 13547661
Free space on /tmp= 73784 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-market-split_5_40_2.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481716-1307577321/watcher-3481716-1307577321 -o /tmp/evaluation-result-3481716-1307577321/solver-3481716-1307577321 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481716-1307577321.opb -seed 1300517719 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4618b6422bdc12197131d1d37f567363
RANDOM SEED=1300517719

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28401816 kB
Buffers:        137456 kB
Cached:         456564 kB
SwapCached:      13788 kB
Active:        4105292 kB
Inactive:       144284 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28401816 kB
SwapTotal:    67111528 kB
SwapFree:     41082008 kB
Dirty:          101804 kB
Writeback:           0 kB
AnonPages:     3652888 kB
Mapped:          23296 kB
Slab:           134296 kB
PageTables:      98348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 132821672 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73684 MiB
End job on node138 at 2011-06-09 02:03:35