Trace number 3481524

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 773.54 766.795

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_500_25_1.opb
MD5SUM7980660368cd371c40e33d6668082e41
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-65
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -64
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint25
Maximum length of a constraint48
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)15716
Sum of products size (including duplicates)31432
Number of different products7858
Sum of products size15716

Solver Data 

0.36/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.36/0.69	c INFO: solving HOME/instance-3481524-1307578032.opb
0.49/0.80	c INFO: wrote linearized instance to HOME/tmpO7Byno.opb
0.69/0.92	c INFO: parsing took 0.11 s
0.90/1.14	c INFO: features took 0.22 CPU seconds
0.90/1.16	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.22)
50.33/50.43	c INFO: running scip-2.0.1-clp@0 for 45 with 1751 remaining (b = 0.04)
100.78/100.61	c INFO: running wbo1.4a@0 for 45 with 1701 remaining (b = 0.02)
148.49/148.11	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1654 remaining (b = 0.02)
196.97/193.94	c INFO: running scip-2.0.1-spx@47 for 45 with 1607 remaining (b = 0.01)
243.99/240.71	c INFO: running scip-2.0.1-clp@49 for 45 with 1562 remaining (b = 0.01)
287.68/284.21	c INFO: running clasp-1.3.7@0 for 91 with 1519 remaining (b = 0.03)
383.88/380.03	c INFO: running scip-2.0.1-spx@92 for 228 with 1423 remaining (b = 0.05)
630.81/625.80	c INFO: running bsolo_pb10-l3@0 for 45 with 1195 remaining (b = 0.01)
678.41/673.24	c INFO: running scip-2.0.1-clp@92 for 91 with 1147 remaining (b = 0.02)
771.25/765.72	c INFO: running sat4j-pb-v20101225@0 for 91 with 1056 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481524-1307578032/watcher-3481524-1307578032 -o /tmp/evaluation-result-3481524-1307578032/solver-3481524-1307578032 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481524-1307578032.opb -seed 1111090234 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.96 2.05 1.68 2/540 32122
/proc/meminfo: memFree=28620016/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=16236 CPUtime=0 cores=1,3,5,7
/proc/32122/stat : 32122 (python) R 32120 32122 31366 0 -1 4202496 1040 0 0 0 0 0 0 0 17 0 1 0 869401209 16625664 911 33554432000 4194304 5683644 140735054027696 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32122/statm: 4059 911 380 364 0 546 0

[startup+0.102611 s]
/proc/loadavg: 1.96 2.05 1.68 2/540 32122
/proc/meminfo: memFree=28620016/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=87828 CPUtime=0.06 cores=1,3,5,7
/proc/32122/stat : 32122 (python) R 32120 32122 31366 0 -1 4202496 2690 0 0 0 4 2 0 0 17 0 1 0 869401209 89935872 2405 33554432000 4194304 5683644 140735054027696 18446744073709551615 4510876 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32122/statm: 21957 2405 733 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87828

[startup+0.200588 s]
/proc/loadavg: 1.96 2.05 1.68 2/540 32122
/proc/meminfo: memFree=28620016/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=117900 CPUtime=0.13 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 4923 929 1 0 9 4 0 0 17 0 1 0 869401209 120729600 3346 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/32122/statm: 29475 3346 916 364 0 2445 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 117900

[startup+0.300544 s]
/proc/loadavg: 1.96 2.05 1.68 2/540 32122
/proc/meminfo: memFree=28620016/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=123740 CPUtime=0.17 cores=1,3,5,7
/proc/32122/stat : 32122 (python) R 32120 32122 31366 0 -1 4202496 5358 929 1 0 10 7 0 0 16 0 1 0 869401209 126709760 3744 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122710021 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/32122/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123740

[startup+0.718426 s]
/proc/loadavg: 1.96 2.05 1.68 2/540 32122
/proc/meminfo: memFree=28620016/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=282532 CPUtime=0.43 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 9214 929 1 0 28 15 0 0 15 0 1 0 869401209 289312768 6944 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734095 0 0 16781312 2 2579553672895660032 0 0 17 5 0 0 0
/proc/32122/statm: 70633 6944 1777 364 0 5526 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 282532

[startup+1.50029 s]
/proc/loadavg: 1.96 2.05 1.68 3/541 32128
/proc/meminfo: memFree=28589124/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=297340 CPUtime=0.96 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 12714 1388 1 0 64 22 7 3 18 0 2 0 869401209 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 74335 8175 1871 364 0 9222 0
Current children cumulated CPU time (s) 0.96
Current children cumulated vsize (KiB) 297340

[startup+3.10104 s]
/proc/loadavg: 1.96 2.05 1.68 3/544 32131
/proc/meminfo: memFree=28530572/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=297340 CPUtime=0.96 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 12714 1388 1 0 64 22 7 3 18 0 2 0 869401209 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 74335 8175 1871 364 0 9222 0
[pid=32129] ppid=32122 vsize=287096 CPUtime=0 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 1 0 869401326 293986304 6619 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734095 0 0 16781312 33554946 4171136117476687872 0 0 17 5 0 0 0
/proc/32129/statm: 71774 6619 319 364 0 6661 0
[pid=32131] ppid=32129 vsize=68836 CPUtime=1.91 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) R 32129 32131 32131 0 -1 4202496 15827 0 0 0 174 17 0 0 20 0 1 0 869401326 70488064 14890 33554432000 4194304 13684479 140736438712288 18446744073709551615 6054263 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32131/statm: 17209 14890 756 2317 0 14887 0
[pid=32122/tid=32130] ppid=32120 vsize=297340 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 2 0 869401326 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.87
Current children cumulated vsize (KiB) 653272

[startup+6.30045 s]
/proc/loadavg: 2.04 2.07 1.69 3/544 32131
/proc/meminfo: memFree=28500068/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=297340 CPUtime=0.96 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 12714 1388 1 0 64 22 7 3 18 0 2 0 869401209 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 74335 8175 1871 364 0 9222 0
[pid=32129] ppid=32122 vsize=287096 CPUtime=0.03 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 895 0 0 0 2 1 0 0 15 0 1 0 869401326 293986304 6643 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734095 0 0 16781312 33554946 157243842242805760 0 0 17 5 0 0 0
/proc/32129/statm: 71774 6643 343 364 0 6661 0
[pid=32131] ppid=32129 vsize=89408 CPUtime=5.1 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) R 32129 32131 32131 0 -1 4202496 21622 0 0 0 484 26 0 0 21 0 1 0 869401326 91553792 19898 33554432000 4194304 13684479 140736438712288 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32131/statm: 22352 19898 766 2317 0 20030 0
[pid=32122/tid=32130] ppid=32120 vsize=297340 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 2 0 869401326 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.09
Current children cumulated vsize (KiB) 673844

[startup+12.7003 s]
/proc/loadavg: 2.04 2.06 1.69 3/544 32131
/proc/meminfo: memFree=28473068/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=297340 CPUtime=0.96 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 12714 1388 1 0 64 22 7 3 18 0 2 0 869401209 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 74335 8175 1871 364 0 9222 0
[pid=32129] ppid=32122 vsize=287096 CPUtime=0.07 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 914 0 0 0 5 2 0 0 15 0 1 0 869401326 293986304 6643 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734095 0 0 16781312 33554946 1861647578676854784 0 0 17 5 0 0 0
/proc/32129/statm: 71774 6643 343 364 0 6661 0
[pid=32131] ppid=32129 vsize=107116 CPUtime=11.47 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) R 32129 32131 32131 0 -1 4202496 26043 0 0 0 1102 45 0 0 25 0 1 0 869401326 109686784 24232 33554432000 4194304 13684479 140736438712288 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32131/statm: 26779 24232 759 2317 0 24457 0
[pid=32122/tid=32130] ppid=32120 vsize=297340 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 2 0 869401326 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.5
Current children cumulated vsize (KiB) 691552

[startup+25.501 s]
/proc/loadavg: 2.03 2.06 1.70 3/544 32131
/proc/meminfo: memFree=28421964/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=297340 CPUtime=0.96 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 12714 1388 1 0 64 22 7 3 18 0 2 0 869401209 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 74335 8175 1871 364 0 9222 0
[pid=32129] ppid=32122 vsize=287096 CPUtime=0.16 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 932 0 0 0 10 6 0 0 16 0 1 0 869401326 293986304 6643 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734095 0 0 16781312 33554946 4294934791 0 0 17 5 0 0 0
/proc/32129/statm: 71774 6643 343 364 0 6661 0
[pid=32131] ppid=32129 vsize=117056 CPUtime=24.23 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) R 32129 32131 32131 0 -1 4202496 28610 0 0 0 2352 71 0 0 25 0 1 0 869401326 119865344 26732 33554432000 4194304 13684479 140736438712288 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32131/statm: 29264 26732 759 2317 0 26942 0
[pid=32122/tid=32130] ppid=32120 vsize=297340 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 2 0 869401326 304476160 8175 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 701492

[startup+51.1013 s]
/proc/loadavg: 2.03 2.05 1.70 3/540 32232
/proc/meminfo: memFree=28291544/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=307596 CPUtime=0.99 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 13605 1388 1 0 67 22 7 3 20 0 3 0 869401209 314978304 8182 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 76899 8182 1874 364 0 11783 0
[pid=32129] ppid=32122 vsize=297340 CPUtime=0.31 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 1142 0 0 0 18 13 0 0 17 0 2 0 869401326 304476160 6711 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/32129/statm: 74335 6711 406 364 0 9222 0
[pid=32131] ppid=32129 vsize=117368 CPUtime=49.08 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) T 32129 32131 32131 0 -1 4202496 29388 0 0 0 4790 118 0 0 25 0 1 0 869401326 120184832 26866 33554432000 4194304 13684479 140736438712288 18446744073709551615 7361327 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/32131/statm: 29342 26866 780 2317 0 27020 0
[pid=32129/tid=32229] ppid=32122 vsize=297340 CPUtime=0 cores=1,3,5,7
/proc/32129/task/32229/stat : 32229 (python) S 32122 32122 31366 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869406250 304476160 6711 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604465113292928 0 0 -1 5 0 0 0
[pid=32230] ppid=32122 vsize=297352 CPUtime=0 cores=1,3,5,7
/proc/32230/stat : 32230 (python) S 32122 32122 31366 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 869406252 304488448 6624 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734150 0 0 16781312 33554946 4095027359961317376 0 0 17 5 0 0 0
/proc/32230/statm: 74338 6624 320 364 0 9222 0
[pid=32232] ppid=32230 vsize=64168 CPUtime=0.65 cores=1,3,5,7
/proc/32232/stat : 32232 (scip-2.0.1.linu) R 32230 32232 32232 0 -1 4202496 13425 0 0 0 53 12 0 0 18 0 1 0 869406252 65708032 12779 33554432000 4194304 15243407 140737227981072 18446744073709551615 13277498 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/32232/statm: 16042 12779 851 2698 0 13337 0
[pid=32122/tid=32130] ppid=32120 vsize=307596 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 3 0 869401326 314978304 8182 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=32231] ppid=32120 vsize=307596 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32231/stat : 32231 (python) S 32120 32122 31366 0 -1 4202560 30 1388 0 0 0 0 7 3 20 0 3 0 869406252 314978304 8182 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 1083824

[startup+102.301 s]
/proc/loadavg: 2.22 2.12 1.74 3/544 32274
/proc/meminfo: memFree=28148452/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=317852 CPUtime=1.01 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 14477 1388 1 0 69 22 7 3 20 0 4 0 869401209 325480448 8188 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/32122/statm: 79463 8188 1876 364 0 14344 0
[pid=32129] ppid=32122 vsize=297340 CPUtime=0.31 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 1142 0 0 0 18 13 0 0 17 0 2 0 869401326 304476160 6711 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/32129/statm: 74335 6711 406 364 0 9222 0
[pid=32131] ppid=32129 vsize=117368 CPUtime=49.08 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) T 32129 32131 32131 0 -1 4202496 29388 0 0 0 4790 118 0 0 25 0 1 0 869401326 120184832 26866 33554432000 4194304 13684479 140736438712288 18446744073709551615 7361327 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/32131/statm: 29342 26866 780 2317 0 27020 0
[pid=32129/tid=32229] ppid=32122 vsize=297340 CPUtime=0 cores=1,3,5,7
/proc/32129/task/32229/stat : 32229 (python) S 32122 32122 31366 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869406250 304476160 6711 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604465113292928 0 0 -1 5 0 0 0
[pid=32230] ppid=32122 vsize=297352 CPUtime=0.24 cores=1,3,5,7
/proc/32230/stat : 32230 (python) S 32122 32122 31366 0 -1 4202560 1199 0 0 0 12 12 0 0 16 0 2 0 869406252 304488448 6702 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/32230/statm: 74338 6702 397 364 0 9222 0
[pid=32232] ppid=32230 vsize=105724 CPUtime=50.15 cores=1,3,5,7
/proc/32232/stat : 32232 (scip-2.0.1.linu) T 32230 32232 32232 0 -1 4202496 24434 0 0 0 4973 42 0 0 19 0 1 0 869406252 108261376 22814 33554432000 4194304 15243407 140737227981072 18446744073709551615 8113823 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/32232/statm: 26431 22814 891 2698 0 23726 0
[pid=32230/tid=32270] ppid=32122 vsize=297352 CPUtime=0 cores=1,3,5,7
/proc/32230/task/32270/stat : 32270 (python) S 32122 32122 31366 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869411268 304488448 6702 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604457126647104 0 0 -1 7 0 0 0
[pid=32271] ppid=32122 vsize=307608 CPUtime=0 cores=1,3,5,7
/proc/32271/stat : 32271 (python) S 32122 32122 31366 0 -1 4202560 870 0 0 0 0 0 0 0 18 0 1 0 869411270 314990592 6635 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734150 0 0 16781312 33554946 4490585777679335685 0 0 17 5 0 0 0
/proc/32271/statm: 76902 6635 327 364 0 11783 0
[pid=32273] ppid=32271 vsize=43896 CPUtime=1.7 cores=1,3,5,7
/proc/32273/stat : 32273 (wbo1.4a) R 32271 32273 32273 0 -1 4202496 11134 0 0 0 168 2 0 0 25 0 1 0 869411270 44949504 10493 33554432000 134512640 135751879 4287046352 18446744073709551615 135221296 0 0 16781312 3 0 0 0 17 1 0 0 0
/proc/32273/statm: 10974 10493 143 303 0 10669 0
[pid=32122/tid=32130] ppid=32120 vsize=317852 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 28 1388 0 0 0 0 7 3 18 0 4 0 869401326 325480448 8188 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=32231] ppid=32120 vsize=317852 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32231/stat : 32231 (python) S 32120 32122 31366 0 -1 4202560 30 1388 0 0 0 0 7 3 20 0 4 0 869406252 325480448 8188 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0

################
# More data... #
################


Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+766.702 s]
/proc/loadavg: 2.14 2.12 1.93 4/684 694
/proc/meminfo: memFree=22049264/32951124 swapFree=41082008/67111528
[pid=32122] ppid=32120 vsize=358876 CPUtime=1.19 cores=1,3,5,7
/proc/32122/stat : 32122 (python) S 32120 32122 31366 0 -1 4202496 18271 1388 1 0 86 23 7 3 20 0 8 0 869401209 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/32122/statm: 89719 8212 1884 364 0 24588 0
[pid=674] ppid=32122 vsize=348632 CPUtime=0 cores=1,3,5,7
/proc/674/stat : 674 (python) S 32122 32122 31366 0 -1 4202560 831 0 0 0 0 0 0 0 15 0 1 0 869477781 356999168 6644 33554432000 4194304 5683644 140735054027696 18446744073709551615 228122734150 0 0 16781312 33554946 4294934789 0 0 17 1 0 0 0
/proc/674/statm: 87158 6644 320 364 0 22027 0
[pid=676] ppid=674 vsize=8550424 CPUtime=2.17 cores=1,3,5,7
/proc/676/stat : 676 (java) S 674 676 676 0 -1 4202496 33796 0 1 0 211 6 0 0 17 0 19 0 869477781 8755634176 29701 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134516709 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/676/statm: 2137606 29701 2234 9 0 2128347 0
[pid=676/tid=677] ppid=674 vsize=8550424 CPUtime=0.99 cores=1,3,5,7
/proc/676/task/677/stat : 677 (java) R 674 676 676 0 -1 4202560 22445 0 1 0 95 4 0 0 25 0 19 0 869477782 8755634176 30234 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 46912505830593 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=676/tid=678] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/678/stat : 678 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869477783 8755634176 30235 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=679] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/679/stat : 679 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869477783 8755634176 30235 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 7 0 0 0
[pid=676/tid=680] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/680/stat : 680 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869477783 8755634176 30237 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 7 0 0 0
[pid=676/tid=681] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/681/stat : 681 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869477783 8755634176 30240 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 7 0 0 0
[pid=676/tid=682] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/682/stat : 682 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869477783 8755634176 30241 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 7 0 0 0
[pid=676/tid=683] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/683/stat : 683 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869477783 8755634176 30241 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 1 0 0 0
[pid=676/tid=684] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/684/stat : 684 (java) S 674 676 676 0 -1 4202560 2 0 0 0 0 0 0 0 21 0 19 0 869477783 8755634176 30243 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 1 0 0 0
[pid=676/tid=685] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/685/stat : 685 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869477783 8755634176 30244 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 7 0 0 0
[pid=676/tid=686] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/686/stat : 686 (java) S 674 676 676 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869477784 8755634176 30245 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134530560 0 0 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=687] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/687/stat : 687 (java) S 674 676 676 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 19 0 869477784 8755634176 30247 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=688] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/688/stat : 688 (java) S 674 676 676 0 -1 4202560 7 0 0 0 0 0 0 0 21 0 19 0 869477784 8755634176 30249 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=689] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/689/stat : 689 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869477787 8755634176 30249 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134537649 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=690] ppid=674 vsize=8550424 CPUtime=0.6 cores=1,3,5,7
/proc/676/task/690/stat : 690 (java) S 674 676 676 0 -1 4202560 4338 0 0 0 60 0 0 0 17 0 19 0 869477787 8755634176 30249 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=691] ppid=674 vsize=8550424 CPUtime=0.57 cores=1,3,5,7
/proc/676/task/691/stat : 691 (java) S 674 676 676 0 -1 4202560 6134 0 0 0 57 0 0 0 24 0 19 0 869477787 8755634176 30251 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=692] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/692/stat : 692 (java) S 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869477787 8755634176 30251 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134529945 0 4 0 16800975 18446604468003736640 0 0 -1 5 0 0 0
[pid=676/tid=693] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/693/stat : 693 (java) R 674 676 676 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 869477787 8755634176 30252 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134530560 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=676/tid=694] ppid=674 vsize=8550424 CPUtime=0 cores=1,3,5,7
/proc/676/task/694/stat : 694 (java) S 674 676 676 0 -1 4202560 11 0 0 0 0 0 0 0 25 0 19 0 869477839 8755634176 30252 33554432000 1073741824 1073778376 140736568316768 18446744073709551615 228134530560 0 4 0 16800975 18446604468003736640 0 0 -1 1 0 0 0
[pid=32129] ppid=32122 vsize=297340 CPUtime=1.68 cores=1,3,5,7
/proc/32129/stat : 32129 (python) S 32122 32122 31366 0 -1 4202560 1211 0 0 0 86 82 0 0 16 0 2 0 869401326 304476160 6713 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/32129/statm: 74335 6713 408 364 0 9222 0
[pid=32131] ppid=32129 vsize=158180 CPUtime=341.56 cores=1,3,5,7
/proc/32131/stat : 32131 (scip-2.0.1.linu) T 32129 32131 32131 0 -1 4202496 56819 0 0 0 32078 2078 0 0 20 0 1 0 869401326 161976320 37051 33554432000 4194304 13684479 140736438712288 18446744073709551615 7342375 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/32131/statm: 39545 37051 802 2317 0 37223 0
[pid=32129/tid=32229] ppid=32122 vsize=297340 CPUtime=0 cores=1,3,5,7
/proc/32129/task/32229/stat : 32229 (python) S 32122 32122 31366 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869406250 304476160 6713 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604465113292928 0 0 -1 5 0 0 0
[pid=32230] ppid=32122 vsize=297352 CPUtime=0.9 cores=1,3,5,7
/proc/32230/stat : 32230 (python) S 32122 32122 31366 0 -1 4202560 1284 0 0 0 45 45 0 0 15 0 2 0 869406252 304488448 6703 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/32230/statm: 74338 6703 398 364 0 9222 0
[pid=32232] ppid=32230 vsize=119704 CPUtime=186.08 cores=1,3,5,7
/proc/32232/stat : 32232 (scip-2.0.1.linu) T 32230 32232 32232 0 -1 4202496 67203 0 0 0 18383 225 0 0 18 0 1 0 869406252 122576896 27137 33554432000 4194304 15243407 140737227981072 18446744073709551615 7469085 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/32232/statm: 29926 27137 925 2698 0 27221 0
[pid=32230/tid=32270] ppid=32122 vsize=297352 CPUtime=0 cores=1,3,5,7
/proc/32230/task/32270/stat : 32270 (python) S 32122 32122 31366 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 869411268 304488448 6703 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604457126647104 0 0 -1 7 0 0 0
[pid=32271] ppid=32122 vsize=307608 CPUtime=0.22 cores=1,3,5,7
/proc/32271/stat : 32271 (python) S 32122 32122 31366 0 -1 4202560 1204 0 0 0 10 12 0 0 17 0 2 0 869411270 314990592 6706 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/32271/statm: 76902 6706 397 364 0 11783 0
[pid=32273] ppid=32271 vsize=221740 CPUtime=47.47 cores=1,3,5,7
/proc/32273/stat : 32273 (wbo1.4a) T 32271 32273 32273 0 -1 4202496 56012 0 0 0 4684 63 0 0 25 0 1 0 869411270 227061760 54919 33554432000 134512640 135751879 4287046352 18446744073709551615 134616514 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/32273/statm: 55435 54919 146 303 0 55130 0
[pid=32271/tid=32298] ppid=32122 vsize=307608 CPUtime=0 cores=1,3,5,7
/proc/32271/task/32298/stat : 32298 (python) S 32122 32122 31366 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869416018 314990592 6706 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604459253970880 0 0 -1 7 0 0 0
[pid=32299] ppid=32122 vsize=317864 CPUtime=0.19 cores=1,3,5,7
/proc/32299/stat : 32299 (python) S 32122 32122 31366 0 -1 4202560 1143 0 0 0 8 11 0 0 16 0 2 0 869416021 325492736 6704 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/32299/statm: 79466 6704 391 364 0 14344 0
[pid=32301] ppid=32299 vsize=8542836 CPUtime=48.31 cores=1,3,5,7
/proc/32301/stat : 32301 (java) T 32299 32301 32301 0 -1 4202496 571506 0 1 0 4769 62 0 0 18 0 19 0 869416021 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134516709 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/32301/statm: 2135709 554793 2250 9 0 2126450 0
[pid=32301/tid=32302] ppid=32299 vsize=8542836 CPUtime=45.43 cores=1,3,5,7
/proc/32301/task/32302/stat : 32302 (java) T 32299 32301 32301 0 -1 4202560 474830 0 1 0 4496 47 0 0 25 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 46912506011542 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32303] ppid=32299 vsize=8542836 CPUtime=0.1 cores=1,3,5,7
/proc/32301/task/32303/stat : 32303 (java) T 32299 32301 32301 0 -1 4202560 9769 0 0 0 9 1 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=32301/tid=32304] ppid=32299 vsize=8542836 CPUtime=0.13 cores=1,3,5,7
/proc/32301/task/32304/stat : 32304 (java) T 32299 32301 32301 0 -1 4202560 11405 0 0 0 12 1 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=32301/tid=32305] ppid=32299 vsize=8542836 CPUtime=0.14 cores=1,3,5,7
/proc/32301/task/32305/stat : 32305 (java) T 32299 32301 32301 0 -1 4202560 11579 0 0 0 12 2 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=32301/tid=32306] ppid=32299 vsize=8542836 CPUtime=0.18 cores=1,3,5,7
/proc/32301/task/32306/stat : 32306 (java) T 32299 32301 32301 0 -1 4202560 15042 0 0 0 16 2 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=32301/tid=32307] ppid=32299 vsize=8542836 CPUtime=0.08 cores=1,3,5,7
/proc/32301/task/32307/stat : 32307 (java) T 32299 32301 32301 0 -1 4202560 6401 0 0 0 8 0 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=32301/tid=32308] ppid=32299 vsize=8542836 CPUtime=0.03 cores=1,3,5,7
/proc/32301/task/32308/stat : 32308 (java) T 32299 32301 32301 0 -1 4202560 2415 0 0 0 3 0 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=32301/tid=32309] ppid=32299 vsize=8542836 CPUtime=0.15 cores=1,3,5,7
/proc/32301/task/32309/stat : 32309 (java) T 32299 32301 32301 0 -1 4202560 12630 0 0 0 14 1 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=32301/tid=32310] ppid=32299 vsize=8542836 CPUtime=0.16 cores=1,3,5,7
/proc/32301/task/32310/stat : 32310 (java) T 32299 32301 32301 0 -1 4202560 13282 0 0 0 15 1 0 0 15 0 19 0 869416022 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32311] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32311/stat : 32311 (java) T 32299 32301 32301 0 -1 4202560 990 0 0 0 0 0 0 0 15 0 19 0 869416023 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134530560 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32312] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32312/stat : 32312 (java) T 32299 32301 32301 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869416024 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32313] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32313/stat : 32313 (java) T 32299 32301 32301 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869416024 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32314] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32314/stat : 32314 (java) T 32299 32301 32301 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869416026 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134537649 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32315] ppid=32299 vsize=8542836 CPUtime=1.04 cores=1,3,5,7
/proc/32301/task/32315/stat : 32315 (java) T 32299 32301 32301 0 -1 4202560 5363 0 0 0 103 1 0 0 15 0 19 0 869416026 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=32301/tid=32316] ppid=32299 vsize=8542836 CPUtime=0.77 cores=1,3,5,7
/proc/32301/task/32316/stat : 32316 (java) T 32299 32301 32301 0 -1 4202560 6402 0 0 0 76 1 0 0 15 0 19 0 869416026 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=32301/tid=32317] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32317/stat : 32317 (java) T 32299 32301 32301 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869416026 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134529945 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32301/tid=32318] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32318/stat : 32318 (java) T 32299 32301 32301 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869416026 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134530560 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=32301/tid=32319] ppid=32299 vsize=8542836 CPUtime=0 cores=1,3,5,7
/proc/32301/task/32319/stat : 32319 (java) T 32299 32301 32301 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869416079 8747864064 554793 33554432000 1073741824 1073778376 140737001682032 18446744073709551615 228134530560 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=32299/tid=32325] ppid=32122 vsize=317864 CPUtime=0 cores=1,3,5,7
/proc/32299/task/32325/stat : 32325 (python) S 32122 32122 31366 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869420601 325492736 6704 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604459895310464 0 0 -1 1 0 0 0
[pid=32392] ppid=32122 vsize=328120 CPUtime=0.39 cores=1,3,5,7
/proc/32392/stat : 32392 (python) S 32122 32122 31366 0 -1 4202560 1185 0 0 0 18 21 0 0 16 0 2 0 869429630 335994880 6708 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/32392/statm: 82030 6708 391 364 0 16905 0
[pid=32394] ppid=32392 vsize=8292 CPUtime=95.79 cores=1,3,5,7
/proc/32394/stat : 32394 (clasp-1.3.7-x86) T 32392 32394 32394 0 -1 4202496 2218 0 0 0 9579 0 0 0 25 0 1 0 869429630 8491008 1816 33554432000 134512640 136139019 4289771152 18446744073709551615 134599797 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/32394/statm: 2073 1816 187 398 0 1673 0
[pid=32392/tid=32480] ppid=32122 vsize=328120 CPUtime=0 cores=1,3,5,7
/proc/32392/task/32480/stat : 32480 (python) S 32122 32122 31366 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869439210 335994880 6708 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604467459995840 0 0 -1 1 0 0 0
[pid=32635] ppid=32122 vsize=338376 CPUtime=0.2 cores=1,3,5,7
/proc/32635/stat : 32635 (python) S 32122 32122 31366 0 -1 4202560 1166 0 0 0 9 11 0 0 17 0 2 0 869463790 346497024 6712 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134540747 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/32635/statm: 84594 6712 391 364 0 19466 0
[pid=32637] ppid=32635 vsize=85668 CPUtime=47.39 cores=1,3,5,7
/proc/32637/stat : 32637 (bsolo_pb10) T 32635 32637 32637 0 -1 4202496 19400 0 0 0 4734 5 0 0 25 0 1 0 869463790 87724032 18968 33554432000 134512640 137138936 4289219120 18446744073709551615 134542516 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/32637/statm: 21417 18968 192 642 0 20773 0
[pid=32635/tid=345] ppid=32122 vsize=338376 CPUtime=0 cores=1,3,5,7
/proc/32635/task/345/stat : 345 (python) S 32122 32122 31366 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869468531 346497024 6712 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554946 18446604470494312256 0 0 -1 5 0 0 0
[pid=32122/tid=32130] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32130/stat : 32130 (python) S 32120 32122 31366 0 -1 4202560 40 1388 0 0 0 0 7 3 18 0 8 0 869401326 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=32231] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32231/stat : 32231 (python) S 32120 32122 31366 0 -1 4202560 40 1388 0 0 0 0 7 3 18 0 8 0 869406252 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=32272] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32272/stat : 32272 (python) S 32120 32122 31366 0 -1 4202560 30 1388 0 0 0 0 7 3 20 0 8 0 869411270 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 1 0 0 0
[pid=32122/tid=32300] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32300/stat : 32300 (python) S 32120 32122 31366 0 -1 4202560 25 1388 0 0 0 0 7 3 20 0 8 0 869416021 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 1 0 0 0
[pid=32122/tid=32393] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32393/stat : 32393 (python) S 32120 32122 31366 0 -1 4202560 33 1388 0 0 0 0 7 3 20 0 8 0 869429630 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=32636] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/32636/stat : 32636 (python) S 32120 32122 31366 0 -1 4202560 30 1388 0 0 0 0 7 3 20 0 8 0 869463790 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
[pid=32122/tid=675] ppid=32120 vsize=358876 CPUtime=0.1 cores=1,3,5,7
/proc/32122/task/675/stat : 675 (python) S 32120 32122 31366 0 -1 4202560 32 1388 0 0 0 0 7 3 20 0 8 0 869477781 367489024 8212 33554432000 4194304 5683644 140735054027696 18446744073709551615 228134537649 0 0 16781312 33554434 18446604457126648896 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 773.54
Current children cumulated vsize (KiB) 20281012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32122 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=946856
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=272958
# CPU time returned by wait4() is 1.21981
# while last known CPU time is 773.54
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 766.795
CPU time (s): 773.54
CPU user time (s): 747.07
CPU system time (s): 26.47
CPU usage (%): 100.88
Max. virtual memory (cumulated for all children) (KiB): 20281012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.946856
system time used= 0.272958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19664
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8792
involuntary context switches= 27

runsolver used 5.46617 second user time and 12.8061 second system time

The end

Launcher Data 

Begin job on node138 at 2011-06-09 02:07:12
IDJOB=3481524
IDBENCH=48191
IDSOLVER=1970
FILE ID=node138/3481524-1307578032
RUNJOBID= node138-1307576355-31385
PBS_JOBID= 13547661
Free space on /tmp= 73712 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_500_25_1.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481524-1307578032/watcher-3481524-1307578032 -o /tmp/evaluation-result-3481524-1307578032/solver-3481524-1307578032 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481524-1307578032.opb -seed 1111090234 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7980660368cd371c40e33d6668082e41
RANDOM SEED=1111090234

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28620172 kB
Buffers:        148216 kB
Cached:         545544 kB
SwapCached:      13788 kB
Active:        3878952 kB
Inactive:       148204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28620172 kB
SwapTotal:    67111528 kB
SwapFree:     41082008 kB
Dirty:          101588 kB
Writeback:           0 kB
AnonPages:     3331248 kB
Mapped:          54272 kB
Slab:           134944 kB
PageTables:      99548 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 133477220 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73404 MiB
End job on node138 at 2011-06-09 02:20:01