Trace number 3481926

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 197.81 214.482

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-seymour.opb
MD5SUM97ebaccbda37d5c570b4e2ec3cd7f8f0
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark425
Best CPU time to get the best result obtained on this benchmark1797.08
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 425
Optimality of the best value was proved NO
Number of variables1372
Total number of constraints4944
Number of constraints which are clauses4944
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint19
Number of terms in the objective function 1372
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1372
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1372
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.55/18.57	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.55/18.57	c INFO: solving HOME/instance-3481926-1307576357.opb
0.62/18.63	c INFO: parsing took 0.06 s
0.73/18.74	c INFO: features took 0.11 CPU seconds
0.73/18.79	c INFO: running sat4j-pb-v20101225@0 for 45 with 1799 remaining (b = 0.40)
49.48/66.85	c INFO: running scip-2.0.1-spx@0 for 45 with 1750 remaining (b = 0.16)
96.19/113.56	c INFO: running wbo1.4a@0 for 45 with 1705 remaining (b = 0.03)
145.99/163.16	c INFO: running scip-2.0.1-clp@0 for 45 with 1656 remaining (b = 0.02)
197.09/214.01	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1605 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481926-1307576357/watcher-3481926-1307576357 -o /tmp/evaluation-result-3481926-1307576357/solver-3481926-1307576357 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481926-1307576357.opb -seed 611056974 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.44 0.10 0.03 3/452 23088
/proc/meminfo: memFree=32103888/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (runsolver) S 23084 23086 23050 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 1 0 869235990 12079104 54 33554432000 4194304 5432328 140734321300384 18446744073709551615 5055479 0 2147483391 4096 24578 18446744071699469502 0 0 17 1 0 0 0
/proc/23086/statm: 2949 54 34 303 0 2643 0

[startup+0.038667 s]
/proc/loadavg: 0.44 0.10 0.03 3/452 23088
/proc/meminfo: memFree=32103888/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (runsolver) S 23084 23086 23050 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 1 0 869235990 12079104 54 33554432000 4194304 5432328 140734321300384 18446744073709551615 5055479 0 2147483391 4096 24578 18446744071699469502 0 0 17 7 0 0 0
/proc/23086/statm: 2949 54 34 303 0 2643 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11796

[startup+0.100619 s]
/proc/loadavg: 0.44 0.10 0.03 3/452 23088
/proc/meminfo: memFree=32103888/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=1964 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (python) D 23084 23086 23050 0 -1 4194304 75 0 1 0 0 0 0 0 17 0 1 0 869235990 2011136 29 33554432000 4194304 5683644 140734696092992 18446744073709551615 271545615376 0 0 4096 0 18446744071562234166 0 0 17 1 0 0 3
/proc/23086/statm: 491 29 21 364 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1964

[startup+0.300618 s]
/proc/loadavg: 0.44 0.10 0.03 3/452 23088
/proc/meminfo: memFree=32103888/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 608 0 6 0 0 0 0 0 17 0 1 0 869235990 15441920 511 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550533477 0 2147483391 16781312 2 18446744071699469502 0 0 17 7 0 0 14
/proc/23086/statm: 3770 511 298 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.700548 s]
/proc/loadavg: 0.44 0.10 0.03 3/452 23088
/proc/meminfo: memFree=32103888/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=15216 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (python) D 23084 23086 23050 0 -1 4202496 648 0 6 0 0 0 0 0 15 0 1 0 869235990 15581184 550 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550537472 0 0 16781312 2 18446744071562234166 0 0 17 7 0 0 15
/proc/23086/statm: 3804 550 312 364 0 291 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15216

[startup+1.50043 s]
/proc/loadavg: 0.44 0.10 0.03 2/454 23090
/proc/meminfo: memFree=32100500/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 889 0 6 0 0 0 0 0 15 0 1 0 869235990 16158720 777 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 7 0 0 48
/proc/23086/statm: 3945 777 343 364 0 432 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15780

[startup+3.10114 s]
/proc/loadavg: 0.44 0.10 0.03 1/454 23090
/proc/meminfo: memFree=32097180/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=16400 CPUtime=0.01 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 1111 0 6 0 1 0 0 0 16 0 1 0 869235990 16793600 985 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 7 0 0 97
/proc/23086/statm: 4100 985 409 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400
heavy processes:

[startup+6.30054 s]
/proc/loadavg: 0.49 0.11 0.04 1/454 23090
/proc/meminfo: memFree=32093760/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=20984 CPUtime=0.03 cores=1,3,5,7
/proc/23086/stat : 23086 (python) D 23084 23086 23050 0 -1 4202496 1293 0 8 0 3 0 0 0 16 0 1 0 869235990 21487616 1153 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550537472 0 0 16781312 2 18446744071562234166 0 0 17 7 0 0 142
/proc/23086/statm: 5246 1153 428 364 0 693 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 20984
heavy processes:

[startup+12.7003 s]
/proc/loadavg: 0.53 0.13 0.04 1/454 23098
/proc/meminfo: memFree=32069360/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=123744 CPUtime=0.24 cores=1,3,5,7
/proc/23086/stat : 23086 (python) D 23084 23086 23050 0 -1 4202496 5318 921 39 9 16 8 0 0 15 0 1 0 869235990 126713856 3744 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550533637 0 0 16781312 2 0 0 0 17 7 0 0 264
/proc/23086/statm: 30936 3744 987 364 0 2768 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 123744
heavy processes:

[startup+25.501 s]
/proc/loadavg: 0.64 0.17 0.06 3/478 23122
/proc/meminfo: memFree=31614396/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=294888 CPUtime=0.78 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 10172 921 114 9 57 21 0 0 18 0 2 0 869235990 301965312 7579 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 368
/proc/23086/statm: 73722 7579 1870 364 0 8609 0
[pid=23099] ppid=23086 vsize=284644 CPUtime=0.01 cores=1,3,5,7
/proc/23099/stat : 23099 (python) S 23086 23086 23050 0 -1 4202560 891 0 0 0 0 1 0 0 15 0 1 0 869237869 291475456 6081 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550557711 0 0 16781312 33554946 3888072513967620096 0 0 17 3 0 0 0
/proc/23099/statm: 71161 6081 376 364 0 6048 0
[pid=23101] ppid=23099 vsize=8541804 CPUtime=7.08 cores=1,3,5,7
/proc/23101/stat : 23101 (java) S 23099 23101 23101 0 -1 4202496 26725 0 111 0 704 4 0 0 18 0 19 0 869237869 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 8
/proc/23101/statm: 2135451 24777 2255 9 0 2126192 0
[pid=23101/tid=23102] ppid=23099 vsize=8541804 CPUtime=6.22 cores=1,3,5,7
/proc/23101/task/23102/stat : 23102 (java) R 23099 23101 23101 0 -1 4202560 11082 0 54 0 621 1 0 0 25 0 19 0 869237881 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 46912505740164 0 4 0 16800975 0 0 0 -1 3 0 0 19
[pid=23101/tid=23103] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23103/stat : 23103 (java) S 23099 23101 23101 0 -1 4202560 696 0 0 0 0 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23104] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23104/stat : 23104 (java) S 23099 23101 23101 0 -1 4202560 774 0 0 0 0 0 0 0 16 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23105] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23105/stat : 23105 (java) S 23099 23101 23101 0 -1 4202560 813 0 0 0 0 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23106] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23106/stat : 23106 (java) S 23099 23101 23101 0 -1 4202560 172 0 0 0 0 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23107] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23107/stat : 23107 (java) S 23099 23101 23101 0 -1 4202560 445 0 0 0 0 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 3 0 0 0
[pid=23101/tid=23108] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23108/stat : 23108 (java) S 23099 23101 23101 0 -1 4202560 530 0 0 0 0 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23109] ppid=23099 vsize=8541804 CPUtime=0.01 cores=1,3,5,7
/proc/23101/task/23109/stat : 23109 (java) S 23099 23101 23101 0 -1 4202560 1711 0 0 0 1 0 0 0 15 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23110] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23110/stat : 23110 (java) S 23099 23101 23101 0 -1 4202560 361 0 0 0 0 0 0 0 16 0 19 0 869237885 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23111] ppid=23099 vsize=8541804 CPUtime=0.06 cores=1,3,5,7
/proc/23101/task/23111/stat : 23111 (java) S 23099 23101 23101 0 -1 4202560 4093 0 0 0 6 0 0 0 15 0 19 0 869237890 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 0 0 16800975 18446604469612905472 0 0 -1 1 0 0 0
[pid=23101/tid=23112] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23112/stat : 23112 (java) S 23099 23101 23101 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23113] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23113/stat : 23113 (java) S 23099 23101 23101 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 4
[pid=23101/tid=23114] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23114/stat : 23114 (java) S 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869237901 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562361265 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23115] ppid=23099 vsize=8541804 CPUtime=0.38 cores=1,3,5,7
/proc/23101/task/23115/stat : 23115 (java) S 23099 23101 23101 0 -1 4202560 1986 0 0 0 38 0 0 0 15 0 19 0 869237901 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23116] ppid=23099 vsize=8541804 CPUtime=0.32 cores=1,3,5,7
/proc/23101/task/23116/stat : 23116 (java) S 23099 23101 23101 0 -1 4202560 2740 0 1 0 32 0 0 0 15 0 19 0 869237901 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 1 0 0 0
[pid=23101/tid=23117] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23117/stat : 23117 (java) S 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869237901 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23118] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23118/stat : 23118 (java) S 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869237901 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 4 0 16800975 18446604469612905472 0 0 -1 1 0 0 0
[pid=23101/tid=23119] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23119/stat : 23119 (java) S 23099 23101 23101 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869237941 8746807296 24777 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23086/tid=23100] ppid=23084 vsize=294888 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23100/stat : 23100 (python) S 23084 23086 23050 0 -1 4202560 27 921 0 9 0 0 0 0 18 0 2 0 869237869 301965312 7579 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.87
Current children cumulated vsize (KiB) 9121336
heavy processes:

[startup+51.1014 s]
/proc/loadavg: 1.31 0.36 0.12 4/478 23123
/proc/meminfo: memFree=31470696/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=294888 CPUtime=0.78 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 10172 921 114 9 57 21 0 0 18 0 2 0 869235990 301965312 7579 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 368
/proc/23086/statm: 73722 7579 1870 364 0 8609 0
[pid=23099] ppid=23086 vsize=284644 CPUtime=0.13 cores=1,3,5,7
/proc/23099/stat : 23099 (python) S 23086 23086 23050 0 -1 4202560 990 0 0 0 6 7 0 0 15 0 1 0 869237869 291475456 6086 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550557711 0 0 16781312 33554946 4294934791 0 0 17 3 0 0 0
/proc/23099/statm: 71161 6086 381 364 0 6048 0
[pid=23101] ppid=23099 vsize=8541804 CPUtime=32.75 cores=1,3,5,7
/proc/23101/stat : 23101 (java) S 23099 23101 23101 0 -1 4202496 28093 0 111 0 3270 5 0 0 18 0 19 0 869237869 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 8
/proc/23101/statm: 2135451 26122 2255 9 0 2126192 0
[pid=23101/tid=23102] ppid=23099 vsize=8541804 CPUtime=31.45 cores=1,3,5,7
/proc/23101/task/23102/stat : 23102 (java) R 23099 23101 23101 0 -1 4202560 11101 0 54 0 3144 1 0 0 25 0 19 0 869237881 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 46912505755877 0 4 0 16800975 0 0 0 -1 5 0 0 19
[pid=23101/tid=23103] ppid=23099 vsize=8541804 CPUtime=0.02 cores=1,3,5,7
/proc/23101/task/23103/stat : 23103 (java) S 23099 23101 23101 0 -1 4202560 724 0 0 0 2 0 0 0 16 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23104] ppid=23099 vsize=8541804 CPUtime=0.02 cores=1,3,5,7
/proc/23101/task/23104/stat : 23104 (java) S 23099 23101 23101 0 -1 4202560 777 0 0 0 2 0 0 0 15 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23105] ppid=23099 vsize=8541804 CPUtime=0.01 cores=1,3,5,7
/proc/23101/task/23105/stat : 23105 (java) S 23099 23101 23101 0 -1 4202560 818 0 0 0 1 0 0 0 15 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23106] ppid=23099 vsize=8541804 CPUtime=0.02 cores=1,3,5,7
/proc/23101/task/23106/stat : 23106 (java) S 23099 23101 23101 0 -1 4202560 179 0 0 0 2 0 0 0 16 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23107] ppid=23099 vsize=8541804 CPUtime=0.01 cores=1,3,5,7
/proc/23101/task/23107/stat : 23107 (java) S 23099 23101 23101 0 -1 4202560 536 0 0 0 1 0 0 0 15 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23108] ppid=23099 vsize=8541804 CPUtime=0.02 cores=1,3,5,7
/proc/23101/task/23108/stat : 23108 (java) S 23099 23101 23101 0 -1 4202560 534 0 0 0 2 0 0 0 15 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23109] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23109/stat : 23109 (java) S 23099 23101 23101 0 -1 4202560 1729 0 0 0 3 0 0 0 16 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23110] ppid=23099 vsize=8541804 CPUtime=0.01 cores=1,3,5,7
/proc/23101/task/23110/stat : 23110 (java) S 23099 23101 23101 0 -1 4202560 417 0 0 0 1 0 0 0 16 0 19 0 869237885 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23111] ppid=23099 vsize=8541804 CPUtime=0.35 cores=1,3,5,7
/proc/23101/task/23111/stat : 23111 (java) S 23099 23101 23101 0 -1 4202560 5228 0 0 0 35 0 0 0 15 0 19 0 869237890 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 0 0 16800975 18446604469612905472 0 0 -1 1 0 0 0
[pid=23101/tid=23112] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23112/stat : 23112 (java) S 23099 23101 23101 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23113] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23113/stat : 23113 (java) S 23099 23101 23101 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 4
[pid=23101/tid=23114] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23114/stat : 23114 (java) S 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869237901 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562361265 0 4 0 16800975 18446604469612905472 0 0 -1 7 0 0 0
[pid=23101/tid=23115] ppid=23099 vsize=8541804 CPUtime=0.39 cores=1,3,5,7
/proc/23101/task/23115/stat : 23115 (java) S 23099 23101 23101 0 -1 4202560 1986 0 0 0 39 0 0 0 15 0 19 0 869237901 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 5 0 0 0
[pid=23101/tid=23116] ppid=23099 vsize=8541804 CPUtime=0.32 cores=1,3,5,7
/proc/23101/task/23116/stat : 23116 (java) S 23099 23101 23101 0 -1 4202560 2740 0 1 0 32 0 0 0 15 0 19 0 869237901 8746807296 26122 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446604469612905472 0 0 -1 1 0 0 0
[pid=23101/tid=23117] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/23128/stat : 23128 (scip-2.0.1.linu) T 23126 23128 23128 0 -1 4202496 40564 0 0 0 4568 85 0 0 25 0 1 0 869242687 164397056 37321 33554432000 4194304 13684479 140734784484304 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23128/statm: 40136 37321 816 2317 0 37814 0
[pid=23126/tid=23134] ppid=23086 vsize=295480 CPUtime=0 cores=1,3,5,7
/proc/23126/task/23134/stat : 23134 (python) S 23086 23086 23050 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869247344 302571520 6233 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554946 18446604467278542848 0 0 -1 7 0 0 0
[pid=23135] ppid=23086 vsize=305736 CPUtime=0.19 cores=1,3,5,7
/proc/23135/stat : 23135 (python) S 23086 23086 23050 0 -1 4202560 956 0 0 0 9 10 0 0 15 0 1 0 869247346 313073664 6212 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550557766 0 0 16781312 33554946 5623311482772007788 0 0 17 1 0 0 0
/proc/23135/statm: 76434 6212 373 364 0 11315 0
[pid=23137] ppid=23135 vsize=130832 CPUtime=48.73 cores=1,3,5,7
/proc/23137/stat : 23137 (wbo1.4a) R 23135 23137 23137 0 -1 4202496 32738 0 0 0 4801 72 0 0 25 0 1 0 869247347 133971968 32237 33554432000 134512640 135751879 4286956384 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/23137/statm: 32708 32237 146 303 0 32403 0
[pid=23086/tid=23100] ppid=23084 vsize=315980 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23100/stat : 23100 (python) S 23084 23086 23050 0 -1 4202560 27 921 0 9 0 0 0 0 18 0 4 0 869237869 323563520 7718 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
[pid=23086/tid=23127] ppid=23084 vsize=315980 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23127/stat : 23127 (python) S 23084 23086 23050 0 -1 4202560 29 921 0 9 0 0 0 0 20 0 4 0 869242676 323563520 7718 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
[pid=23086/tid=23136] ppid=23084 vsize=315980 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23136/stat : 23136 (python) S 23084 23086 23050 0 -1 4202560 35 921 0 9 0 0 0 0 20 0 4 0 869247347 323563520 7718 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 145.19
Current children cumulated vsize (KiB) 10045264



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+214.402 s]
/proc/loadavg: 1.97 1.07 0.43 6/546 23196
/proc/meminfo: memFree=30466220/32951124 swapFree=55639044/67111528
[pid=23086] ppid=23084 vsize=336492 CPUtime=0.89 cores=1,3,5,7
/proc/23086/stat : 23086 (python) S 23084 23086 23050 0 -1 4202496 13861 921 114 9 67 22 0 0 20 0 6 0 869235990 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 368
/proc/23086/statm: 84123 7730 1879 364 0 18998 0
[pid=23099] ppid=23086 vsize=294888 CPUtime=0.2 cores=1,3,5,7
/proc/23099/stat : 23099 (python) S 23086 23086 23050 0 -1 4202560 1136 0 0 0 10 10 0 0 16 0 2 0 869237869 301965312 6122 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/23099/statm: 73722 6122 412 364 0 8609 0
[pid=23101] ppid=23099 vsize=8541804 CPUtime=48.53 cores=1,3,5,7
/proc/23101/stat : 23101 (java) T 23099 23101 23101 0 -1 4202496 30284 0 111 0 4848 5 0 0 18 0 19 0 869237869 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 8
/proc/23101/statm: 2135451 28297 2255 9 0 2126192 0
[pid=23101/tid=23102] ppid=23099 vsize=8541804 CPUtime=46.94 cores=1,3,5,7
/proc/23101/task/23102/stat : 23102 (java) T 23099 23101 23101 0 -1 4202560 11113 0 54 0 4693 1 0 0 25 0 19 0 869237881 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 46912505692614 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 19
[pid=23101/tid=23103] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23103/stat : 23103 (java) T 23099 23101 23101 0 -1 4202560 742 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23101/tid=23104] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23104/stat : 23104 (java) T 23099 23101 23101 0 -1 4202560 835 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23105] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23105/stat : 23105 (java) T 23099 23101 23101 0 -1 4202560 829 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23101/tid=23106] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23106/stat : 23106 (java) T 23099 23101 23101 0 -1 4202560 198 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23101/tid=23107] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23107/stat : 23107 (java) T 23099 23101 23101 0 -1 4202560 567 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23101/tid=23108] ppid=23099 vsize=8541804 CPUtime=0.03 cores=1,3,5,7
/proc/23101/task/23108/stat : 23108 (java) T 23099 23101 23101 0 -1 4202560 547 0 0 0 3 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23101/tid=23109] ppid=23099 vsize=8541804 CPUtime=0.05 cores=1,3,5,7
/proc/23101/task/23109/stat : 23109 (java) T 23099 23101 23101 0 -1 4202560 1742 0 0 0 5 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23101/tid=23110] ppid=23099 vsize=8541804 CPUtime=0.02 cores=1,3,5,7
/proc/23101/task/23110/stat : 23110 (java) T 23099 23101 23101 0 -1 4202560 417 0 0 0 2 0 0 0 15 0 19 0 869237885 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23111] ppid=23099 vsize=8541804 CPUtime=0.54 cores=1,3,5,7
/proc/23101/task/23111/stat : 23111 (java) T 23099 23101 23101 0 -1 4202560 7242 0 0 0 54 0 0 0 15 0 19 0 869237890 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23101/tid=23112] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23112/stat : 23112 (java) T 23099 23101 23101 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23113] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23113/stat : 23113 (java) T 23099 23101 23101 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869237892 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 4
[pid=23101/tid=23114] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23114/stat : 23114 (java) T 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869237901 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562361265 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23115] ppid=23099 vsize=8541804 CPUtime=0.39 cores=1,3,5,7
/proc/23101/task/23115/stat : 23115 (java) T 23099 23101 23101 0 -1 4202560 1986 0 0 0 39 0 0 0 15 0 19 0 869237901 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23101/tid=23116] ppid=23099 vsize=8541804 CPUtime=0.32 cores=1,3,5,7
/proc/23101/task/23116/stat : 23116 (java) T 23099 23101 23101 0 -1 4202560 2740 0 1 0 32 0 0 0 15 0 19 0 869237901 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23101/tid=23117] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23117/stat : 23117 (java) T 23099 23101 23101 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869237901 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23118] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23118/stat : 23118 (java) T 23099 23101 23101 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869237901 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23101/tid=23119] ppid=23099 vsize=8541804 CPUtime=0 cores=1,3,5,7
/proc/23101/task/23119/stat : 23119 (java) T 23099 23101 23101 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869237941 8746807296 28297 33554432000 1073741824 1073778376 140734203743712 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23099/tid=23125] ppid=23086 vsize=294888 CPUtime=0 cores=1,3,5,7
/proc/23099/task/23125/stat : 23125 (python) S 23086 23086 23050 0 -1 4202560 42 0 0 0 0 0 0 0 16 0 2 0 869242673 301965312 6122 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554946 18446604469585588672 0 0 -1 3 0 0 0
[pid=23126] ppid=23086 vsize=295480 CPUtime=0.18 cores=1,3,5,7
/proc/23126/stat : 23126 (python) S 23086 23086 23050 0 -1 4202560 1127 0 0 0 8 10 0 0 16 0 2 0 869242676 302571520 6233 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23126/statm: 73870 6233 397 364 0 8754 0
[pid=23128] ppid=23126 vsize=160544 CPUtime=46.53 cores=1,3,5,7
/proc/23128/stat : 23128 (scip-2.0.1.linu) T 23126 23128 23128 0 -1 4202496 40564 0 0 0 4568 85 0 0 25 0 1 0 869242687 164397056 37321 33554432000 4194304 13684479 140734784484304 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23128/statm: 40136 37321 816 2317 0 37814 0
[pid=23126/tid=23134] ppid=23086 vsize=295480 CPUtime=0 cores=1,3,5,7
/proc/23126/task/23134/stat : 23134 (python) S 23086 23086 23050 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869247344 302571520 6233 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554946 18446604467278542848 0 0 -1 7 0 0 0
[pid=23135] ppid=23086 vsize=305736 CPUtime=0.2 cores=1,3,5,7
/proc/23135/stat : 23135 (python) S 23086 23086 23050 0 -1 4202560 1114 0 0 0 9 11 0 0 17 0 2 0 869247346 313073664 6237 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23135/statm: 76434 6237 397 364 0 11315 0
[pid=23137] ppid=23135 vsize=132812 CPUtime=49.57 cores=1,3,5,7
/proc/23137/stat : 23137 (wbo1.4a) T 23135 23137 23137 0 -1 4202496 33241 0 0 0 4884 73 0 0 25 0 1 0 869247347 135999488 32740 33554432000 134512640 135751879 4286956384 18446744073709551615 134616492 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/23137/statm: 33203 32740 146 303 0 32898 0
[pid=23135/tid=23143] ppid=23086 vsize=305736 CPUtime=0 cores=1,3,5,7
/proc/23135/task/23143/stat : 23143 (python) S 23086 23086 23050 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869252304 313073664 6237 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554946 18446604458068677056 0 0 -1 7 0 0 0
[pid=23144] ppid=23086 vsize=315992 CPUtime=0.2 cores=1,3,5,7
/proc/23144/stat : 23144 (python) S 23086 23086 23050 0 -1 4202560 1139 0 0 0 10 10 0 0 16 0 2 0 869252307 323575808 6241 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23144/statm: 78998 6241 397 364 0 13876 0
[pid=23146] ppid=23144 vsize=121432 CPUtime=50.8 cores=1,3,5,7
/proc/23146/stat : 23146 (scip-2.0.1.linu) T 23144 23146 23146 0 -1 4202496 47579 0 0 0 5043 37 0 0 25 0 1 0 869252307 124346368 26261 33554432000 4194304 15243407 140733358219808 18446744073709551615 8113495 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/23146/statm: 30358 26261 931 2698 0 27653 0
[pid=23144/tid=23175] ppid=23086 vsize=315992 CPUtime=0 cores=1,3,5,7
/proc/23144/task/23175/stat : 23175 (python) S 23086 23086 23050 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869257388 323575808 6241 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554946 18446604470334570880 0 0 -1 7 0 0 0
[pid=23176] ppid=23086 vsize=326248 CPUtime=0 cores=1,3,5,7
/proc/23176/stat : 23176 (python) S 23086 23086 23050 0 -1 4202560 808 0 0 0 0 0 0 0 15 0 1 0 869257391 334077952 6196 33554432000 4194304 5683644 140734696092992 18446744073709551615 271550557766 0 0 16781312 33554946 187489929654173696 0 0 17 1 0 0 0
/proc/23176/statm: 81562 6196 349 364 0 16437 0
[pid=23178] ppid=23176 vsize=8537232 CPUtime=0.71 cores=1,3,5,7
/proc/23178/stat : 23178 (java) S 23176 23178 23178 0 -1 4202496 12724 0 1 0 69 2 0 0 20 0 19 0 869257391 8742125568 11732 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/23178/statm: 2134308 11732 2214 9 0 2125049 0
[pid=23178/tid=23179] ppid=23176 vsize=8537232 CPUtime=0.41 cores=1,3,5,7
/proc/23178/task/23179/stat : 23179 (java) R 23176 23178 23178 0 -1 4202560 8981 0 1 0 39 2 0 0 25 0 19 0 869257392 8742125568 11800 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 47322957417268 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=23178/tid=23180] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23180/stat : 23180 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869257392 8742125568 11800 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23181] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23181/stat : 23181 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869257392 8742125568 11800 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23182] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23182/stat : 23182 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869257392 8742125568 11801 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23183] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23183/stat : 23183 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257392 8742125568 11801 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23184] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23184/stat : 23184 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257392 8742125568 11801 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23185] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23185/stat : 23185 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257392 8742125568 11801 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23186] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23186/stat : 23186 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257392 8742125568 11802 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23187] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23187/stat : 23187 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257392 8742125568 11802 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23188] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23188/stat : 23188 (java) S 23176 23178 23178 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 869257393 8742125568 11802 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562354176 0 0 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23189] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23189/stat : 23189 (java) S 23176 23178 23178 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869257394 8742125568 11803 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23190] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23190/stat : 23190 (java) S 23176 23178 23178 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869257394 8742125568 11803 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23191] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23191/stat : 23191 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257396 8742125568 11803 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562361265 0 4 0 16800975 18446604458127256640 0 0 -1 1 0 0 0
[pid=23178/tid=23192] ppid=23176 vsize=8537232 CPUtime=0.14 cores=1,3,5,7
/proc/23178/task/23192/stat : 23192 (java) R 23176 23178 23178 0 -1 4202560 988 0 0 0 14 0 0 0 25 0 19 0 869257396 8742125568 11803 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=23178/tid=23193] ppid=23176 vsize=8537232 CPUtime=0.16 cores=1,3,5,7
/proc/23178/task/23193/stat : 23193 (java) R 23176 23178 23178 0 -1 4202560 1429 0 0 0 16 0 0 0 25 0 19 0 869257396 8742125568 11804 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562356508 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=23178/tid=23194] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23194/stat : 23194 (java) S 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869257396 8742125568 11804 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562353561 0 4 0 16800975 18446604458127256640 0 0 -1 7 0 0 0
[pid=23178/tid=23195] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23195/stat : 23195 (java) R 23176 23178 23178 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869257396 8742125568 11804 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562354176 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=23178/tid=23196] ppid=23176 vsize=8537232 CPUtime=0 cores=1,3,5,7
/proc/23178/task/23196/stat : 23196 (java) S 23176 23178 23178 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869257429 8742125568 11804 33554432000 1073741824 1073778376 140736945092880 18446744073709551615 271562354176 0 4 0 16800975 18446604458127256640 0 0 -1 7 0 0 0
[pid=23086/tid=23100] ppid=23084 vsize=336492 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23100/stat : 23100 (python) S 23084 23086 23050 0 -1 4202560 27 921 0 9 0 0 0 0 18 0 6 0 869237869 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
[pid=23086/tid=23127] ppid=23084 vsize=336492 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23127/stat : 23127 (python) S 23084 23086 23050 0 -1 4202560 29 921 0 9 0 0 0 0 20 0 6 0 869242676 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
[pid=23086/tid=23136] ppid=23084 vsize=336492 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23136/stat : 23136 (python) S 23084 23086 23050 0 -1 4202560 35 921 0 9 0 0 0 0 20 0 6 0 869247347 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 7 0 0 0
[pid=23086/tid=23145] ppid=23084 vsize=336492 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23145/stat : 23145 (python) S 23084 23086 23050 0 -1 4202560 29 921 0 9 0 0 0 0 20 0 6 0 869252307 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 5 0 0 0
[pid=23086/tid=23177] ppid=23084 vsize=336492 CPUtime=0 cores=1,3,5,7
/proc/23086/task/23177/stat : 23177 (python) S 23084 23086 23050 0 -1 4202560 29 921 0 9 0 0 0 0 20 0 6 0 869257391 344567808 7730 33554432000 4194304 5683644 140734696092992 18446744073709551615 271562361265 0 0 16781312 33554434 18446604456609244096 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 197.81
Current children cumulated vsize (KiB) 19368660

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23086 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=674897
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=227965
# CPU time returned by wait4() is 0.902862
# while last known CPU time is 197.81
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 214.482
CPU time (s): 197.81
CPU user time (s): 195.16
CPU system time (s): 2.65
CPU usage (%): 92.2271
Max. virtual memory (cumulated for all children) (KiB): 19368660

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.674897
system time used= 0.227965
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14784
page faults= 123
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17555
involuntary context switches= 66

runsolver used 1.17482 second user time and 2.70259 second system time

The end

Launcher Data 

Begin job on node133 at 2011-06-09 01:39:17
IDJOB=3481926
IDBENCH=1873
IDSOLVER=1970
FILE ID=node133/3481926-1307576357
RUNJOBID= node133-1307576356-23069
PBS_JOBID= 13547666
Free space on /tmp= 74012 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-seymour.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481926-1307576357/watcher-3481926-1307576357 -o /tmp/evaluation-result-3481926-1307576357/solver-3481926-1307576357 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481926-1307576357.opb -seed 611056974 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 97ebaccbda37d5c570b4e2ec3cd7f8f0
RANDOM SEED=611056974

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32106596 kB
Buffers:        145548 kB
Cached:         413724 kB
SwapCached:      10460 kB
Active:         431580 kB
Inactive:       148972 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32106596 kB
SwapTotal:    67111528 kB
SwapFree:     55639044 kB
Dirty:          210120 kB
Writeback:           0 kB
AnonPages:       18428 kB
Mapped:          12388 kB
Slab:           142100 kB
PageTables:      53352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 114886968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73808 MiB
End job on node133 at 2011-06-09 01:43:18