Trace number 3481442

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 336.33 331.593

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_1000_25_3.opb
MD5SUM58d1d1d90868b936a5ba7e034aba056d
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark58
Best CPU time to get the best result obtained on this benchmark1797.26
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 71
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1000
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1000
Minimum length of a constraint26
Maximum length of a constraint48
Number of terms in the objective function 1000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1000
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)31622
Sum of products size (including duplicates)63244
Number of different products31622
Sum of products size63244

Solver Data 

0.40/0.51	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.40/0.51	c INFO: solving HOME/instance-3481442-1307577833.opb
0.60/0.86	c INFO: wrote linearized instance to HOME/tmpgBLULL.opb
1.63/1.65	c INFO: parsing took 0.41 s
1.63/2.08	c INFO: features took 0.81 CPU seconds
2.24/2.11	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.04)
49.00/48.77	c INFO: running wbo1.4a@0 for 45 with 1752 remaining (b = 0.02)
98.53/98.08	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1702 remaining (b = 0.01)
149.42/146.07	c INFO: running clasp-1.3.7@0 for 91 with 1652 remaining (b = 0.01)
241.85/238.06	c INFO: running scip-2.0.1-clp@0 for 45 with 1561 remaining (b = 0.01)
288.70/284.79	c INFO: running scip-2.0.1-spx@46 for 45 with 1514 remaining (b = 0.00)
335.28/331.04	c INFO: running sat4j-pb-v20101225@0 for 91 with 1468 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481442-1307577833/watcher-3481442-1307577833 -o /tmp/evaluation-result-3481442-1307577833/solver-3481442-1307577833 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481442-1307577833.opb -seed 968410611 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.19 2.07 1.62 2/752 19830
/proc/meminfo: memFree=18963848/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 1045 0 0 0 0 0 0 0 17 0 1 0 869383005 16629760 917 33554432000 4194304 5683644 140735682756688 18446744073709551615 208079926228 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/19830/statm: 4060 917 381 364 0 547 0

[startup+0.0401499 s]
/proc/loadavg: 2.19 2.07 1.62 2/752 19830
/proc/meminfo: memFree=18963848/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=18888 CPUtime=0.02 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 1287 0 0 0 2 0 0 0 17 0 1 0 869383005 19341312 1140 33554432000 4194304 5683644 140735682756688 18446744073709551615 4317685 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/19830/statm: 4722 1140 421 364 0 691 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18888

[startup+0.100144 s]
/proc/loadavg: 2.19 2.07 1.62 2/752 19830
/proc/meminfo: memFree=18963848/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=96128 CPUtime=0.07 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 3000 465 1 0 5 2 0 0 18 0 1 0 869383005 98435072 2483 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080052629 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/19830/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96128

[startup+0.301103 s]
/proc/loadavg: 2.19 2.07 1.62 2/752 19830
/proc/meminfo: memFree=18963848/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=168312 CPUtime=0.23 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 5993 929 1 0 17 6 0 0 17 0 1 0 869383005 172351488 4311 33554432000 4194304 5683644 140735682756688 18446744073709551615 4570176 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/19830/statm: 42078 4311 1216 364 0 3295 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 168312

[startup+0.701085 s]
/proc/loadavg: 2.19 2.07 1.62 2/752 19830
/proc/meminfo: memFree=18963848/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=284496 CPUtime=0.51 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 9705 929 1 0 38 13 0 0 15 0 1 0 869383005 291323904 7438 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059024 0 0 16781312 2 2665323048810315776 0 0 17 0 0 0 0
/proc/19830/statm: 71124 7438 1777 364 0 6017 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 284496

[startup+1.50082 s]
/proc/loadavg: 2.19 2.07 1.62 3/753 19836
/proc/meminfo: memFree=18919072/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=298376 CPUtime=1.63 cores=0,2,4,6
/proc/19830/stat : 19830 (python) R 19828 19830 17436 0 -1 4202496 18360 1553 1 0 109 21 29 4 16 0 1 0 869383005 305537024 10942 33554432000 4194304 5683644 140735682756688 18446744073709551615 4662490 0 0 16781312 33554434 0 0 0 17 0 0 0 0
/proc/19830/statm: 74594 10942 1816 364 0 9487 0
Current children cumulated CPU time (s) 1.63
Current children cumulated vsize (KiB) 298376

[startup+3.10063 s]
/proc/loadavg: 2.34 2.10 1.63 3/756 19839
/proc/meminfo: memFree=18791576/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=309904 CPUtime=2.24 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 19339 1553 1 0 170 21 29 4 19 0 2 0 869383005 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 77476 11316 1871 364 0 12363 0
[pid=19837] ppid=19830 vsize=299660 CPUtime=0 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 699 0 0 0 0 0 0 0 16 0 1 0 869383217 306851840 9759 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252431 0 0 16781312 33554946 10904855139147809025 0 0 17 6 0 0 0
/proc/19837/statm: 74915 9759 318 364 0 9802 0
[pid=19839] ppid=19837 vsize=172504 CPUtime=0.97 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) R 19837 19839 19839 0 -1 4202496 40668 0 0 0 92 5 0 0 21 0 1 0 869383217 176644096 39985 33554432000 4194304 13684479 140734449509792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19839/statm: 43126 39985 586 2317 0 40804 0
[pid=19830/tid=19838] ppid=19828 vsize=309904 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 19 0 2 0 869383217 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.21
Current children cumulated vsize (KiB) 782068

[startup+6.30102 s]
/proc/loadavg: 2.34 2.10 1.63 3/756 19841
/proc/meminfo: memFree=18559160/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=309904 CPUtime=2.24 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 19339 1553 1 0 170 21 29 4 19 0 2 0 869383005 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 77476 11316 1871 364 0 12363 0
[pid=19837] ppid=19830 vsize=299660 CPUtime=0.02 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 866 0 0 0 1 1 0 0 15 0 1 0 869383217 306851840 9783 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252431 0 0 16781312 33554946 3979507415602135297 0 0 17 6 0 0 0
/proc/19837/statm: 74915 9783 342 364 0 9802 0
[pid=19839] ppid=19837 vsize=345296 CPUtime=4.18 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) R 19837 19839 19839 0 -1 4202496 87636 0 0 0 398 20 0 0 20 0 1 0 869383217 353583104 83157 33554432000 4194304 13684479 140734449509792 18446744073709551615 4941053 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19839/statm: 86324 83157 833 2317 0 84002 0
[pid=19830/tid=19838] ppid=19828 vsize=309904 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 19 0 2 0 869383217 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.44
Current children cumulated vsize (KiB) 954860

[startup+12.7008 s]
/proc/loadavg: 2.28 2.10 1.64 3/756 19842
/proc/meminfo: memFree=18385464/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=309904 CPUtime=2.24 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 19339 1553 1 0 170 21 29 4 19 0 2 0 869383005 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 77476 11316 1871 364 0 12363 0
[pid=19837] ppid=19830 vsize=299660 CPUtime=0.04 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 871 0 0 0 2 2 0 0 15 0 1 0 869383217 306851840 9783 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252431 0 0 16781312 33554946 1466833899697995776 0 0 17 6 0 0 0
/proc/19837/statm: 74915 9783 342 364 0 9802 0
[pid=19839] ppid=19837 vsize=492772 CPUtime=10.58 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) R 19837 19839 19839 0 -1 4202496 123672 0 0 0 1031 27 0 0 21 0 1 0 869383217 504598528 119122 33554432000 4194304 13684479 140734449509792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19839/statm: 123193 119122 772 2317 0 120871 0
[pid=19830/tid=19838] ppid=19828 vsize=309904 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 19 0 2 0 869383217 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.86
Current children cumulated vsize (KiB) 1102336

[startup+25.5004 s]
/proc/loadavg: 2.31 2.11 1.64 3/756 19843
/proc/meminfo: memFree=18446512/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=309904 CPUtime=2.24 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 19339 1553 1 0 170 21 29 4 19 0 2 0 869383005 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 77476 11316 1871 364 0 12363 0
[pid=19837] ppid=19830 vsize=299660 CPUtime=0.1 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 878 0 0 0 4 6 0 0 15 0 1 0 869383217 306851840 9783 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252431 0 0 16781312 33554946 72556772316949301 0 0 17 6 0 0 0
/proc/19837/statm: 74915 9783 342 364 0 9802 0
[pid=19839] ppid=19837 vsize=359820 CPUtime=23.37 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) R 19837 19839 19839 0 -1 4202496 123930 0 0 0 2304 33 0 0 25 0 1 0 869383217 368455680 86883 33554432000 4194304 13684479 140734449509792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19839/statm: 89955 86883 792 2317 0 87633 0
[pid=19830/tid=19838] ppid=19828 vsize=309904 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 19 0 2 0 869383217 317341696 11316 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.71
Current children cumulated vsize (KiB) 969384

[startup+51.1205 s]
/proc/loadavg: 2.21 2.10 1.65 2/747 19872
/proc/meminfo: memFree=18310872/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=320160 CPUtime=2.27 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 20222 1553 1 0 173 21 29 4 19 0 3 0 869383005 327843840 11323 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 80040 11323 1874 364 0 14924 0
[pid=19837] ppid=19830 vsize=309904 CPUtime=0.21 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 1085 0 0 0 10 11 0 0 17 0 2 0 869383217 317341696 9851 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19837/statm: 77476 9851 405 364 0 12363 0
[pid=19839] ppid=19837 vsize=359820 CPUtime=46.62 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) T 19837 19839 19839 0 -1 4202496 123935 0 0 0 4623 39 0 0 25 0 1 0 869383217 368455680 86888 33554432000 4194304 13684479 140734449509792 18446744073709551615 4976560 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/19839/statm: 89955 86888 797 2317 0 87633 0
[pid=19837/tid=19845] ppid=19830 vsize=309904 CPUtime=0 cores=0,2,4,6
/proc/19837/task/19845/stat : 19845 (python) S 19830 19830 17436 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869387880 317341696 9851 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604441630115008 0 0 -1 6 0 0 0
[pid=19846] ppid=19830 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/19846/stat : 19846 (python) S 19830 19830 17436 0 -1 4202560 759 0 0 0 0 0 0 0 16 0 1 0 869387883 317353984 9764 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252486 0 0 16781312 33554946 1718302744525144064 0 0 17 6 0 0 0
/proc/19846/statm: 77479 9764 319 364 0 12363 0
[pid=19848] ppid=19846 vsize=28920 CPUtime=2.33 cores=0,2,4,6
/proc/19848/stat : 19848 (wbo1.4a) R 19846 19848 19848 0 -1 4202496 11874 0 0 0 231 2 0 0 25 0 1 0 869387884 29614080 6630 33554432000 134512640 135751879 4287592448 18446744073709551615 134518831 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/19848/statm: 7230 6630 146 303 0 6925 0
[pid=19830/tid=19838] ppid=19828 vsize=320160 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 19 0 3 0 869383217 327843840 11323 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
[pid=19830/tid=19847] ppid=19828 vsize=320160 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19847/stat : 19847 (python) S 19828 19830 17436 0 -1 4202560 29 1553 0 0 0 0 29 4 20 0 3 0 869387883 327843840 11323 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.43
Current children cumulated vsize (KiB) 1328720

[startup+102.302 s]
/proc/loadavg: 2.09 2.08 1.67 3/774 19930
/proc/meminfo: memFree=17747696/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=330416 CPUtime=2.3 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 21111 1553 1 0 175 22 29 4 20 0 4 0 869383005 338345984 11329 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19830/statm: 82604 11329 1876 364 0 17485 0
[pid=19837] ppid=19830 vsize=309904 CPUtime=0.21 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 1085 0 0 0 10 11 0 0 17 0 2 0 869383217 317341696 9851 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19837/statm: 77476 9851 405 364 0 12363 0
[pid=19839] ppid=19837 vsize=359820 CPUtime=46.62 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) T 19837 19839 19839 0 -1 4202496 123935 0 0 0 4623 39 0 0 25 0 1 0 869383217 368455680 86888 33554432000 4194304 13684479 140734449509792 18446744073709551615 4976560 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/19839/statm: 89955 86888 797 2317 0 87633 0
[pid=19837/tid=19845] ppid=19830 vsize=309904 CPUtime=0 cores=0,2,4,6
/proc/19837/task/19845/stat : 19845 (python) S 19830 19830 17436 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869387880 317341696 9851 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604441630115008 0 0 -1 6 0 0 0
[pid=19846] ppid=19830 vsize=309916 CPUtime=0.24 cores=0,2,4,6
/proc/19846/stat : 19846 (python) S 19830 19830 17436 0 -1 4202560 1121 0 0 0 12 12 0 0 17 0 2 0 869387883 317353984 9836 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19846/statm: 77479 9836 390 364 0 12363 0
[pid=19848] ppid=19846 vsize=46432 CPUtime=49.26 cores=0,2,4,6
/proc/19848/stat : 19848 (wbo1.4a) T 19846 19848 19848 0 -1 4202496 16636 0 0 0 4916 10 0 0 25 0 1 0 869387884 47546368 11002 33554432000 134512640 135751879 4287592448 18446744073709551615 134616273 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/19848/statm: 11608 11002 146 303 0 11303 0
[pid=19846/tid=19909] ppid=19830 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/19846/task/19909/stat : 19909 (python) S 19830 19830 17436 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 869392811 317353984 9836 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604446424299456 0 0 -1 6 0 0 0
[pid=19910] ppid=19830 vsize=320172 CPUtime=0.01 cores=0,2,4,6
/proc/19910/stat : 19910 (python) S 19830 19830 17436 0 -1 4202560 912 0 0 0 0 1 0 0 15 0 1 0 869392814 327856128 9792 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252486 0 0 16781312 33554946 4294934786 0 0 17 0 0 0 0
/proc/19910/statm: 80043 9792 343 364 0 14924 0
[pid=19912] ppid=19910 vsize=8543416 CPUtime=6.14 cores=0,2,4,6
/proc/19912/stat : 19912 (java) S 19910 19912 19912 0 -1 4202496 130110 0 1 0 599 15 0 0 20 0 19 0 869392814 8748457984 126195 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092035045 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/19912/statm: 2135854 126195 2244 9 0 2126595 0
[pid=19912/tid=19913] ppid=19910 vsize=8543416 CPUtime=4.03 cores=0,2,4,6
/proc/19912/task/19913/stat : 19913 (java) R 19910 19912 19912 0 -1 4202560 93650 0 1 0 391 12 0 0 25 0 19 0 869392815 8748457984 126195 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 46912506069527 0 4 0 16800975 0 0 0 -1 2 0 0 4
[pid=19912/tid=19914] ppid=19910 vsize=8543416 CPUtime=0.04 cores=0,2,4,6
/proc/19912/task/19914/stat : 19914 (java) S 19910 19912 19912 0 -1 4202560 3493 0 0 0 4 0 0 0 16 0 19 0 869392815 8748457984 126195 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446604445188109632 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=19830/tid=19847] ppid=19828 vsize=416464 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19847/stat : 19847 (python) S 19828 19830 17436 0 -1 4202560 29 1553 0 0 0 0 29 4 20 0 6 0 869387883 426459136 11502 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 0 0 0 0
[pid=19830/tid=19911] ppid=19828 vsize=416464 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19911/stat : 19911 (python) S 19828 19830 17436 0 -1 4202560 31 1553 0 0 0 0 29 4 20 0 6 0 869392814 426459136 11502 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 0 0 0 0
[pid=19830/tid=19956] ppid=19828 vsize=416464 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19956/stat : 19956 (python) S 19828 19830 17436 0 -1 4202560 29 1553 0 0 0 0 29 4 20 0 6 0 869397613 426459136 11502 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 2 0 0 0
[pid=19830/tid=20134] ppid=19828 vsize=416464 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/20134/stat : 20134 (python) S 19828 19830 17436 0 -1 4202560 63 1553 0 0 0 0 29 4 20 0 6 0 869406813 426459136 11502 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 286.31
Current children cumulated vsize (KiB) 11421728



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+331.502 s]
/proc/loadavg: 2.24 2.13 1.77 6/853 20184
/proc/meminfo: memFree=10287488/32950928 swapFree=38525204/67111528
[pid=19830] ppid=19828 vsize=426720 CPUtime=2.4 cores=0,2,4,6
/proc/19830/stat : 19830 (python) S 19828 19830 17436 0 -1 4202496 23813 1553 1 0 185 22 29 4 20 0 7 0 869383005 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/19830/statm: 106680 11429 1882 364 0 41552 0
[pid=19837] ppid=19830 vsize=309904 CPUtime=0.43 cores=0,2,4,6
/proc/19837/stat : 19837 (python) S 19830 19830 17436 0 -1 4202560 1113 0 0 0 21 22 0 0 15 0 2 0 869383217 317341696 9852 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19837/statm: 77476 9852 406 364 0 12363 0
[pid=19839] ppid=19837 vsize=362912 CPUtime=92.85 cores=0,2,4,6
/proc/19839/stat : 19839 (scip-2.0.1.linu) T 19837 19839 19839 0 -1 4202496 124361 0 0 0 9233 52 0 0 25 0 1 0 869383217 371621888 87314 33554432000 4194304 13684479 140734449509792 18446744073709551615 4752937 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/19839/statm: 90728 87314 798 2317 0 88406 0
[pid=19837/tid=19845] ppid=19830 vsize=309904 CPUtime=0 cores=0,2,4,6
/proc/19837/task/19845/stat : 19845 (python) S 19830 19830 17436 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869387880 317341696 9852 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604441630115008 0 0 -1 2 0 0 0
[pid=19846] ppid=19830 vsize=309916 CPUtime=0.24 cores=0,2,4,6
/proc/19846/stat : 19846 (python) S 19830 19830 17436 0 -1 4202560 1121 0 0 0 12 12 0 0 17 0 2 0 869387883 317353984 9836 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19846/statm: 77479 9836 390 364 0 12363 0
[pid=19848] ppid=19846 vsize=46432 CPUtime=49.26 cores=0,2,4,6
/proc/19848/stat : 19848 (wbo1.4a) T 19846 19848 19848 0 -1 4202496 16636 0 0 0 4916 10 0 0 25 0 1 0 869387884 47546368 11002 33554432000 134512640 135751879 4287592448 18446744073709551615 134616273 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/19848/statm: 11608 11002 146 303 0 11303 0
[pid=19846/tid=19909] ppid=19830 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/19846/task/19909/stat : 19909 (python) S 19830 19830 17436 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 869392811 317353984 9836 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604446424299456 0 0 -1 6 0 0 0
[pid=19910] ppid=19830 vsize=320172 CPUtime=0.22 cores=0,2,4,6
/proc/19910/stat : 19910 (python) S 19830 19830 17436 0 -1 4202560 1124 0 0 0 11 11 0 0 17 0 2 0 869392814 327856128 9840 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19910/statm: 80043 9840 390 364 0 14924 0
[pid=19912] ppid=19910 vsize=8543416 CPUtime=50.64 cores=0,2,4,6
/proc/19912/stat : 19912 (java) T 19910 19912 19912 0 -1 4202496 710068 0 1 0 4987 77 0 0 18 0 19 0 869392814 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092035045 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/19912/statm: 2135854 700926 2249 9 0 2126595 0
[pid=19912/tid=19913] ppid=19910 vsize=8543416 CPUtime=47.58 cores=0,2,4,6
/proc/19912/task/19913/stat : 19913 (java) T 19910 19912 19912 0 -1 4202560 632816 0 1 0 4690 68 0 0 25 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 46912506207435 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 4
[pid=19912/tid=19914] ppid=19910 vsize=8543416 CPUtime=0.12 cores=0,2,4,6
/proc/19912/task/19914/stat : 19914 (java) T 19910 19912 19912 0 -1 4202560 8269 0 0 0 11 1 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19912/tid=19915] ppid=19910 vsize=8543416 CPUtime=0.12 cores=0,2,4,6
/proc/19912/task/19915/stat : 19915 (java) T 19910 19912 19912 0 -1 4202560 8449 0 0 0 12 0 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19912/tid=19916] ppid=19910 vsize=8543416 CPUtime=0.14 cores=0,2,4,6
/proc/19912/task/19916/stat : 19916 (java) T 19910 19912 19912 0 -1 4202560 10003 0 0 0 13 1 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=19912/tid=19917] ppid=19910 vsize=8543416 CPUtime=0.16 cores=0,2,4,6
/proc/19912/task/19917/stat : 19917 (java) T 19910 19912 19912 0 -1 4202560 10721 0 0 0 15 1 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19912/tid=19918] ppid=19910 vsize=8543416 CPUtime=0.11 cores=0,2,4,6
/proc/19912/task/19918/stat : 19918 (java) T 19910 19912 19912 0 -1 4202560 7836 0 0 0 11 0 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19912/tid=19919] ppid=19910 vsize=8543416 CPUtime=0.04 cores=0,2,4,6
/proc/19912/task/19919/stat : 19919 (java) T 19910 19912 19912 0 -1 4202560 2453 0 0 0 4 0 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19912/tid=19920] ppid=19910 vsize=8543416 CPUtime=0.12 cores=0,2,4,6
/proc/19912/task/19920/stat : 19920 (java) T 19910 19912 19912 0 -1 4202560 8727 0 0 0 12 0 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19912/tid=19921] ppid=19910 vsize=8543416 CPUtime=0.12 cores=0,2,4,6
/proc/19912/task/19921/stat : 19921 (java) T 19910 19912 19912 0 -1 4202560 7798 0 0 0 12 0 0 0 15 0 19 0 869392815 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=19912/tid=19922] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19922/stat : 19922 (java) T 19910 19912 19912 0 -1 4202560 1273 0 0 0 0 0 0 0 15 0 19 0 869392816 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048896 0 0 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19923] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19923/stat : 19923 (java) T 19910 19912 19912 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869392817 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19924] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19924/stat : 19924 (java) T 19910 19912 19912 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869392817 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19925] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19925/stat : 19925 (java) T 19910 19912 19912 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869392819 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092055985 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19926] ppid=19910 vsize=8543416 CPUtime=0.94 cores=0,2,4,6
/proc/19912/task/19926/stat : 19926 (java) T 19910 19912 19912 0 -1 4202560 5550 0 0 0 94 0 0 0 15 0 19 0 869392819 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19912/tid=19927] ppid=19910 vsize=8543416 CPUtime=1.08 cores=0,2,4,6
/proc/19912/task/19927/stat : 19927 (java) T 19910 19912 19912 0 -1 4202560 4776 0 0 0 108 0 0 0 15 0 19 0 869392819 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19928] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19928/stat : 19928 (java) T 19910 19912 19912 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869392819 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19929] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19929/stat : 19929 (java) T 19910 19912 19912 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 19 0 869392819 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048896 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19912/tid=19930] ppid=19910 vsize=8543416 CPUtime=0 cores=0,2,4,6
/proc/19912/task/19930/stat : 19930 (java) T 19910 19912 19912 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869392895 8748457984 700926 33554432000 1073741824 1073778376 140733799843088 18446744073709551615 208092048896 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19910/tid=19954] ppid=19830 vsize=320172 CPUtime=0 cores=0,2,4,6
/proc/19910/task/19954/stat : 19954 (python) S 19830 19830 17436 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869397610 327856128 9840 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604452456202560 0 0 -1 6 0 0 0
[pid=19955] ppid=19830 vsize=330428 CPUtime=0.41 cores=0,2,4,6
/proc/19955/stat : 19955 (python) S 19830 19830 17436 0 -1 4202560 1175 0 0 0 20 21 0 0 16 0 2 0 869397613 338358272 9844 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19955/statm: 82607 9844 390 364 0 17485 0
[pid=19957] ppid=19955 vsize=29844 CPUtime=91.96 cores=0,2,4,6
/proc/19957/stat : 19957 (clasp-1.3.7-x86) T 19955 19957 19957 0 -1 4202496 8075 0 0 0 9195 1 0 0 25 0 1 0 869397613 30560256 7201 33554432000 134512640 136139019 4289849264 18446744073709551615 134831721 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/19957/statm: 7461 7201 187 398 0 7061 0
[pid=19955/tid=20132] ppid=19830 vsize=330428 CPUtime=0 cores=0,2,4,6
/proc/19955/task/20132/stat : 20132 (python) S 19830 19830 17436 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869406810 338358272 9844 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604449443728256 0 0 -1 6 0 0 0
[pid=20133] ppid=19830 vsize=406220 CPUtime=0.23 cores=0,2,4,6
/proc/20133/stat : 20133 (python) S 19830 19830 17436 0 -1 4202560 1276 0 0 0 12 11 0 0 17 0 2 0 869406812 415969280 10015 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/20133/statm: 101555 10015 396 364 0 36430 0
[pid=20135] ppid=20133 vsize=349112 CPUtime=46.66 cores=0,2,4,6
/proc/20135/stat : 20135 (scip-2.0.1.linu) T 20133 20135 20135 0 -1 4202496 135425 0 0 0 4632 34 0 0 25 0 1 0 869406813 357490688 83320 33554432000 4194304 15243407 140734093892512 18446744073709551615 4947023 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/20135/statm: 87278 83320 917 2698 0 84573 0
[pid=20133/tid=20141] ppid=19830 vsize=406220 CPUtime=0 cores=0,2,4,6
/proc/20133/task/20141/stat : 20141 (python) S 19830 19830 17436 0 -1 4202560 43 0 0 0 0 0 0 0 17 0 2 0 869411482 415969280 10015 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554946 18446604450486335296 0 0 -1 6 0 0 0
[pid=20165] ppid=19830 vsize=416476 CPUtime=0 cores=0,2,4,6
/proc/20165/stat : 20165 (python) S 19830 19830 17436 0 -1 4202560 816 0 0 0 0 0 0 0 19 0 1 0 869416110 426471424 9862 33554432000 4194304 5683644 140735682756688 18446744073709551615 208080252486 0 0 16781312 33554946 255719771528495104 0 0 17 4 0 0 0
/proc/20165/statm: 104119 9862 319 364 0 38991 0
[pid=20167] ppid=20165 vsize=8544744 CPUtime=1.03 cores=0,2,4,6
/proc/20167/stat : 20167 (java) S 20165 20167 20167 0 -1 4202496 18567 0 1 0 99 4 0 0 21 0 18 0 869416110 8749817856 15665 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092035045 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/20167/statm: 2136186 15665 2216 9 0 2126927 0
[pid=20167/tid=20168] ppid=20165 vsize=8544744 CPUtime=0.47 cores=0,2,4,6
/proc/20167/task/20168/stat : 20168 (java) R 20165 20167 20167 0 -1 4202560 7978 0 1 0 46 1 0 0 25 0 18 0 869416111 8749817856 15727 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 46912505612787 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=20167/tid=20169] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20169/stat : 20169 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869416111 8749817856 15728 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20170] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20170/stat : 20170 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15728 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20171] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20171/stat : 20171 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15729 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20172] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20172/stat : 20172 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15729 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20173] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20173/stat : 20173 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15729 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20174] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20174/stat : 20174 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15730 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20175] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20175/stat : 20175 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15730 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20176] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20176/stat : 20176 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416111 8749817856 15731 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 4 0 0 0
[pid=20167/tid=20177] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20177/stat : 20177 (java) S 20165 20167 20167 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869416112 8749817856 15731 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048896 0 0 0 16800975 18446604449443727360 0 0 -1 6 0 0 0
[pid=20167/tid=20178] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20178/stat : 20178 (java) S 20165 20167 20167 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869416112 8749817856 15732 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 6 0 0 0
[pid=20167/tid=20179] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20179/stat : 20179 (java) S 20165 20167 20167 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869416112 8749817856 15732 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 6 0 0 0
[pid=20167/tid=20180] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20180/stat : 20180 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416114 8749817856 15732 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092055985 0 4 0 16800975 18446604449443727360 0 0 -1 6 0 0 0
[pid=20167/tid=20181] ppid=20165 vsize=8544744 CPUtime=0.3 cores=0,2,4,6
/proc/20167/task/20181/stat : 20181 (java) R 20165 20167 20167 0 -1 4202560 5297 0 0 0 29 1 0 0 25 0 18 0 869416114 8749817856 15733 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 47836517328988 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=20167/tid=20182] ppid=20165 vsize=8544744 CPUtime=0.23 cores=0,2,4,6
/proc/20167/task/20182/stat : 20182 (java) R 20165 20167 20167 0 -1 4202560 3956 0 0 0 23 0 0 0 25 0 18 0 869416114 8749817856 15733 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 47836516510337 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=20167/tid=20183] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20183/stat : 20183 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416114 8749817856 15734 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048281 0 4 0 16800975 18446604449443727360 0 0 -1 6 0 0 0
[pid=20167/tid=20184] ppid=20165 vsize=8544744 CPUtime=0 cores=0,2,4,6
/proc/20167/task/20184/stat : 20184 (java) S 20165 20167 20167 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416114 8749817856 15734 33554432000 1073741824 1073778376 140736739779296 18446744073709551615 208092048896 0 4 0 16800975 18446604449443727360 0 0 -1 2 0 0 0
[pid=19830/tid=19838] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19838/stat : 19838 (python) S 19828 19830 17436 0 -1 4202560 32 1553 0 0 0 0 29 4 18 0 7 0 869383217 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
[pid=19830/tid=19847] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19847/stat : 19847 (python) S 19828 19830 17436 0 -1 4202560 29 1553 0 0 0 0 29 4 20 0 7 0 869387883 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 0 0 0 0
[pid=19830/tid=19911] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19911/stat : 19911 (python) S 19828 19830 17436 0 -1 4202560 31 1553 0 0 0 0 29 4 20 0 7 0 869392814 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 0 0 0 0
[pid=19830/tid=19956] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/19956/stat : 19956 (python) S 19828 19830 17436 0 -1 4202560 29 1553 0 0 0 0 29 4 20 0 7 0 869397613 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 2 0 0 0
[pid=19830/tid=20134] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/20134/stat : 20134 (python) S 19828 19830 17436 0 -1 4202560 63 1553 0 0 0 0 29 4 20 0 7 0 869406813 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 6 0 0 0
[pid=19830/tid=20166] ppid=19828 vsize=426720 CPUtime=0.33 cores=0,2,4,6
/proc/19830/task/20166/stat : 20166 (python) S 19828 19830 17436 0 -1 4202560 26 1553 0 0 0 0 29 4 20 0 7 0 869416110 436961280 11429 33554432000 4194304 5683644 140735682756688 18446744073709551615 208092055985 0 0 16781312 33554434 18446604444028138432 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 336.33
Current children cumulated vsize (KiB) 20396296

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19830 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=150673
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=272958
# CPU time returned by wait4() is 2.42363
# while last known CPU time is 336.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 331.593
CPU time (s): 336.33
CPU user time (s): 333.52
CPU system time (s): 2.81
CPU usage (%): 101.429
Max. virtual memory (cumulated for all children) (KiB): 20396296

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.15067
system time used= 0.272958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25370
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21177
involuntary context switches= 37

runsolver used 2.6046 second user time and 5.2942 second system time

The end

Launcher Data 

Begin job on node127 at 2011-06-09 02:03:53
IDJOB=3481442
IDBENCH=48109
IDSOLVER=1970
FILE ID=node127/3481442-1307577833
RUNJOBID= node127-1307576357-17454
PBS_JOBID= 13547672
Free space on /tmp= 73648 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_1000_25_3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481442-1307577833/watcher-3481442-1307577833 -o /tmp/evaluation-result-3481442-1307577833/solver-3481442-1307577833 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481442-1307577833.opb -seed 968410611 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 58d1d1d90868b936a5ba7e034aba056d
RANDOM SEED=968410611

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18964004 kB
Buffers:        178192 kB
Cached:         741240 kB
SwapCached:       9392 kB
Active:       13504588 kB
Inactive:       147212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18964004 kB
SwapTotal:    67111528 kB
SwapFree:     38525204 kB
Dirty:          104316 kB
Writeback:           0 kB
AnonPages:    12729688 kB
Mapped:          95904 kB
Slab:           139676 kB
PageTables:     121700 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 134970492 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node127 at 2011-06-09 02:09:27