Trace number 3481836

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 202.15 199.982

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/
manquinho/primes-dimacs-cnf/normalized-ii8b3.opb
MD5SUM192e079d91d386374bed5b6f1f3b1921
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark507
Best CPU time to get the best result obtained on this benchmark431.4
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 507
Optimality of the best value was proved NO
Number of variables1632
Total number of constraints6924
Number of constraints which are clauses6924
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint8
Number of terms in the objective function 1632
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1632
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1632
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.31/0.47	c INFO: solving HOME/instance-3481836-1307576688.opb
0.40/0.51	c INFO: parsing took 0.03 s
0.40/0.57	c INFO: features took 0.06 CPU seconds
0.40/0.59	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.43)
49.97/49.94	c INFO: running sat4j-pb-v20101225@0 for 45 with 1750 remaining (b = 0.15)
100.84/99.72	c INFO: running scip-2.0.1-clp@0 for 45 with 1700 remaining (b = 0.03)
150.12/148.88	c INFO: running wbo1.4a@0 for 45 with 1651 remaining (b = 0.01)
200.61/199.16	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1601 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481836-1307576688/watcher-3481836-1307576688 -o /tmp/evaluation-result-3481836-1307576688/solver-3481836-1307576688 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481836-1307576688.opb -seed 965477168 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 1.37 0.60 3/495 2488
/proc/meminfo: memFree=30028580/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 711 0 0 0 0 0 0 0 20 0 1 0 869267744 15548416 603 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/2488/statm: 3796 603 319 364 0 283 0

[startup+0.0614479 s]
/proc/loadavg: 2.02 1.37 0.60 3/495 2488
/proc/meminfo: memFree=30028580/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=40972 CPUtime=0.03 cores=0,2,4,6
/proc/2488/stat : 2488 (python) R 2486 2488 2236 0 -1 4202496 1677 0 0 0 3 0 0 0 20 0 1 0 869267744 41955328 1502 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594864640 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2488/statm: 10243 1502 463 364 0 1026 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 40972

[startup+0.100474 s]
/proc/loadavg: 2.02 1.37 0.60 3/495 2488
/proc/meminfo: memFree=30028580/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=96124 CPUtime=0.06 cores=0,2,4,6
/proc/2488/stat : 2488 (python) R 2486 2488 2236 0 -1 4202496 3168 929 1 0 5 1 0 0 18 0 1 0 869267744 98430976 2483 33554432000 4194304 5683644 140736622912896 18446744073709551615 5170272 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2488/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96124

[startup+0.300355 s]
/proc/loadavg: 2.02 1.37 0.60 3/495 2488
/proc/meminfo: memFree=30028580/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=200776 CPUtime=0.23 cores=0,2,4,6
/proc/2488/stat : 2488 (python) R 2486 2488 2236 0 -1 4202496 6647 929 1 0 17 6 0 0 17 0 1 0 869267744 205594624 4936 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594866320 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2488/statm: 50194 4936 1465 364 0 3676 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 200776

[startup+0.700285 s]
/proc/loadavg: 2.02 1.37 0.60 3/495 2488
/proc/meminfo: memFree=30028580/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 294288

[startup+1.50114 s]
/proc/loadavg: 2.02 1.38 0.61 3/499 2496
/proc/meminfo: memFree=29965432/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
[pid=2494] ppid=2488 vsize=284044 CPUtime=0 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 777 0 0 0 0 0 0 0 15 0 1 0 869267803 290861056 5889 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886671 0 0 16781312 33554946 2363860161887469568 0 0 17 4 0 0 0
/proc/2494/statm: 71011 5889 352 364 0 5898 0
[pid=2496] ppid=2494 vsize=49508 CPUtime=0.89 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) R 2494 2496 2496 0 -1 4202496 10921 0 0 0 85 4 0 0 23 0 1 0 869267803 50696192 10149 33554432000 4194304 13684479 140735259373792 18446744073709551615 5101251 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2496/statm: 12377 10149 755 2317 0 10055 0
[pid=2488/tid=2495] ppid=2486 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 2 0 869267803 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 627840

[startup+3.10086 s]
/proc/loadavg: 2.02 1.38 0.61 3/499 2496
/proc/meminfo: memFree=29963076/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
[pid=2494] ppid=2488 vsize=284044 CPUtime=0 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 869267803 290861056 5889 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886671 0 0 16781312 33554946 1524974609990942720 0 0 17 4 0 0 0
/proc/2494/statm: 71011 5889 352 364 0 5898 0
[pid=2496] ppid=2494 vsize=51848 CPUtime=2.48 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) R 2494 2496 2496 0 -1 4202496 11676 0 0 0 239 9 0 0 25 0 1 0 869267803 53092352 10804 33554432000 4194304 13684479 140735259373792 18446744073709551615 6427705 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2496/statm: 12962 10804 788 2317 0 10640 0
[pid=2488/tid=2495] ppid=2486 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 2 0 869267803 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 630180

[startup+6.30136 s]
/proc/loadavg: 2.02 1.39 0.61 3/492 2568
/proc/meminfo: memFree=30099600/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
[pid=2494] ppid=2488 vsize=284044 CPUtime=0.02 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 921 0 0 0 1 1 0 0 15 0 1 0 869267803 290861056 5913 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886671 0 0 16781312 33554946 2750846769775509504 0 0 17 4 0 0 0
/proc/2494/statm: 71011 5913 376 364 0 5898 0
[pid=2496] ppid=2494 vsize=63408 CPUtime=5.69 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) R 2494 2496 2496 0 -1 4202496 14255 0 0 0 554 15 0 0 25 0 1 0 869267803 64929792 13371 33554432000 4194304 13684479 140735259373792 18446744073709551615 6052495 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2496/statm: 15852 13371 778 2317 0 13530 0
[pid=2488/tid=2495] ppid=2486 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 2 0 869267803 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 641740

[startup+12.7013 s]
/proc/loadavg: 2.02 1.40 0.62 3/499 2640
/proc/meminfo: memFree=29925912/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
[pid=2494] ppid=2488 vsize=284044 CPUtime=0.07 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 929 0 0 0 4 3 0 0 15 0 1 0 869267803 290861056 5913 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886671 0 0 16781312 33554946 4137627001676627968 0 0 17 6 0 0 0
/proc/2494/statm: 71011 5913 376 364 0 5898 0
[pid=2496] ppid=2494 vsize=67228 CPUtime=12.08 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) R 2494 2496 2496 0 -1 4202496 15401 0 0 0 1184 24 0 0 19 0 1 0 869267803 68841472 14491 33554432000 4194304 13684479 140735259373792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2496/statm: 16807 14491 916 2317 0 14485 0
[pid=2488/tid=2495] ppid=2486 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 2 0 869267803 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 645560

[startup+25.501 s]
/proc/loadavg: 2.01 1.42 0.64 3/499 2641
/proc/meminfo: memFree=29863792/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=294288 CPUtime=0.5 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 9908 929 1 0 41 9 0 0 19 0 2 0 869267744 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 73572 7411 1870 364 0 8459 0
[pid=2494] ppid=2488 vsize=284044 CPUtime=0.1 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 933 0 0 0 5 5 0 0 15 0 1 0 869267803 290861056 5913 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886671 0 0 16781312 33554946 72556772316949360 0 0 17 6 0 0 0
/proc/2494/statm: 71011 5913 376 364 0 5898 0
[pid=2496] ppid=2494 vsize=66468 CPUtime=24.87 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) R 2494 2496 2496 0 -1 4202496 16236 0 0 0 2453 34 0 0 25 0 1 0 869267803 68063232 14471 33554432000 4194304 13684479 140735259373792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/2496/statm: 16617 14471 818 2317 0 14295 0
[pid=2488/tid=2495] ppid=2486 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 2 0 869267803 301350912 7411 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 644800

[startup+51.1015 s]
/proc/loadavg: 2.14 1.49 0.68 4/520 2662
/proc/meminfo: memFree=29793128/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=305048 CPUtime=0.52 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 10786 929 1 0 43 9 0 0 20 0 3 0 869267744 312369152 7544 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/2488/statm: 76262 7544 1873 364 0 11146 0
[pid=2494] ppid=2488 vsize=294288 CPUtime=0.22 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 1103 0 0 0 11 11 0 0 17 0 2 0 869267803 301350912 5949 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/2494/statm: 73572 5949 407 364 0 8459 0
[pid=2496] ppid=2494 vsize=81904 CPUtime=49.29 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) T 2494 2496 2496 0 -1 4202496 19650 0 0 0 4875 54 0 0 25 0 1 0 869267803 83869696 17871 33554432000 4194304 13684479 140735259373792 18446744073709551615 7387884 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/2496/statm: 20476 17871 819 2317 0 18154 0
[pid=2494/tid=2642] ppid=2488 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2494/task/2642/stat : 2642 (python) S 2488 2488 2236 0 -1 4202560 43 0 0 0 0 0 0 0 17 0 2 0 869272735 301350912 5949 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604453877463168 0 0 -1 4 0 0 0
[pid=2643] ppid=2488 vsize=294804 CPUtime=0 cores=0,2,4,6
/proc/2643/stat : 2643 (python) S 2488 2488 2236 0 -1 4202560 784 0 0 0 0 0 0 0 15 0 1 0 869272738 301879296 6016 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886726 0 0 16781312 33554946 3241419175570178048 0 0 17 2 0 0 0
/proc/2643/statm: 73701 6016 349 364 0 8585 0
[pid=2645] ppid=2643 vsize=8539936 CPUtime=1.75 cores=0,2,4,6
/proc/2645/stat : 2645 (java) S 2643 2645 2645 0 -1 4202496 14559 0 1 0 173 2 0 0 21 0 19 0 869272738 8744894464 12844 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/2645/statm: 2134984 12844 2230 9 0 2125725 0
[pid=2645/tid=2646] ppid=2643 vsize=8539936 CPUtime=1.13 cores=0,2,4,6
/proc/2645/task/2646/stat : 2646 (java) R 2643 2645 2645 0 -1 4202560 9051 0 1 0 112 1 0 0 20 0 19 0 869272739 8744894464 12844 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 46912505760979 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=2645/tid=2647] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2647/stat : 2647 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869272739 8744894464 12844 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2648] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2648/stat : 2648 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2649] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2649/stat : 2649 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2650] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2650/stat : 2650 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2651] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2651/stat : 2651 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2652] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2652/stat : 2652 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2653] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2653/stat : 2653 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2654] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2654/stat : 2654 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272739 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 2 0 0 0
[pid=2645/tid=2655] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2655/stat : 2655 (java) S 2643 2645 2645 0 -1 4202560 6 0 0 0 0 0 0 0 20 0 19 0 869272740 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606683136 0 0 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2656] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2656/stat : 2656 (java) S 2643 2645 2645 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869272741 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2657] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2657/stat : 2657 (java) S 2643 2645 2645 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869272741 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2658] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2658/stat : 2658 (java) S 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869272743 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606690225 0 4 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2659] ppid=2643 vsize=8539936 CPUtime=0.28 cores=0,2,4,6
/proc/2645/task/2659/stat : 2659 (java) S 2643 2645 2645 0 -1 4202560 1421 0 0 0 28 0 0 0 15 0 19 0 869272743 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 6 0 0 0
[pid=2645/tid=2660] ppid=2643 vsize=8539936 CPUtime=0.32 cores=0,2,4,6
/proc/2645/task/2660/stat : 2660 (java) S 2643 2645 2645 0 -1 4202560 2685 0 0 0 32 0 0 0 16 0 19 0 869272743 8744894464 12845 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446604446606876736 0 0 -1 0 0 0 0
[pid=2645/tid=2661] ppid=2643 vsize=8539936 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=2689/tid=2697] ppid=2488 vsize=305060 CPUtime=0 cores=0,2,4,6
/proc/2689/task/2697/stat : 2697 (python) S 2488 2488 2236 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869282630 312381440 6069 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604450645741632 0 0 -1 6 0 0 0
[pid=2698] ppid=2488 vsize=315316 CPUtime=0.06 cores=0,2,4,6
/proc/2698/stat : 2698 (python) S 2488 2488 2236 0 -1 4202560 954 0 0 0 3 3 0 0 15 0 1 0 869282633 322883584 6048 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886726 0 0 16781312 33554946 72556772316949360 0 0 17 6 0 0 0
/proc/2698/statm: 78829 6048 373 364 0 13707 0
[pid=2700] ppid=2698 vsize=30236 CPUtime=13.4 cores=0,2,4,6
/proc/2700/stat : 2700 (wbo1.4a) R 2698 2700 2700 0 -1 4202496 8841 0 0 0 1318 22 0 0 25 0 1 0 869282633 30961664 7093 33554432000 134512640 135751879 4294659920 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/2700/statm: 7559 7093 146 303 0 7254 0
[pid=2488/tid=2495] ppid=2486 vsize=325560 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 5 0 869267803 333373440 7556 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
[pid=2488/tid=2644] ppid=2486 vsize=325560 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2644/stat : 2644 (python) S 2486 2488 2236 0 -1 4202560 27 929 0 0 0 0 0 0 20 0 5 0 869272738 333373440 7556 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 2 0 0 0
[pid=2488/tid=2690] ppid=2486 vsize=325560 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2690/stat : 2690 (python) S 2486 2488 2236 0 -1 4202560 29 929 0 0 0 0 0 0 20 0 5 0 869277716 333373440 7556 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
[pid=2488/tid=2699] ppid=2486 vsize=325560 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2699/stat : 2699 (python) S 2486 2488 2236 0 -1 4202560 32 929 0 0 0 0 0 0 20 0 5 0 869282633 333373440 7556 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 163.69
Current children cumulated vsize (KiB) 10267732



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+199.902 s]
/proc/loadavg: 2.10 1.74 0.89 6/581 2727
/proc/meminfo: memFree=29138064/32950928 swapFree=34366004/67111528
[pid=2488] ppid=2486 vsize=335972 CPUtime=0.6 cores=0,2,4,6
/proc/2488/stat : 2488 (python) S 2486 2488 2236 0 -1 4202496 13504 929 1 0 50 10 0 0 20 0 6 0 869267744 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/2488/statm: 83993 7601 1879 364 0 18868 0
[pid=2494] ppid=2488 vsize=294288 CPUtime=0.22 cores=0,2,4,6
/proc/2494/stat : 2494 (python) S 2488 2488 2236 0 -1 4202560 1103 0 0 0 11 11 0 0 17 0 2 0 869267803 301350912 5949 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/2494/statm: 73572 5949 407 364 0 8459 0
[pid=2496] ppid=2494 vsize=81904 CPUtime=49.29 cores=0,2,4,6
/proc/2496/stat : 2496 (scip-2.0.1.linu) T 2494 2496 2496 0 -1 4202496 19650 0 0 0 4875 54 0 0 25 0 1 0 869267803 83869696 17871 33554432000 4194304 13684479 140735259373792 18446744073709551615 7387884 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/2496/statm: 20476 17871 819 2317 0 18154 0
[pid=2494/tid=2642] ppid=2488 vsize=294288 CPUtime=0 cores=0,2,4,6
/proc/2494/task/2642/stat : 2642 (python) S 2488 2488 2236 0 -1 4202560 43 0 0 0 0 0 0 0 17 0 2 0 869272735 301350912 5949 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604453877463168 0 0 -1 4 0 0 0
[pid=2643] ppid=2488 vsize=294804 CPUtime=0.2 cores=0,2,4,6
/proc/2643/stat : 2643 (python) S 2488 2488 2236 0 -1 4202560 1109 0 0 0 10 10 0 0 16 0 2 0 869272738 301879296 6065 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/2643/statm: 73701 6065 397 364 0 8585 0
[pid=2645] ppid=2643 vsize=8539288 CPUtime=50.61 cores=0,2,4,6
/proc/2645/stat : 2645 (java) T 2643 2645 2645 0 -1 4202496 29482 0 1 0 5055 6 0 0 18 0 19 0 869272738 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/2645/statm: 2134822 27110 2255 9 0 2125563 0
[pid=2645/tid=2646] ppid=2643 vsize=8539288 CPUtime=49.33 cores=0,2,4,6
/proc/2645/task/2646/stat : 2646 (java) T 2643 2645 2645 0 -1 4202560 9931 0 1 0 4931 2 0 0 25 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 46912505728155 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=2645/tid=2647] ppid=2643 vsize=8539288 CPUtime=0.02 cores=0,2,4,6
/proc/2645/task/2647/stat : 2647 (java) T 2643 2645 2645 0 -1 4202560 1146 0 0 0 2 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=2645/tid=2648] ppid=2643 vsize=8539288 CPUtime=0.03 cores=0,2,4,6
/proc/2645/task/2648/stat : 2648 (java) T 2643 2645 2645 0 -1 4202560 1751 0 0 0 3 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=2645/tid=2649] ppid=2643 vsize=8539288 CPUtime=0.02 cores=0,2,4,6
/proc/2645/task/2649/stat : 2649 (java) T 2643 2645 2645 0 -1 4202560 500 0 0 0 2 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=2645/tid=2650] ppid=2643 vsize=8539288 CPUtime=0.02 cores=0,2,4,6
/proc/2645/task/2650/stat : 2650 (java) T 2643 2645 2645 0 -1 4202560 849 0 0 0 2 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=2645/tid=2651] ppid=2643 vsize=8539288 CPUtime=0.01 cores=0,2,4,6
/proc/2645/task/2651/stat : 2651 (java) T 2643 2645 2645 0 -1 4202560 427 0 0 0 1 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=2645/tid=2652] ppid=2643 vsize=8539288 CPUtime=0.02 cores=0,2,4,6
/proc/2645/task/2652/stat : 2652 (java) T 2643 2645 2645 0 -1 4202560 651 0 0 0 2 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2653] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2653/stat : 2653 (java) T 2643 2645 2645 0 -1 4202560 367 0 0 0 0 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2654] ppid=2643 vsize=8539288 CPUtime=0.02 cores=0,2,4,6
/proc/2645/task/2654/stat : 2654 (java) T 2643 2645 2645 0 -1 4202560 1688 0 0 0 2 0 0 0 15 0 19 0 869272739 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=2645/tid=2655] ppid=2643 vsize=8539288 CPUtime=0.28 cores=0,2,4,6
/proc/2645/task/2655/stat : 2655 (java) T 2643 2645 2645 0 -1 4202560 5994 0 0 0 28 0 0 0 15 0 19 0 869272740 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606683136 0 0 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=2645/tid=2656] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2656/stat : 2656 (java) T 2643 2645 2645 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869272741 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=2645/tid=2657] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2657/stat : 2657 (java) T 2643 2645 2645 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869272741 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2658] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2658/stat : 2658 (java) T 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869272743 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606690225 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=2645/tid=2659] ppid=2643 vsize=8539288 CPUtime=0.34 cores=0,2,4,6
/proc/2645/task/2659/stat : 2659 (java) T 2643 2645 2645 0 -1 4202560 1432 0 0 0 34 0 0 0 15 0 19 0 869272743 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2660] ppid=2643 vsize=8539288 CPUtime=0.42 cores=0,2,4,6
/proc/2645/task/2660/stat : 2660 (java) T 2643 2645 2645 0 -1 4202560 3351 0 0 0 42 0 0 0 15 0 19 0 869272743 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=2645/tid=2661] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2661/stat : 2661 (java) T 2643 2645 2645 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869272743 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2662] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2662/stat : 2662 (java) T 2643 2645 2645 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869272743 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2645/tid=2663] ppid=2643 vsize=8539288 CPUtime=0 cores=0,2,4,6
/proc/2645/task/2663/stat : 2663 (java) T 2643 2645 2645 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869272775 8744230912 27110 33554432000 1073741824 1073778376 140733344230912 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=2643/tid=2688] ppid=2488 vsize=294804 CPUtime=0 cores=0,2,4,6
/proc/2643/task/2688/stat : 2688 (python) S 2488 2488 2236 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869277714 301879296 6065 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604449001167744 0 0 -1 6 0 0 0
[pid=2689] ppid=2488 vsize=305060 CPUtime=0.21 cores=0,2,4,6
/proc/2689/stat : 2689 (python) S 2488 2488 2236 0 -1 4202560 1123 0 0 0 10 11 0 0 16 0 2 0 869277716 312381440 6069 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/2689/statm: 76265 6069 397 364 0 11146 0
[pid=2691] ppid=2689 vsize=81276 CPUtime=49.12 cores=0,2,4,6
/proc/2691/stat : 2691 (scip-2.0.1.linu) T 2689 2691 2691 0 -1 4202496 103036 0 0 0 4874 38 0 0 25 0 1 0 869277717 83226624 16700 33554432000 4194304 15243407 140733713376688 18446744073709551615 13277498 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/2691/statm: 20319 16700 921 2698 0 17614 0
[pid=2689/tid=2697] ppid=2488 vsize=305060 CPUtime=0 cores=0,2,4,6
/proc/2689/task/2697/stat : 2697 (python) S 2488 2488 2236 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869282630 312381440 6069 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604450645741632 0 0 -1 6 0 0 0
[pid=2698] ppid=2488 vsize=315316 CPUtime=0.21 cores=0,2,4,6
/proc/2698/stat : 2698 (python) S 2488 2488 2236 0 -1 4202560 1133 0 0 0 11 10 0 0 17 0 2 0 869282633 322883584 6073 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/2698/statm: 78829 6073 397 364 0 13707 0
[pid=2700] ppid=2698 vsize=133296 CPUtime=50.24 cores=0,2,4,6
/proc/2700/stat : 2700 (wbo1.4a) T 2698 2700 2700 0 -1 4202496 34597 0 0 0 4972 52 0 0 25 0 1 0 869282633 136495104 32849 33554432000 134512640 135751879 4294659920 18446744073709551615 134610865 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/2700/statm: 33324 32849 146 303 0 33019 0
[pid=2698/tid=2706] ppid=2488 vsize=315316 CPUtime=0 cores=0,2,4,6
/proc/2698/task/2706/stat : 2706 (python) S 2488 2488 2236 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869287657 322883584 6073 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554946 18446604447774143616 0 0 -1 6 0 0 0
[pid=2707] ppid=2488 vsize=325728 CPUtime=0 cores=0,2,4,6
/proc/2707/stat : 2707 (python) S 2488 2488 2236 0 -1 4202560 819 0 0 0 0 0 0 0 15 0 1 0 869287660 333545472 6067 33554432000 4194304 5683644 140736622912896 18446744073709551615 235594886726 0 0 16781312 33554946 3974541059018457088 0 0 17 6 0 0 0
/proc/2707/statm: 81432 6067 349 364 0 16307 0
[pid=2709] ppid=2707 vsize=8537908 CPUtime=1.45 cores=0,2,4,6
/proc/2709/stat : 2709 (java) S 2707 2709 2709 0 -1 4202496 24984 0 1 0 141 4 0 0 20 0 19 0 869287660 8742817792 22883 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/2709/statm: 2134477 22883 2229 9 0 2125218 0
[pid=2709/tid=2710] ppid=2707 vsize=8537908 CPUtime=0.74 cores=0,2,4,6
/proc/2709/task/2710/stat : 2710 (java) R 2707 2709 2709 0 -1 4202560 19803 0 1 0 71 3 0 0 19 0 19 0 869287661 8742817792 24173 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 46912505787775 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=2709/tid=2711] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2711/stat : 2711 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869287662 8742817792 24178 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2712] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2712/stat : 2712 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869287662 8742817792 24180 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2713] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2713/stat : 2713 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869287662 8742817792 24180 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2714] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2714/stat : 2714 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287662 8742817792 24185 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2715] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2715/stat : 2715 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287662 8742817792 24188 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2716] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2716/stat : 2716 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287662 8742817792 24188 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2717] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2717/stat : 2717 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287662 8742817792 24192 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2718] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2718/stat : 2718 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287662 8742817792 24195 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2719] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2719/stat : 2719 (java) S 2707 2709 2709 0 -1 4202560 5 0 0 0 0 0 0 0 21 0 19 0 869287663 8742817792 24195 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606683136 0 0 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2720] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2720/stat : 2720 (java) S 2707 2709 2709 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869287663 8742817792 24199 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2721] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2721/stat : 2721 (java) S 2707 2709 2709 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869287663 8742817792 24202 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2722] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2722/stat : 2722 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287666 8742817792 24202 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606690225 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2723] ppid=2707 vsize=8537908 CPUtime=0.34 cores=0,2,4,6
/proc/2709/task/2723/stat : 2723 (java) S 2707 2709 2709 0 -1 4202560 2813 0 0 0 34 0 0 0 16 0 19 0 869287666 8742817792 24206 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 2 0 0 0
[pid=2709/tid=2724] ppid=2707 vsize=8537908 CPUtime=0.36 cores=0,2,4,6
/proc/2709/task/2724/stat : 2724 (java) S 2707 2709 2709 0 -1 4202560 2256 0 0 0 36 0 0 0 25 0 19 0 869287666 8742817792 24210 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 2 0 0 0
[pid=2709/tid=2725] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2725/stat : 2725 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869287666 8742817792 24210 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606682521 0 4 0 16800975 18446604447774145408 0 0 -1 6 0 0 0
[pid=2709/tid=2726] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2726/stat : 2726 (java) S 2707 2709 2709 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869287666 8742817792 24213 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606683136 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2709/tid=2727] ppid=2707 vsize=8537908 CPUtime=0 cores=0,2,4,6
/proc/2709/task/2727/stat : 2727 (java) S 2707 2709 2709 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869287699 8742817792 24217 33554432000 1073741824 1073778376 140737041631024 18446744073709551615 235606683136 0 4 0 16800975 18446604447774145408 0 0 -1 0 0 0 0
[pid=2488/tid=2495] ppid=2486 vsize=335972 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2495/stat : 2495 (python) S 2486 2488 2236 0 -1 4202560 25 929 0 0 0 0 0 0 19 0 6 0 869267803 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
[pid=2488/tid=2644] ppid=2486 vsize=335972 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2644/stat : 2644 (python) S 2486 2488 2236 0 -1 4202560 27 929 0 0 0 0 0 0 20 0 6 0 869272738 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 2 0 0 0
[pid=2488/tid=2690] ppid=2486 vsize=335972 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2690/stat : 2690 (python) S 2486 2488 2236 0 -1 4202560 29 929 0 0 0 0 0 0 20 0 6 0 869277716 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 6 0 0 0
[pid=2488/tid=2699] ppid=2486 vsize=335972 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2699/stat : 2699 (python) S 2486 2488 2236 0 -1 4202560 32 929 0 0 0 0 0 0 20 0 6 0 869282633 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 0 0 0 0
[pid=2488/tid=2708] ppid=2486 vsize=335972 CPUtime=0 cores=0,2,4,6
/proc/2488/task/2708/stat : 2708 (python) S 2486 2488 2236 0 -1 4202560 30 929 0 0 0 0 0 0 20 0 6 0 869287660 344035328 7601 33554432000 4194304 5683644 140736622912896 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452885095552 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 202.15
Current children cumulated vsize (KiB) 19244840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2488 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=509922
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=104984
# CPU time returned by wait4() is 0.614906
# while last known CPU time is 202.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 199.982
CPU time (s): 202.15
CPU user time (s): 200.09
CPU system time (s): 2.06
CPU usage (%): 101.084
Max. virtual memory (cumulated for all children) (KiB): 19244840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.509922
system time used= 0.104984
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14435
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1014
involuntary context switches= 20

runsolver used 1.25981 second user time and 2.24266 second system time

The end

Launcher Data 

Begin job on node120 at 2011-06-09 01:44:49
IDJOB=3481836
IDBENCH=2099
IDSOLVER=1970
FILE ID=node120/3481836-1307576688
RUNJOBID= node120-1307576358-2263
PBS_JOBID= 13547679
Free space on /tmp= 73736 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/primes-dimacs-cnf/normalized-ii8b3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481836-1307576688/watcher-3481836-1307576688 -o /tmp/evaluation-result-3481836-1307576688/solver-3481836-1307576688 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481836-1307576688.opb -seed 965477168 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 192e079d91d386374bed5b6f1f3b1921
RANDOM SEED=965477168

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30028860 kB
Buffers:        144056 kB
Cached:         556956 kB
SwapCached:      12060 kB
Active:        2437464 kB
Inactive:       174040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30028860 kB
SwapTotal:    67111528 kB
SwapFree:     34366004 kB
Dirty:          205032 kB
Writeback:           0 kB
AnonPages:     1908900 kB
Mapped:          42628 kB
Slab:           144928 kB
PageTables:      97112 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 107984764 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73636 MiB
End job on node120 at 2011-06-09 01:48:12