Trace number 3482235

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (TO) 1800.02 1789.77

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j120opt/
normalized-j12047_2.std.opb
MD5SUM3d3e67c51070a852e8117f97ab577e7c
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark134
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints256320
Number of constraints which are clauses255120
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint68
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.32/0.47	c INFO: solving HOME/instance-3482235-1307578732.opb
1.61/1.73	c INFO: parsing took 1.24 s
3.81/3.96	c INFO: features took 2.22 CPU seconds
3.81/3.99	c INFO: running wbo1.4a@0 for 45 with 1796 remaining (b = 0.56)
51.50/51.42	c INFO: running scip-2.0.1-spx@0 for 45 with 1749 remaining (b = 0.01)
98.99/98.71	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1702 remaining (b = 0.01)
148.11/144.62	c INFO: running bsolo_pb10-l3@0 for 1654 with 1654 remaining (b = 0.08)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482235-1307578732/watcher-3482235-1307578732 -o /tmp/evaluation-result-3482235-1307578732/solver-3482235-1307578732 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482235-1307578732.opb -seed 58639514 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.03 1.87 2/664 23992
/proc/meminfo: memFree=16550524/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=16244 CPUtime=0 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 1032 0 0 0 0 0 0 0 20 0 1 0 869471189 16633856 903 33554432000 4194304 5683644 140733814723472 18446744073709551615 5177344 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23992/statm: 4061 906 380 364 0 548 0

[startup+0.0290769 s]
/proc/loadavg: 1.93 2.03 1.87 2/664 23992
/proc/meminfo: memFree=16550524/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=18892 CPUtime=0.01 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 1266 0 0 0 1 0 0 0 20 0 1 0 869471189 19345408 1118 33554432000 4194304 5683644 140733814723472 18446744073709551615 4865422 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23992/statm: 4723 1118 421 364 0 692 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18892

[startup+0.101064 s]
/proc/loadavg: 1.93 2.03 1.87 2/664 23992
/proc/meminfo: memFree=16550524/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=96128 CPUtime=0.07 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 3168 930 1 0 5 2 0 0 18 0 1 0 869471189 98435072 2483 33554432000 4194304 5683644 140733814723472 18446744073709551615 5168776 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23992/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96128

[startup+0.30099 s]
/proc/loadavg: 1.93 2.03 1.87 2/664 23992
/proc/meminfo: memFree=16550524/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=203280 CPUtime=0.23 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 6713 930 1 0 17 6 0 0 17 0 1 0 869471189 208158720 4992 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 2 0 0 0
/proc/23992/statm: 50820 4992 1472 364 0 3782 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 203280

[startup+0.700941 s]
/proc/loadavg: 1.93 2.03 1.87 2/664 23992
/proc/meminfo: memFree=16550524/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=298160 CPUtime=0.61 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 12990 930 1 0 51 10 0 0 17 0 1 0 869471189 305315840 10853 33554432000 4194304 5683644 140733814723472 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23992/statm: 74540 10854 1781 364 0 9433 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 298160

[startup+1.50079 s]
/proc/loadavg: 1.93 2.03 1.87 3/665 23997
/proc/meminfo: memFree=16500544/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=327036 CPUtime=1.41 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 20157 930 1 0 131 10 0 0 18 0 1 0 869471189 334884864 18020 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550224064 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23992/statm: 81759 18021 1781 364 0 16652 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 327036

[startup+3.10048 s]
/proc/loadavg: 2.01 2.05 1.88 3/665 23997
/proc/meminfo: memFree=16474008/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=335492 CPUtime=3.01 cores=0,2,4,6
/proc/23992/stat : 23992 (python) R 23990 23992 23050 0 -1 4202496 31115 930 1 0 289 12 0 0 22 0 1 0 869471189 343543808 20220 33554432000 4194304 5683644 140733814723472 18446744073709551615 4531827 0 0 16781312 33554434 0 0 0 17 2 0 0 0
/proc/23992/statm: 83873 20220 1816 364 0 18766 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 335492

[startup+6.3009 s]
/proc/loadavg: 2.01 2.05 1.88 3/668 24000
/proc/meminfo: memFree=16414264/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=349764 CPUtime=3.9 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 32396 930 1 0 378 12 0 0 25 0 2 0 869471189 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/23992/statm: 87441 21271 1862 364 0 22328 0
[pid=23998] ppid=23992 vsize=339520 CPUtime=0 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 767 0 0 0 0 0 0 0 15 0 1 0 869471588 347668480 19756 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557711 0 0 16781312 33554946 4337649139094356226 0 0 17 2 0 0 0
/proc/23998/statm: 84880 19756 351 364 0 19767 0
[pid=24000] ppid=23998 vsize=55808 CPUtime=2.28 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) R 23998 24000 24000 0 -1 4202496 25372 0 0 0 225 3 0 0 25 0 1 0 869471589 57147392 13057 33554432000 134512640 135751879 4290473376 18446744073709551615 134638015 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/24000/statm: 13952 13057 146 303 0 13647 0
[pid=23992/tid=23999] ppid=23990 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 2 0 869471589 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 745092

[startup+12.7007 s]
/proc/loadavg: 2.09 2.06 1.88 3/668 24000
/proc/meminfo: memFree=16400900/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=349764 CPUtime=3.9 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 32396 930 1 0 378 12 0 0 25 0 2 0 869471189 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/23992/statm: 87441 21271 1862 364 0 22328 0
[pid=23998] ppid=23992 vsize=339520 CPUtime=0.04 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 927 0 0 0 2 2 0 0 15 0 1 0 869471588 347668480 19780 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557711 0 0 16781312 33554946 4294934786 0 0 17 2 0 0 0
/proc/23998/statm: 84880 19780 375 364 0 19767 0
[pid=24000] ppid=23998 vsize=54792 CPUtime=8.67 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) R 23998 24000 24000 0 -1 4202496 29203 0 0 0 862 5 0 0 25 0 1 0 869471589 56107008 13025 33554432000 134512640 135751879 4290473376 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/24000/statm: 13698 13025 146 303 0 13393 0
[pid=23992/tid=23999] ppid=23990 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 2 0 869471589 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 744076

[startup+25.5004 s]
/proc/loadavg: 2.08 2.06 1.88 3/668 24000
/proc/meminfo: memFree=16390728/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=349764 CPUtime=3.9 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 32396 930 1 0 378 12 0 0 25 0 2 0 869471189 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/23992/statm: 87441 21271 1862 364 0 22328 0
[pid=23998] ppid=23992 vsize=339520 CPUtime=0.1 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 937 0 0 0 5 5 0 0 15 0 1 0 869471588 347668480 19780 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557711 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/23998/statm: 84880 19780 375 364 0 19767 0
[pid=24000] ppid=23998 vsize=65476 CPUtime=21.47 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) R 23998 24000 24000 0 -1 4202496 32065 0 0 0 2136 11 0 0 25 0 1 0 869471589 67047424 15441 33554432000 134512640 135751879 4290473376 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/24000/statm: 16369 15441 146 303 0 16064 0
[pid=23992/tid=23999] ppid=23990 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 2 0 869471589 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 754760

[startup+51.1008 s]
/proc/loadavg: 2.05 2.05 1.89 3/668 24001
/proc/meminfo: memFree=16336008/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=349764 CPUtime=3.9 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 32396 930 1 0 378 12 0 0 25 0 2 0 869471189 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/23992/statm: 87441 21271 1862 364 0 22328 0
[pid=23998] ppid=23992 vsize=339520 CPUtime=0.21 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 945 0 0 0 10 11 0 0 15 0 1 0 869471588 347668480 19780 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557711 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/23998/statm: 84880 19780 375 364 0 19767 0
[pid=24000] ppid=23998 vsize=75652 CPUtime=47.08 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) R 23998 24000 24000 0 -1 4202496 35938 0 0 0 4688 20 0 0 25 0 1 0 869471589 77467648 18017 33554432000 134512640 135751879 4290473376 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/24000/statm: 18913 18017 146 303 0 18608 0
[pid=23992/tid=23999] ppid=23990 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 2 0 869471589 358158336 21271 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 51.19
Current children cumulated vsize (KiB) 764936

[startup+102.319 s]
/proc/loadavg: 2.11 2.07 1.90 3/694 24028
/proc/meminfo: memFree=14695352/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=370276 CPUtime=3.96 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 34160 930 1 0 383 13 0 0 20 0 4 0 869471189 379162624 21284 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23992/statm: 92569 21284 1867 364 0 27450 0
[pid=23998] ppid=23992 vsize=349764 CPUtime=0.23 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 1105 0 0 0 11 12 0 0 17 0 2 0 869471588 358158336 19816 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23998/statm: 87441 19816 406 364 0 22328 0
[pid=24000] ppid=23998 vsize=75652 CPUtime=47.37 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) T 23998 24000 24000 0 -1 4202496 35938 0 0 0 4717 20 0 0 25 0 1 0 869471589 77467648 18017 33554432000 134512640 135751879 4290473376 18446744073709551615 134616518 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/24000/statm: 18913 18017 146 303 0 18608 0
[pid=23998/tid=24002] ppid=23992 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23998/task/24002/stat : 24002 (python) S 23992 23992 23050 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869476329 358158336 19816 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604447510025152 0 0 -1 6 0 0 0
[pid=24003] ppid=23992 vsize=349776 CPUtime=0.2 cores=0,2,4,6
/proc/24003/stat : 24003 (python) S 23992 23992 23050 0 -1 4202560 1103 0 0 0 10 10 0 0 16 0 2 0 869476332 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/24003/statm: 87444 19806 396 364 0 22328 0
[pid=24005] ppid=24003 vsize=1010312 CPUtime=47.25 cores=0,2,4,6
/proc/24005/stat : 24005 (scip-2.0.1.linu) T 24003 24005 24005 0 -1 4202496 249925 0 0 0 4624 101 0 0 25 0 1 0 869476332 1034559488 245817 33554432000 4194304 13684479 140736972912320 18446744073709551615 5110634 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/24005/statm: 252578 245817 699 2317 0 250256 0
[pid=24003/tid=24007] ppid=23992 vsize=349776 CPUtime=0 cores=0,2,4,6
/proc/24003/task/24007/stat : 24007 (python) S 23992 23992 23050 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869481058 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604453021431104 0 0 -1 6 0 0 0
[pid=24008] ppid=23992 vsize=360032 CPUtime=0.02 cores=0,2,4,6
/proc/24008/stat : 24008 (python) S 23992 23992 23050 0 -1 4202560 936 0 0 0 1 1 0 0 15 0 1 0 869481061 368672768 19785 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557766 0 0 16781312 33554946 17907448433627595010 0 0 17 4 0 0 0
/proc/24008/statm: 90008 19785 372 364 0 24889 0
[pid=24010] ppid=24008 vsize=8546516 CPUtime=5.64 cores=0,2,4,6
/proc/24010/stat : 24010 (java) S 24008 24010 24010 0 -1 4202496 162721 0 1 0 542 22 0 0 20 0 19 0 869481061 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/24010/statm: 2136629 153803 2244 9 0 2127370 0
[pid=24010/tid=24011] ppid=24008 vsize=8546516 CPUtime=3.45 cores=0,2,4,6
/proc/24010/task/24011/stat : 24011 (java) R 24008 24010 24010 0 -1 4202560 119631 0 1 0 329 16 0 0 21 0 19 0 869481062 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 46912506009576 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=24010/tid=24012] ppid=24008 vsize=8546516 CPUtime=0.08 cores=0,2,4,6
/proc/24010/task/24012/stat : 24012 (java) S 24008 24010 24010 0 -1 4202560 6164 0 0 0 7 1 0 0 16 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 2 0 0 0
[pid=24010/tid=24013] ppid=24008 vsize=8546516 CPUtime=0.06 cores=0,2,4,6
/proc/24010/task/24013/stat : 24013 (java) S 24008 24010 24010 0 -1 4202560 4424 0 0 0 6 0 0 0 15 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 4 0 0 0
[pid=24010/tid=24014] ppid=24008 vsize=8546516 CPUtime=0.03 cores=0,2,4,6
/proc/24010/task/24014/stat : 24014 (java) S 24008 24010 24010 0 -1 4202560 2809 0 0 0 3 0 0 0 16 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 4 0 0 0
[pid=24010/tid=24015] ppid=24008 vsize=8546516 CPUtime=0.02 cores=0,2,4,6
/proc/24010/task/24015/stat : 24015 (java) S 24008 24010 24010 0 -1 4202560 1938 0 0 0 2 0 0 0 15 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 0 0 0 0
[pid=24010/tid=24016] ppid=24008 vsize=8546516 CPUtime=0.01 cores=0,2,4,6
/proc/24010/task/24016/stat : 24016 (java) S 24008 24010 24010 0 -1 4202560 1123 0 0 0 1 0 0 0 15 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 4 0 0 0
[pid=24010/tid=24017] ppid=24008 vsize=8546516 CPUtime=0.02 cores=0,2,4,6
/proc/24010/task/24017/stat : 24017 (java) S 24008 24010 24010 0 -1 4202560 2647 0 0 0 2 0 0 0 16 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 0 0 0 0
[pid=24010/tid=24018] ppid=24008 vsize=8546516 CPUtime=0.03 cores=0,2,4,6
/proc/24010/task/24018/stat : 24018 (java) S 24008 24010 24010 0 -1 4202560 2860 0 0 0 3 0 0 0 16 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 0 0 0 0
[pid=24010/tid=24019] ppid=24008 vsize=8546516 CPUtime=0.07 cores=0,2,4,6
/proc/24010/task/24019/stat : 24019 (java) S 24008 24010 24010 0 -1 4202560 4965 0 0 0 7 0 0 0 15 0 19 0 869481063 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 0 0 0 0
[pid=24010/tid=24020] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24020/stat : 24020 (java) S 24008 24010 24010 0 -1 4202560 463 0 0 0 0 0 0 0 15 0 19 0 869481064 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 0 0 16800975 18446604453723401152 0 0 -1 0 0 0 0
[pid=24010/tid=24021] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24021/stat : 24021 (java) S 24008 24010 24010 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 19 0 869481064 8751632384 153803 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446604453723401152 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=24003] ppid=23992 vsize=349776 CPUtime=0.2 cores=0,2,4,6
/proc/24003/stat : 24003 (python) S 23992 23992 23050 0 -1 4202560 1103 0 0 0 10 10 0 0 16 0 2 0 869476332 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/24003/statm: 87444 19806 396 364 0 22328 0
[pid=24005] ppid=24003 vsize=1010312 CPUtime=47.25 cores=0,2,4,6
/proc/24005/stat : 24005 (scip-2.0.1.linu) T 24003 24005 24005 0 -1 4202496 249925 0 0 0 4624 101 0 0 25 0 1 0 869476332 1034559488 245817 33554432000 4194304 13684479 140736972912320 18446744073709551615 5110634 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/24005/statm: 252578 245817 699 2317 0 250256 0
[pid=24003/tid=24007] ppid=23992 vsize=349776 CPUtime=0 cores=0,2,4,6
/proc/24003/task/24007/stat : 24007 (python) S 23992 23992 23050 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869481058 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604453021431104 0 0 -1 6 0 0 0
[pid=24008] ppid=23992 vsize=360032 CPUtime=0.2 cores=0,2,4,6
/proc/24008/stat : 24008 (python) S 23992 23992 23050 0 -1 4202560 1123 0 0 0 10 10 0 0 16 0 2 0 869481061 368672768 19810 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/24008/statm: 90008 19810 396 364 0 24889 0
[pid=24010] ppid=24008 vsize=8546516 CPUtime=48.9 cores=0,2,4,6
/proc/24010/stat : 24010 (java) T 24008 24010 24010 0 -1 4202496 723604 0 1 0 4809 81 0 0 18 0 19 0 869481061 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/24010/statm: 2136629 701747 2263 9 0 2127370 0
[pid=24010/tid=24011] ppid=24008 vsize=8546516 CPUtime=45.3 cores=0,2,4,6
/proc/24010/task/24011/stat : 24011 (java) T 24008 24010 24010 0 -1 4202560 629146 0 1 0 4462 68 0 0 25 0 19 0 869481062 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 46912506035562 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24012] ppid=24008 vsize=8546516 CPUtime=0.18 cores=0,2,4,6
/proc/24010/task/24012/stat : 24012 (java) T 24008 24010 24010 0 -1 4202560 12047 0 0 0 17 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24013] ppid=24008 vsize=8546516 CPUtime=0.21 cores=0,2,4,6
/proc/24010/task/24013/stat : 24013 (java) T 24008 24010 24010 0 -1 4202560 13186 0 0 0 20 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24014] ppid=24008 vsize=8546516 CPUtime=0.09 cores=0,2,4,6
/proc/24010/task/24014/stat : 24014 (java) T 24008 24010 24010 0 -1 4202560 7794 0 0 0 9 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24015] ppid=24008 vsize=8546516 CPUtime=0.1 cores=0,2,4,6
/proc/24010/task/24015/stat : 24015 (java) T 24008 24010 24010 0 -1 4202560 7446 0 0 0 9 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24016] ppid=24008 vsize=8546516 CPUtime=0.09 cores=0,2,4,6
/proc/24010/task/24016/stat : 24016 (java) T 24008 24010 24010 0 -1 4202560 7356 0 0 0 9 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24017] ppid=24008 vsize=8546516 CPUtime=0.14 cores=0,2,4,6
/proc/24010/task/24017/stat : 24017 (java) T 24008 24010 24010 0 -1 4202560 9937 0 0 0 13 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=24010/tid=24018] ppid=24008 vsize=8546516 CPUtime=0.14 cores=0,2,4,6
/proc/24010/task/24018/stat : 24018 (java) T 24008 24010 24010 0 -1 4202560 11492 0 0 0 13 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24019] ppid=24008 vsize=8546516 CPUtime=0.13 cores=0,2,4,6
/proc/24010/task/24019/stat : 24019 (java) T 24008 24010 24010 0 -1 4202560 8116 0 0 0 13 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24020] ppid=24008 vsize=8546516 CPUtime=0.2 cores=0,2,4,6
/proc/24010/task/24020/stat : 24020 (java) T 24008 24010 24010 0 -1 4202560 1361 0 0 0 20 0 0 0 15 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24021] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24021/stat : 24021 (java) T 24008 24010 24010 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24022] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24022/stat : 24022 (java) T 24008 24010 24010 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24023] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24023/stat : 24023 (java) T 24008 24010 24010 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562361265 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24024] ppid=24008 vsize=8546516 CPUtime=1.17 cores=0,2,4,6
/proc/24010/task/24024/stat : 24024 (java) T 24008 24010 24010 0 -1 4202560 5689 0 0 0 116 1 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24025] ppid=24008 vsize=8546516 CPUtime=1.03 cores=0,2,4,6
/proc/24010/task/24025/stat : 24025 (java) T 24008 24010 24010 0 -1 4202560 8641 0 0 0 102 1 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24026] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24026/stat : 24026 (java) T 24008 24010 24010 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24027] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24027/stat : 24027 (java) T 24008 24010 24010 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=24010/tid=24028] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24028/stat : 24028 (java) T 24008 24010 24010 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869481220 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24008/tid=24030] ppid=23992 vsize=360032 CPUtime=0 cores=0,2,4,6
/proc/24008/task/24030/stat : 24030 (python) S 23992 23992 23050 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869485649 368672768 19810 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604448148627648 0 0 -1 6 0 0 0
[pid=24031] ppid=23992 vsize=370288 CPUtime=6.74 cores=0,2,4,6
/proc/24031/stat : 24031 (python) S 23992 23992 23050 0 -1 4202560 1047 0 0 0 341 333 0 0 15 0 1 0 869485652 379174912 19789 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557766 0 0 16781312 33554946 72556772316949243 0 0 17 6 0 0 0
/proc/24031/statm: 92572 19789 372 364 0 27450 0
[pid=24033] ppid=24031 vsize=876364 CPUtime=1645.14 cores=0,2,4,6
/proc/24033/stat : 24033 (bsolo_pb10) R 24031 24033 24033 0 -1 4202496 20666949 0 0 0 162226 2288 0 0 25 0 1 0 869485652 897396736 216446 33554432000 134512640 137138936 4292528752 18446744073709551615 134542649 0 0 16781312 16384 0 0 0 17 0 0 0 0
/proc/24033/statm: 219091 216446 192 642 0 218447 0
[pid=23992/tid=23999] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 5 0 869471589 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
[pid=23992/tid=24004] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24004/stat : 24004 (python) S 23990 23992 23050 0 -1 4202560 25 930 0 0 0 0 0 0 20 0 5 0 869476332 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
[pid=23992/tid=24009] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24009/stat : 24009 (python) S 23990 23992 23050 0 -1 4202560 29 930 0 0 0 0 0 0 20 0 5 0 869481061 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 4 0 0 0
[pid=23992/tid=24032] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24032/stat : 24032 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 869485652 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 12319236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1789.72 s]
/proc/loadavg: 1.10 1.11 1.34 2/680 24095
/proc/meminfo: memFree=13344848/32951124 swapFree=55639044/67111528
[pid=23992] ppid=23990 vsize=380532 CPUtime=3.99 cores=0,2,4,6
/proc/23992/stat : 23992 (python) S 23990 23992 23050 0 -1 4202496 35079 930 1 0 385 14 0 0 20 0 5 0 869471189 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23992/statm: 95133 21298 1877 364 0 30011 0
[pid=23998] ppid=23992 vsize=349764 CPUtime=0.23 cores=0,2,4,6
/proc/23998/stat : 23998 (python) S 23992 23992 23050 0 -1 4202560 1105 0 0 0 11 12 0 0 17 0 2 0 869471588 358158336 19816 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23998/statm: 87441 19816 406 364 0 22328 0
[pid=24000] ppid=23998 vsize=75652 CPUtime=47.37 cores=0,2,4,6
/proc/24000/stat : 24000 (wbo1.4a) T 23998 24000 24000 0 -1 4202496 35938 0 0 0 4717 20 0 0 25 0 1 0 869471589 77467648 18017 33554432000 134512640 135751879 4290473376 18446744073709551615 134616518 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/24000/statm: 18913 18017 146 303 0 18608 0
[pid=23998/tid=24002] ppid=23992 vsize=349764 CPUtime=0 cores=0,2,4,6
/proc/23998/task/24002/stat : 24002 (python) S 23992 23992 23050 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869476329 358158336 19816 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604447510025152 0 0 -1 6 0 0 0
[pid=24003] ppid=23992 vsize=349776 CPUtime=0.2 cores=0,2,4,6
/proc/24003/stat : 24003 (python) S 23992 23992 23050 0 -1 4202560 1103 0 0 0 10 10 0 0 16 0 2 0 869476332 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/24003/statm: 87444 19806 396 364 0 22328 0
[pid=24005] ppid=24003 vsize=1010312 CPUtime=47.25 cores=0,2,4,6
/proc/24005/stat : 24005 (scip-2.0.1.linu) T 24003 24005 24005 0 -1 4202496 249925 0 0 0 4624 101 0 0 25 0 1 0 869476332 1034559488 245817 33554432000 4194304 13684479 140736972912320 18446744073709551615 5110634 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/24005/statm: 252578 245817 699 2317 0 250256 0
[pid=24003/tid=24007] ppid=23992 vsize=349776 CPUtime=0 cores=0,2,4,6
/proc/24003/task/24007/stat : 24007 (python) S 23992 23992 23050 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869481058 358170624 19806 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604453021431104 0 0 -1 6 0 0 0
[pid=24008] ppid=23992 vsize=360032 CPUtime=0.2 cores=0,2,4,6
/proc/24008/stat : 24008 (python) S 23992 23992 23050 0 -1 4202560 1123 0 0 0 10 10 0 0 16 0 2 0 869481061 368672768 19810 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/24008/statm: 90008 19810 396 364 0 24889 0
[pid=24010] ppid=24008 vsize=8546516 CPUtime=48.9 cores=0,2,4,6
/proc/24010/stat : 24010 (java) T 24008 24010 24010 0 -1 4202496 723604 0 1 0 4809 81 0 0 18 0 19 0 869481061 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/24010/statm: 2136629 701747 2263 9 0 2127370 0
[pid=24010/tid=24011] ppid=24008 vsize=8546516 CPUtime=45.3 cores=0,2,4,6
/proc/24010/task/24011/stat : 24011 (java) T 24008 24010 24010 0 -1 4202560 629146 0 1 0 4462 68 0 0 25 0 19 0 869481062 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 46912506035562 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24012] ppid=24008 vsize=8546516 CPUtime=0.18 cores=0,2,4,6
/proc/24010/task/24012/stat : 24012 (java) T 24008 24010 24010 0 -1 4202560 12047 0 0 0 17 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24013] ppid=24008 vsize=8546516 CPUtime=0.21 cores=0,2,4,6
/proc/24010/task/24013/stat : 24013 (java) T 24008 24010 24010 0 -1 4202560 13186 0 0 0 20 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24014] ppid=24008 vsize=8546516 CPUtime=0.09 cores=0,2,4,6
/proc/24010/task/24014/stat : 24014 (java) T 24008 24010 24010 0 -1 4202560 7794 0 0 0 9 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24015] ppid=24008 vsize=8546516 CPUtime=0.1 cores=0,2,4,6
/proc/24010/task/24015/stat : 24015 (java) T 24008 24010 24010 0 -1 4202560 7446 0 0 0 9 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24016] ppid=24008 vsize=8546516 CPUtime=0.09 cores=0,2,4,6
/proc/24010/task/24016/stat : 24016 (java) T 24008 24010 24010 0 -1 4202560 7356 0 0 0 9 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24017] ppid=24008 vsize=8546516 CPUtime=0.14 cores=0,2,4,6
/proc/24010/task/24017/stat : 24017 (java) T 24008 24010 24010 0 -1 4202560 9937 0 0 0 13 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=24010/tid=24018] ppid=24008 vsize=8546516 CPUtime=0.14 cores=0,2,4,6
/proc/24010/task/24018/stat : 24018 (java) T 24008 24010 24010 0 -1 4202560 11492 0 0 0 13 1 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=24010/tid=24019] ppid=24008 vsize=8546516 CPUtime=0.13 cores=0,2,4,6
/proc/24010/task/24019/stat : 24019 (java) T 24008 24010 24010 0 -1 4202560 8116 0 0 0 13 0 0 0 15 0 19 0 869481063 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24020] ppid=24008 vsize=8546516 CPUtime=0.2 cores=0,2,4,6
/proc/24010/task/24020/stat : 24020 (java) T 24008 24010 24010 0 -1 4202560 1361 0 0 0 20 0 0 0 15 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24021] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24021/stat : 24021 (java) T 24008 24010 24010 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24022] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24022/stat : 24022 (java) T 24008 24010 24010 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869481064 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24023] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24023/stat : 24023 (java) T 24008 24010 24010 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562361265 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24024] ppid=24008 vsize=8546516 CPUtime=1.17 cores=0,2,4,6
/proc/24010/task/24024/stat : 24024 (java) T 24008 24010 24010 0 -1 4202560 5689 0 0 0 116 1 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24025] ppid=24008 vsize=8546516 CPUtime=1.03 cores=0,2,4,6
/proc/24010/task/24025/stat : 24025 (java) T 24008 24010 24010 0 -1 4202560 8641 0 0 0 102 1 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=24010/tid=24026] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24026/stat : 24026 (java) T 24008 24010 24010 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24010/tid=24027] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24027/stat : 24027 (java) T 24008 24010 24010 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869481066 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=24010/tid=24028] ppid=24008 vsize=8546516 CPUtime=0 cores=0,2,4,6
/proc/24010/task/24028/stat : 24028 (java) T 24008 24010 24010 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869481220 8751632384 701747 33554432000 1073741824 1073778376 140736486458992 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=24008/tid=24030] ppid=23992 vsize=360032 CPUtime=0 cores=0,2,4,6
/proc/24008/task/24030/stat : 24030 (python) S 23992 23992 23050 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869485649 368672768 19810 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554946 18446604448148627648 0 0 -1 6 0 0 0
[pid=24031] ppid=23992 vsize=370288 CPUtime=6.74 cores=0,2,4,6
/proc/24031/stat : 24031 (python) S 23992 23992 23050 0 -1 4202560 1047 0 0 0 341 333 0 0 15 0 1 0 869485652 379174912 19789 33554432000 4194304 5683644 140733814723472 18446744073709551615 271550557766 0 0 16781312 33554946 72556772316949243 0 0 17 6 0 0 0
/proc/24031/statm: 92572 19789 372 364 0 27450 0
[pid=24033] ppid=24031 vsize=876364 CPUtime=1645.14 cores=0,2,4,6
/proc/24033/stat : 24033 (bsolo_pb10) R 24031 24033 24033 0 -1 4202496 20666949 0 0 0 162226 2288 0 0 25 0 1 0 869485652 897396736 216446 33554432000 134512640 137138936 4292528752 18446744073709551615 134542649 0 0 16781312 16384 0 0 0 17 0 0 0 0
/proc/24033/statm: 219091 216446 192 642 0 218447 0
[pid=23992/tid=23999] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/23999/stat : 23999 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 25 0 5 0 869471589 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
[pid=23992/tid=24004] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24004/stat : 24004 (python) S 23990 23992 23050 0 -1 4202560 25 930 0 0 0 0 0 0 20 0 5 0 869476332 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 2 0 0 0
[pid=23992/tid=24009] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24009/stat : 24009 (python) S 23990 23992 23050 0 -1 4202560 29 930 0 0 0 0 0 0 20 0 5 0 869481061 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 4 0 0 0
[pid=23992/tid=24032] ppid=23990 vsize=380532 CPUtime=0 cores=0,2,4,6
/proc/23992/task/24032/stat : 24032 (python) S 23990 23992 23050 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 869485652 389664768 21298 33554432000 4194304 5683644 140733814723472 18446744073709551615 271562361265 0 0 16781312 33554434 18446604447597606144 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 12319236

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23992 and gives
#  childrusage.ru_utime.tv_sec=3
#  childrusage.ru_utime.tv_usec=854414
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=146977
# CPU time returned by wait4() is 4.00139
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1789.77
CPU time (s): 1800.02
CPU user time (s): 1771.33
CPU system time (s): 28.69
CPU usage (%): 100.573
Max. virtual memory (cumulated for all children) (KiB): 12319412

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.85441
system time used= 0.146977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 36011
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1007
involuntary context switches= 21

runsolver used 14.5378 second user time and 31.3652 second system time

The end

Launcher Data 

Begin job on node133 at 2011-06-09 02:18:52
IDJOB=3482235
IDBENCH=77174
IDSOLVER=1970
FILE ID=node133/3482235-1307578732
RUNJOBID= node133-1307576356-23068
PBS_JOBID= 13547666
Free space on /tmp= 73580 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j120opt/normalized-j12047_2.std.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482235-1307578732/watcher-3482235-1307578732 -o /tmp/evaluation-result-3482235-1307578732/solver-3482235-1307578732 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482235-1307578732.opb -seed 58639514 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3d3e67c51070a852e8117f97ab577e7c
RANDOM SEED=58639514

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16550556 kB
Buffers:        157036 kB
Cached:         803132 kB
SwapCached:      10460 kB
Active:       15913760 kB
Inactive:       177640 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16550556 kB
SwapTotal:    67111528 kB
SwapFree:     55639044 kB
Dirty:          110476 kB
Writeback:           0 kB
AnonPages:    15129128 kB
Mapped:          87432 kB
Slab:           147800 kB
PageTables:      89788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135644908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73560 MiB
End job on node133 at 2011-06-09 02:48:45