Trace number 3482316

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 220.91 217.885

General information on the benchmark

Name/OPT-SMALLINT-LIN/kullmann/
normalized-mul_8_11_shg.opb
MD5SUM72d0920292366751823d98a716f59807
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark76
Best CPU time to get the best result obtained on this benchmark1799.59
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables15008
Total number of constraints65280
Number of constraints which are clauses65280
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint65
Maximum length of a constraint90
Number of terms in the objective function 15008
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 15008
Number of bits of the sum of numbers in the objective function 14
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 15008
Number of bits of the biggest sum of numbers14
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.37/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/0.69	c INFO: solving HOME/instance-3482316-1307579000.opb
8.44/8.73	c INFO: parsing took 7.89 s
23.84/24.13	c INFO: features took 15.36 CPU seconds
23.84/24.16	c INFO: running bsolo_pb10-l3@0 for 45 with 1776 remaining (b = 0.44)
74.74/74.83	c INFO: running wbo1.4a@0 for 45 with 1726 remaining (b = 0.02)
125.52/125.47	c INFO: running bsolo_pb10-l3@50 for 45 with 1675 remaining (b = 0.00)
171.03/170.70	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1630 remaining (b = 0.18)
219.48/216.72	c INFO: running sat4j-pb-v20101225@0 for 91 with 1582 remaining (b = 0.04)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482316-1307579000/watcher-3482316-1307579000 -o /tmp/evaluation-result-3482316-1307579000/solver-3482316-1307579000 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482316-1307579000.opb -seed 713042191 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.11 1.97 2/770 4834
/proc/meminfo: memFree=8717024/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 859 0 0 0 0 0 0 0 20 0 1 0 869498431 16154624 741 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516833936 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4834/statm: 3944 741 335 364 0 431 0

[startup+0.135091 s]
/proc/loadavg: 2.13 2.11 1.97 2/770 4834
/proc/meminfo: memFree=8717024/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=96128 CPUtime=0.09 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 3168 929 1 0 7 2 0 0 18 0 1 0 869498431 98435072 2484 33554432000 4194304 5683644 140737005306224 18446744073709551615 5170248 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/4834/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 96128

[startup+0.201399 s]
/proc/loadavg: 2.13 2.11 1.97 2/770 4834
/proc/meminfo: memFree=8717024/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=117900 CPUtime=0.13 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 4918 929 1 0 9 4 0 0 17 0 1 0 869498431 120729600 3345 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516830053 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/4834/statm: 29475 3345 916 364 0 2445 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 117900

[startup+0.301102 s]
/proc/loadavg: 2.13 2.11 1.97 2/770 4834
/proc/meminfo: memFree=8717024/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=123740 CPUtime=0.18 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 5357 929 1 0 12 6 0 0 17 0 1 0 869498431 126709760 3744 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516830213 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/4834/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 123740

[startup+0.700983 s]
/proc/loadavg: 2.13 2.11 1.97 2/770 4834
/proc/meminfo: memFree=8717024/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=330728 CPUtime=0.44 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 11435 929 1 0 31 13 0 0 16 0 1 0 869498431 338665472 9298 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516834048 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4834/statm: 82682 9298 1776 364 0 17575 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 330728

[startup+1.50087 s]
/proc/loadavg: 2.13 2.11 1.97 3/771 4839
/proc/meminfo: memFree=8634928/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=354900 CPUtime=1.24 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 27133 929 1 0 108 16 0 0 16 0 1 0 869498431 363417600 24996 33554432000 4194304 5683644 140737005306224 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4834/statm: 88725 24996 1781 364 0 23618 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 354900

[startup+3.10058 s]
/proc/loadavg: 2.13 2.11 1.97 3/771 4839
/proc/meminfo: memFree=8600780/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=404792 CPUtime=2.84 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 39173 929 1 0 266 18 0 0 18 0 1 0 869498431 414507008 37036 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516495045 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4834/statm: 101198 37036 1781 364 0 36091 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 404792

[startup+6.30097 s]
/proc/loadavg: 2.12 2.11 1.97 3/771 4839
/proc/meminfo: memFree=8499976/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=501336 CPUtime=6.04 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 63136 929 1 0 583 21 0 0 25 0 1 0 869498431 513368064 60999 33554432000 4194304 5683644 140737005306224 18446744073709551615 4602336 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4834/statm: 125334 60999 1781 364 0 60227 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 501336

[startup+12.7008 s]
/proc/loadavg: 2.11 2.11 1.97 3/771 4839
/proc/meminfo: memFree=8399528/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=577232 CPUtime=12.44 cores=0,2,4,6
/proc/4834/stat : 4834 (python) R 4832 4834 1406 0 -1 4202496 137373 929 1 0 1213 31 0 0 25 0 1 0 869498431 591085568 80655 33554432000 4194304 5683644 140737005306224 18446744073709551615 47373883306165 0 0 16781312 33554434 0 0 0 17 2 0 0 0
/proc/4834/statm: 144308 80655 1815 364 0 79201 0
Current children cumulated CPU time (s) 12.44
Current children cumulated vsize (KiB) 577232

[startup+25.5005 s]
/proc/loadavg: 2.16 2.12 1.97 3/774 4842
/proc/meminfo: memFree=8481304/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=484568 CPUtime=23.91 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 138174 929 1 0 2358 33 0 0 25 0 2 0 869498431 496197632 54983 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/4834/statm: 121142 54983 1872 364 0 56029 0
[pid=4840] ppid=4834 vsize=474836 CPUtime=0 cores=0,2,4,6
/proc/4840/stat : 4840 (python) S 4834 4834 1406 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 869500847 486232064 53461 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516854287 0 0 16781312 33554946 3538839991461314819 0 0 17 6 0 0 0
/proc/4840/statm: 118709 53461 353 364 0 53596 0
[pid=4842] ppid=4840 vsize=82072 CPUtime=1.31 cores=0,2,4,6
/proc/4842/stat : 4842 (bsolo_pb10) R 4840 4842 4842 0 -1 4202496 9928 0 0 0 130 1 0 0 25 0 1 0 869500847 84041728 9674 33554432000 134512640 137138936 4288153152 18446744073709551615 134531166 0 0 16781312 16384 0 0 0 17 0 0 0 0
/proc/4842/statm: 20518 9674 3837 642 0 7794 0
[pid=4834/tid=4841] ppid=4832 vsize=484568 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 25 0 2 0 869500847 496197632 54983 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 1041476

[startup+51.1008 s]
/proc/loadavg: 2.11 2.11 1.97 3/774 4843
/proc/meminfo: memFree=8317012/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=484568 CPUtime=23.91 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 138174 929 1 0 2358 33 0 0 25 0 2 0 869498431 496197632 54983 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/4834/statm: 121142 54983 1872 364 0 56029 0
[pid=4840] ppid=4834 vsize=474836 CPUtime=0.11 cores=0,2,4,6
/proc/4840/stat : 4840 (python) S 4834 4834 1406 0 -1 4202560 927 0 0 0 6 5 0 0 15 0 1 0 869500847 486232064 53485 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516854287 0 0 16781312 33554946 72556772316949270 0 0 17 6 0 0 0
/proc/4840/statm: 118709 53485 377 364 0 53596 0
[pid=4842] ppid=4840 vsize=197576 CPUtime=26.92 cores=0,2,4,6
/proc/4842/stat : 4842 (bsolo_pb10) R 4840 4842 4842 0 -1 4202496 81370 0 0 0 2672 20 0 0 25 0 1 0 869500847 202317824 46955 33554432000 134512640 137138936 4288153152 18446744073709551615 134542620 0 0 16781312 16384 0 0 0 17 0 0 0 0
/proc/4842/statm: 49394 46955 192 642 0 48750 0
[pid=4834/tid=4841] ppid=4832 vsize=484568 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 25 0 2 0 869500847 496197632 54983 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 1156980

[startup+102.302 s]
/proc/loadavg: 2.22 2.14 1.99 3/778 4848
/proc/meminfo: memFree=8079580/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=494824 CPUtime=23.93 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 139080 929 1 0 2360 33 0 0 20 0 3 0 869498431 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/4834/statm: 123706 54990 1875 364 0 58590 0
[pid=4840] ppid=4834 vsize=485080 CPUtime=0.22 cores=0,2,4,6
/proc/4840/stat : 4840 (python) S 4834 4834 1406 0 -1 4202560 1107 0 0 0 12 10 0 0 17 0 2 0 869500847 496721920 53520 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/4840/statm: 121270 53520 407 364 0 56157 0
[pid=4842] ppid=4840 vsize=346196 CPUtime=50.6 cores=0,2,4,6
/proc/4842/stat : 4842 (bsolo_pb10) T 4840 4842 4842 0 -1 4202496 118530 0 0 0 5034 26 0 0 25 0 1 0 869500847 354504704 84115 33554432000 134512640 137138936 4288153152 18446744073709551615 134618214 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/4842/statm: 86549 84115 192 642 0 85905 0
[pid=4840/tid=4845] ppid=4834 vsize=485080 CPUtime=0 cores=0,2,4,6
/proc/4840/task/4845/stat : 4845 (python) S 4834 4834 1406 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869505910 496721920 53520 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604452249858368 0 0 -1 6 0 0 0
[pid=4846] ppid=4834 vsize=485092 CPUtime=0.13 cores=0,2,4,6
/proc/4846/stat : 4846 (python) S 4834 4834 1406 0 -1 4202560 970 0 0 0 6 7 0 0 15 0 1 0 869505914 496734208 53486 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516854342 0 0 16781312 33554946 72556772316949270 0 0 17 6 0 0 0
/proc/4846/statm: 121273 53486 374 364 0 56157 0
[pid=4848] ppid=4846 vsize=70988 CPUtime=27.46 cores=0,2,4,6
/proc/4848/stat : 4848 (wbo1.4a) R 4846 4848 4848 0 -1 4202496 30881 0 0 0 2737 9 0 0 25 0 1 0 869505914 72691712 17166 33554432000 134512640 135751879 4288113696 18446744073709551615 134518470 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/4848/statm: 17747 17166 146 303 0 17442 0
[pid=4834/tid=4841] ppid=4832 vsize=494824 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 25 0 3 0 869500847 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4847] ppid=4832 vsize=494824 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4847/stat : 4847 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 20 0 3 0 869505914 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.34
Current children cumulated vsize (KiB) 1882180

[startup+162.301 s]
/proc/loadavg: 2.08 2.11 1.99 3/779 4851
/proc/meminfo: memFree=7911208/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=494824 CPUtime=23.96 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 139700 929 1 0 2363 33 0 0 18 0 3 0 869498431 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/4834/statm: 123706 54990 1875 364 0 58590 0
[pid=4840] ppid=4834 vsize=485080 CPUtime=0.38 cores=0,2,4,6
/proc/4840/stat : 4840 (python) S 4834 4834 1406 0 -1 4202560 1127 0 0 0 19 19 0 0 15 0 2 0 869500847 496721920 53521 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516854342 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/4840/statm: 121270 53521 408 364 0 56157 0
[pid=4842] ppid=4840 vsize=443880 CPUtime=87.43 cores=0,2,4,6
/proc/4842/stat : 4842 (bsolo_pb10) R 4840 4842 4842 0 -1 4202496 142997 0 0 0 8714 29 0 0 25 0 1 0 869500847 454533120 108528 33554432000 134512640 137138936 4288153152 18446744073709551615 134542480 0 0 16781312 16384 0 0 0 17 0 0 0 0
/proc/4842/statm: 110970 108528 192 642 0 110326 0
[pid=4840/tid=4845] ppid=4834 vsize=485080 CPUtime=0 cores=0,2,4,6
/proc/4840/task/4845/stat : 4845 (python) S 4834 4834 1406 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869505910 496721920 53521 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604452249858368 0 0 -1 6 0 0 0
[pid=4846] ppid=4834 vsize=485092 CPUtime=0.22 cores=0,2,4,6
/proc/4846/stat : 4846 (python) S 4834 4834 1406 0 -1 4202560 1156 0 0 0 11 11 0 0 17 0 2 0 869505914 496734208 53510 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/4846/statm: 121273 53510 397 364 0 56157 0
[pid=4848] ppid=4846 vsize=128328 CPUtime=50.6 cores=0,2,4,6
/proc/4848/stat : 4848 (wbo1.4a) T 4846 4848 4848 0 -1 4202496 45254 0 0 0 5041 19 0 0 25 0 1 0 869505914 131407872 31539 33554432000 134512640 135751879 4288113696 18446744073709551615 134606393 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/4848/statm: 32082 31539 146 303 0 31777 0
[pid=4846/tid=4850] ppid=4834 vsize=485092 CPUtime=0 cores=0,2,4,6
/proc/4846/task/4850/stat : 4850 (python) S 4834 4834 1406 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869510975 496734208 53510 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453635612992 0 0 -1 6 0 0 0
[pid=4834/tid=4841] ppid=4832 vsize=494824 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 32 929 0 0 0 0 0 0 18 0 3 0 869500847 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4847] ppid=4832 vsize=494824 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4847/stat : 4847 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 20 0 3 0 869505914 506699776 54990 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 162.59
Current children cumulated vsize (KiB) 2037204



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+217.801 s]
/proc/loadavg: 2.03 2.09 1.99 4/821 4894
/proc/meminfo: memFree=6581684/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=515336 CPUtime=24.01 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 140930 929 1 0 2367 34 0 0 20 0 5 0 869498431 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/4834/statm: 128834 55002 1879 364 0 63712 0

################
# More data... #
################

[pid=4877/tid=4883] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4883/stat : 4883 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4884] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4884/stat : 4884 (java) S 4875 4877 4877 0 -1 4202560 365 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 0 0 0 0
[pid=4877/tid=4885] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4885/stat : 4885 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4886] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4886/stat : 4886 (java) S 4875 4877 4877 0 -1 4202560 157 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4887] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4887/stat : 4887 (java) S 4875 4877 4877 0 -1 4202560 71 0 0 0 0 0 0 0 16 0 18 0 869520106 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650752 0 0 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4888] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4888/stat : 4888 (java) S 4875 4877 4877 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 18 0 869520107 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4889] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4889/stat : 4889 (java) S 4875 4877 4877 0 -1 4202560 10 0 0 0 0 0 0 0 19 0 18 0 869520107 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4890] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4890/stat : 4890 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528657841 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4891] ppid=4875 vsize=8538840 CPUtime=0.14 cores=0,2,4,6
/proc/4877/task/4891/stat : 4891 (java) S 4875 4877 4877 0 -1 4202560 1302 0 0 0 14 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4892] ppid=4875 vsize=8538840 CPUtime=0.17 cores=0,2,4,6
/proc/4877/task/4892/stat : 4892 (java) S 4875 4877 4877 0 -1 4202560 2131 0 0 0 17 0 0 0 15 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4893] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4893/stat : 4893 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4894] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4894/stat : 4894 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650752 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4834/tid=4841] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 32 929 0 0 0 0 0 0 18 0 5 0 869500847 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4847] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4847/stat : 4847 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 20 0 5 0 869505914 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4853] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4853/stat : 4853 (python) S 4832 4834 1406 0 -1 4202560 29 929 0 0 0 0 0 0 20 0 5 0 869515501 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 0 0 0 0
[pid=4834/tid=4876] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4876/stat : 4876 (python) S 4832 4834 1406 0 -1 4202560 30 929 0 0 0 0 0 0 20 0 5 0 869520104 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 220.91
Current children cumulated vsize (KiB) 20152816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+217.801 s]
/proc/loadavg: 2.03 2.09 1.99 4/821 4894
/proc/meminfo: memFree=6581684/32951124 swapFree=43359760/67111528
[pid=4834] ppid=4832 vsize=515336 CPUtime=24.01 cores=0,2,4,6
/proc/4834/stat : 4834 (python) S 4832 4834 1406 0 -1 4202496 140930 929 1 0 2367 34 0 0 20 0 5 0 869498431 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/4834/statm: 128834 55002 1879 364 0 63712 0
[pid=4840] ppid=4834 vsize=485080 CPUtime=0.42 cores=0,2,4,6
/proc/4840/stat : 4840 (python) S 4834 4834 1406 0 -1 4202560 1129 0 0 0 21 21 0 0 15 0 2 0 869500847 496721920 53521 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/4840/statm: 121270 53521 408 364 0 56157 0
[pid=4842] ppid=4840 vsize=459872 CPUtime=95.81 cores=0,2,4,6
/proc/4842/stat : 4842 (bsolo_pb10) T 4840 4842 4842 0 -1 4202496 147077 0 0 0 9551 30 0 0 25 0 1 0 869500847 470908928 112553 33554432000 134512640 137138936 4288153152 18446744073709551615 134542480 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/4842/statm: 114968 112553 192 642 0 114324 0
[pid=4840/tid=4845] ppid=4834 vsize=485080 CPUtime=0 cores=0,2,4,6
/proc/4840/task/4845/stat : 4845 (python) S 4834 4834 1406 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 869505910 496721920 53521 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604452249858368 0 0 -1 6 0 0 0
[pid=4846] ppid=4834 vsize=485092 CPUtime=0.22 cores=0,2,4,6
/proc/4846/stat : 4846 (python) S 4834 4834 1406 0 -1 4202560 1156 0 0 0 11 11 0 0 17 0 2 0 869505914 496734208 53510 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/4846/statm: 121273 53510 397 364 0 56157 0
[pid=4848] ppid=4846 vsize=128328 CPUtime=50.6 cores=0,2,4,6
/proc/4848/stat : 4848 (wbo1.4a) T 4846 4848 4848 0 -1 4202496 45254 0 0 0 5041 19 0 0 25 0 1 0 869505914 131407872 31539 33554432000 134512640 135751879 4288113696 18446744073709551615 134606393 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/4848/statm: 32082 31539 146 303 0 31777 0
[pid=4846/tid=4850] ppid=4834 vsize=485092 CPUtime=0 cores=0,2,4,6
/proc/4846/task/4850/stat : 4850 (python) S 4834 4834 1406 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869510975 496734208 53510 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604453635612992 0 0 -1 6 0 0 0
[pid=4852] ppid=4834 vsize=495348 CPUtime=0.21 cores=0,2,4,6
/proc/4852/stat : 4852 (python) S 4834 4834 1406 0 -1 4202560 1152 0 0 0 10 11 0 0 17 0 2 0 869515501 507236352 53514 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/4852/statm: 123837 53514 397 364 0 58718 0
[pid=4854] ppid=4852 vsize=8539316 CPUtime=48.22 cores=0,2,4,6
/proc/4854/stat : 4854 (java) T 4852 4854 4854 0 -1 4202496 292303 0 1 0 4772 50 0 0 18 0 19 0 869515502 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4854/statm: 2134829 285692 2249 9 0 2125570 0
[pid=4854/tid=4855] ppid=4852 vsize=8539316 CPUtime=45.88 cores=0,2,4,6
/proc/4854/task/4855/stat : 4855 (java) T 4852 4854 4854 0 -1 4202560 247568 0 1 0 4549 39 0 0 25 0 19 0 869515503 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 46912506172345 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4856] ppid=4852 vsize=8539316 CPUtime=0.05 cores=0,2,4,6
/proc/4854/task/4856/stat : 4856 (java) T 4852 4854 4854 0 -1 4202560 7908 0 0 0 4 1 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4857] ppid=4852 vsize=8539316 CPUtime=0.04 cores=0,2,4,6
/proc/4854/task/4857/stat : 4857 (java) T 4852 4854 4854 0 -1 4202560 5069 0 0 0 3 1 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=4854/tid=4858] ppid=4852 vsize=8539316 CPUtime=0.02 cores=0,2,4,6
/proc/4854/task/4858/stat : 4858 (java) T 4852 4854 4854 0 -1 4202560 2990 0 0 0 2 0 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=4854/tid=4859] ppid=4852 vsize=8539316 CPUtime=0.04 cores=0,2,4,6
/proc/4854/task/4859/stat : 4859 (java) T 4852 4854 4854 0 -1 4202560 4853 0 0 0 3 1 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=4854/tid=4860] ppid=4852 vsize=8539316 CPUtime=0.04 cores=0,2,4,6
/proc/4854/task/4860/stat : 4860 (java) T 4852 4854 4854 0 -1 4202560 5431 0 0 0 3 1 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4861] ppid=4852 vsize=8539316 CPUtime=0.01 cores=0,2,4,6
/proc/4854/task/4861/stat : 4861 (java) T 4852 4854 4854 0 -1 4202560 2339 0 0 0 1 0 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4862] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4862/stat : 4862 (java) T 4852 4854 4854 0 -1 4202560 1229 0 0 0 0 0 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=4854/tid=4863] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4863/stat : 4863 (java) T 4852 4854 4854 0 -1 4202560 447 0 0 0 0 0 0 0 15 0 19 0 869515504 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4864] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4864/stat : 4864 (java) T 4852 4854 4854 0 -1 4202560 967 0 0 0 0 0 0 0 15 0 19 0 869515505 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650752 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4865] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4865/stat : 4865 (java) T 4852 4854 4854 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869515505 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4866] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4866/stat : 4866 (java) T 4852 4854 4854 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869515505 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=4854/tid=4867] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4867/stat : 4867 (java) T 4852 4854 4854 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869515507 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528657841 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4868] ppid=4852 vsize=8539316 CPUtime=0.83 cores=0,2,4,6
/proc/4854/task/4868/stat : 4868 (java) T 4852 4854 4854 0 -1 4202560 2302 0 0 0 83 0 0 0 15 0 19 0 869515507 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4869] ppid=4852 vsize=8539316 CPUtime=1.21 cores=0,2,4,6
/proc/4854/task/4869/stat : 4869 (java) T 4852 4854 4854 0 -1 4202560 9806 0 0 0 119 2 0 0 15 0 19 0 869515507 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=4854/tid=4870] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4870/stat : 4870 (java) T 4852 4854 4854 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869515507 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4854/tid=4871] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4871/stat : 4871 (java) T 4852 4854 4854 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869515507 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=4854/tid=4872] ppid=4852 vsize=8539316 CPUtime=0 cores=0,2,4,6
/proc/4854/task/4872/stat : 4872 (java) T 4852 4854 4854 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869516134 8744259584 285692 33554432000 1073741824 1073778376 140737424131728 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=4852/tid=4874] ppid=4834 vsize=495348 CPUtime=0 cores=0,2,4,6
/proc/4852/task/4874/stat : 4874 (python) S 4834 4834 1406 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869520101 507236352 53514 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554946 18446604445327094208 0 0 -1 0 0 0 0
[pid=4875] ppid=4834 vsize=505604 CPUtime=0 cores=0,2,4,6
/proc/4875/stat : 4875 (python) S 4834 4834 1406 0 -1 4202560 825 0 0 0 0 0 0 0 19 0 1 0 869520103 517738496 53470 33554432000 4194304 5683644 140737005306224 18446744073709551615 246516854342 0 0 16781312 33554946 3141924205163970560 0 0 17 6 0 0 0
/proc/4875/statm: 126401 53470 350 364 0 61279 0
[pid=4877] ppid=4875 vsize=8538840 CPUtime=1.42 cores=0,2,4,6
/proc/4877/stat : 4877 (java) S 4875 4877 4877 0 -1 4202496 42458 0 1 0 136 6 0 0 21 0 18 0 869520104 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/4877/statm: 2134710 40967 2211 9 0 2125451 0
[pid=4877/tid=4878] ppid=4875 vsize=8538840 CPUtime=1.08 cores=0,2,4,6
/proc/4877/task/4878/stat : 4878 (java) R 4875 4877 4877 0 -1 4202560 35206 0 1 0 103 5 0 0 19 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 46912505581595 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=4877/tid=4879] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4879/stat : 4879 (java) S 4875 4877 4877 0 -1 4202560 1148 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4880] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4880/stat : 4880 (java) S 4875 4877 4877 0 -1 4202560 542 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4881] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4881/stat : 4881 (java) S 4875 4877 4877 0 -1 4202560 147 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4882] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4882/stat : 4882 (java) S 4875 4877 4877 0 -1 4202560 5 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 0 0 0 0
[pid=4877/tid=4883] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4883/stat : 4883 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4884] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4884/stat : 4884 (java) S 4875 4877 4877 0 -1 4202560 365 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 0 0 0 0
[pid=4877/tid=4885] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4885/stat : 4885 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4886] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4886/stat : 4886 (java) S 4875 4877 4877 0 -1 4202560 157 0 0 0 0 0 0 0 16 0 18 0 869520105 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4887] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4887/stat : 4887 (java) S 4875 4877 4877 0 -1 4202560 71 0 0 0 0 0 0 0 16 0 18 0 869520106 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650752 0 0 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4888] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4888/stat : 4888 (java) S 4875 4877 4877 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 18 0 869520107 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4889] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4889/stat : 4889 (java) S 4875 4877 4877 0 -1 4202560 10 0 0 0 0 0 0 0 19 0 18 0 869520107 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4890] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4890/stat : 4890 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528657841 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4891] ppid=4875 vsize=8538840 CPUtime=0.14 cores=0,2,4,6
/proc/4877/task/4891/stat : 4891 (java) S 4875 4877 4877 0 -1 4202560 1302 0 0 0 14 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4877/tid=4892] ppid=4875 vsize=8538840 CPUtime=0.17 cores=0,2,4,6
/proc/4877/task/4892/stat : 4892 (java) S 4875 4877 4877 0 -1 4202560 2131 0 0 0 17 0 0 0 15 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 6 0 0 0
[pid=4877/tid=4893] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4893/stat : 4893 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650137 0 4 0 16800975 18446604444194627968 0 0 -1 2 0 0 0
[pid=4877/tid=4894] ppid=4875 vsize=8538840 CPUtime=0 cores=0,2,4,6
/proc/4877/task/4894/stat : 4894 (java) S 4875 4877 4877 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 869520109 8743772160 40967 33554432000 1073741824 1073778376 140733486919136 18446744073709551615 246528650752 0 4 0 16800975 18446604444194627968 0 0 -1 4 0 0 0
[pid=4834/tid=4841] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4841/stat : 4841 (python) S 4832 4834 1406 0 -1 4202560 32 929 0 0 0 0 0 0 18 0 5 0 869500847 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4847] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4847/stat : 4847 (python) S 4832 4834 1406 0 -1 4202560 28 929 0 0 0 0 0 0 20 0 5 0 869505914 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
[pid=4834/tid=4853] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4853/stat : 4853 (python) S 4832 4834 1406 0 -1 4202560 29 929 0 0 0 0 0 0 20 0 5 0 869515501 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 0 0 0 0
[pid=4834/tid=4876] ppid=4832 vsize=515336 CPUtime=0 cores=0,2,4,6
/proc/4834/task/4876/stat : 4876 (python) S 4832 4834 1406 0 -1 4202560 30 929 0 0 0 0 0 0 20 0 5 0 869520104 527704064 55002 33554432000 4194304 5683644 140737005306224 18446744073709551615 246528657841 0 0 16781312 33554434 18446604447680305088 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 220.91
Current children cumulated vsize (KiB) 20152816

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4834 and gives
#  childrusage.ru_utime.tv_sec=23
#  childrusage.ru_utime.tv_usec=679400
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=355945
# CPU time returned by wait4() is 24.0353
# while last known CPU time is 220.91
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 217.885
CPU time (s): 220.91
CPU user time (s): 219.09
CPU system time (s): 1.82
CPU usage (%): 101.388
Max. virtual memory (cumulated for all children) (KiB): 20152816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 23.6794
system time used= 0.355945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 141861
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2876
involuntary context switches= 63

runsolver used 1.24081 second user time and 2.45063 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-09 02:23:22
IDJOB=3482316
IDBENCH=89911
IDSOLVER=1970
FILE ID=node134/3482316-1307579000
RUNJOBID= node134-1307576356-1424
PBS_JOBID= 13547665
Free space on /tmp= 73428 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/kullmann/normalized-mul_8_11_shg.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482316-1307579000/watcher-3482316-1307579000 -o /tmp/evaluation-result-3482316-1307579000/solver-3482316-1307579000 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482316-1307579000.opb -seed 713042191 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 72d0920292366751823d98a716f59807
RANDOM SEED=713042191

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8717180 kB
Buffers:        201776 kB
Cached:        1037844 kB
SwapCached:      10388 kB
Active:       23700440 kB
Inactive:       179452 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8717180 kB
SwapTotal:    67111528 kB
SwapFree:     43359760 kB
Dirty:          150132 kB
Writeback:           0 kB
AnonPages:    22637744 kB
Mapped:         131156 kB
Slab:           148504 kB
PageTables:     132580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135273704 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73328 MiB
End job on node134 at 2011-06-09 02:27:02