Trace number 3481915

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 250.05 247.587

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_5_40_1.opb
MD5SUM5bf563c7058af01702ea80887f1d43ad
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1320.51
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved NO
Number of variables120
Total number of constraints10
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10
Minimum length of a constraint55
Maximum length of a constraint56
Number of terms in the objective function 80
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 2550
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1086
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 3768
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.40/1.22	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.40/1.22	c INFO: solving HOME/instance-3481915-1307577375.opb
0.40/1.22	c INFO: parsing took 0.00 s
0.40/1.23	c INFO: features took 0.00 CPU seconds
0.40/1.25	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.22)
60.68/60.93	c INFO: running wbo1.4a@0 for 45 with 1752 remaining (b = 0.04)
106.94/107.09	c INFO: running clasp-1.3.7@0 for 45 with 1706 remaining (b = 0.01)
154.73/154.67	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1659 remaining (b = 0.00)
202.62/200.64	c INFO: running clasp-1.3.7@47 for 45 with 1611 remaining (b = 0.00)
248.96/246.84	c INFO: running sat4j-pb-v20101225@0 for 91 with 1565 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481915-1307577375/watcher-3481915-1307577375 -o /tmp/evaluation-result-3481915-1307577375/solver-3481915-1307577375 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481915-1307577375.opb -seed 1719461105 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.24 2.02 1.35 3/506 2965
/proc/meminfo: memFree=21833604/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=2016 CPUtime=0 cores=1,3,5,7
/proc/2965/stat : 2965 (python) D 2963 2965 2733 0 -1 4194304 87 0 0 0 0 0 0 0 19 0 1 0 850152866 2064384 39 33554432000 4194304 5683644 140735579298528 18446744073709551615 254256692871 0 0 4096 0 18446744071696489144 0 0 17 1 0 0 0
/proc/2965/statm: 504 39 31 364 0 37 0

[startup+0.0855021 s]
/proc/loadavg: 2.24 2.02 1.35 3/506 2965
/proc/meminfo: memFree=21833604/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=2016 CPUtime=0 cores=1,3,5,7
/proc/2965/stat : 2965 (python) D 2963 2965 2733 0 -1 4194304 87 0 0 0 0 0 0 0 19 0 1 0 850152866 2064384 39 33554432000 4194304 5683644 140735579298528 18446744073709551615 254256692871 0 0 4096 0 18446744071696489144 0 0 17 1 0 0 0
/proc/2965/statm: 504 39 31 364 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2016

[startup+0.100496 s]
/proc/loadavg: 2.24 2.02 1.35 3/506 2965
/proc/meminfo: memFree=21833604/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=2016 CPUtime=0 cores=1,3,5,7
/proc/2965/stat : 2965 (python) D 2963 2965 2733 0 -1 4194304 87 0 0 0 0 0 0 0 19 0 1 0 850152866 2064384 39 33554432000 4194304 5683644 140735579298528 18446744073709551615 254256692871 0 0 4096 0 18446744071696489144 0 0 17 1 0 0 0
/proc/2965/statm: 504 39 31 364 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2016

[startup+0.300462 s]
/proc/loadavg: 2.24 2.02 1.35 3/506 2965
/proc/meminfo: memFree=21833604/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=2016 CPUtime=0 cores=1,3,5,7
/proc/2965/stat : 2965 (python) D 2963 2965 2733 0 -1 4194304 87 0 0 0 0 0 0 0 19 0 1 0 850152866 2064384 39 33554432000 4194304 5683644 140735579298528 18446744073709551615 254256692871 0 0 4096 0 18446744071696489144 0 0 17 1 0 0 0
/proc/2965/statm: 504 39 31 364 0 37 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2016

[startup+0.70041 s]
/proc/loadavg: 2.24 2.02 1.35 3/506 2965
/proc/meminfo: memFree=21833604/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=108860 CPUtime=0.11 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 4329 933 1 0 8 3 0 0 17 0 1 0 850152866 111472640 2842 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2965/statm: 27215 2842 877 364 0 1911 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 108860

[startup+1.50024 s]
/proc/loadavg: 2.24 2.02 1.35 3/507 2970
/proc/meminfo: memFree=21817724/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 293080

[startup+3.10097 s]
/proc/loadavg: 2.24 2.02 1.35 3/510 2973
/proc/meminfo: memFree=21788188/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
[pid=2971] ppid=2965 vsize=282836 CPUtime=0 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 860 0 0 0 0 0 0 0 15 0 1 0 850152992 289624064 5623 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636623 0 0 16781312 33554946 4061698375089651712 0 0 17 7 0 0 0
/proc/2971/statm: 70709 5623 358 364 0 5596 0
[pid=2973] ppid=2971 vsize=33032 CPUtime=1.83 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) R 2971 2973 2973 0 -1 4202496 6574 0 0 0 147 36 0 0 18 0 1 0 850152992 33824768 5590 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2973/statm: 8258 5590 807 2317 0 5936 0
[pid=2965/tid=2972] ppid=2963 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 850152992 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.29
Current children cumulated vsize (KiB) 608948
heavy processes:

[startup+6.30041 s]
/proc/loadavg: 2.30 2.04 1.36 3/510 2973
/proc/meminfo: memFree=21774796/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
[pid=2971] ppid=2965 vsize=282836 CPUtime=0.03 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 989 0 0 0 3 0 0 0 15 0 1 0 850152992 289624064 5648 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636623 0 0 16781312 33554946 1138604106571579392 0 0 17 7 0 0 0
/proc/2971/statm: 70709 5648 382 364 0 5596 0
[pid=2973] ppid=2971 vsize=34992 CPUtime=5.03 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) R 2971 2973 2973 0 -1 4202496 7312 0 0 0 410 93 0 0 18 0 1 0 850152992 35831808 6328 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2973/statm: 8748 6328 807 2317 0 6426 0
[pid=2965/tid=2972] ppid=2963 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 850152992 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.52
Current children cumulated vsize (KiB) 610908

[startup+12.7013 s]
/proc/loadavg: 2.28 2.04 1.37 4/510 2973
/proc/meminfo: memFree=21763772/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
[pid=2971] ppid=2965 vsize=282968 CPUtime=0.1 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1020 0 0 0 8 2 0 0 15 0 1 0 850152992 289759232 5676 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636623 0 0 16781312 33554946 2860328346598768640 0 0 17 7 0 0 0
/proc/2971/statm: 70742 5676 384 364 0 5629 0
[pid=2973] ppid=2971 vsize=32728 CPUtime=11.43 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) R 2971 2973 2973 0 -1 4202496 7837 0 0 0 927 216 0 0 18 0 1 0 850152992 33513472 6012 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2973/statm: 8182 6012 807 2317 0 5860 0
[pid=2965/tid=2972] ppid=2963 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 850152992 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.99
Current children cumulated vsize (KiB) 608776

[startup+25.501 s]
/proc/loadavg: 2.22 2.03 1.37 5/510 2973
/proc/meminfo: memFree=21742936/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
[pid=2971] ppid=2965 vsize=283208 CPUtime=0.22 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1052 0 0 0 16 6 0 0 15 0 1 0 850152992 290004992 5704 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636623 0 0 16781312 33554946 2000221112184602624 0 0 17 7 0 0 0
/proc/2971/statm: 70802 5704 384 364 0 5689 0
[pid=2973] ppid=2971 vsize=33752 CPUtime=24.23 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) R 2971 2973 2973 0 -1 4202496 8105 0 0 0 1945 478 0 0 18 0 1 0 850152992 34562048 6280 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2973/statm: 8438 6280 807 2317 0 6116 0
[pid=2965/tid=2972] ppid=2963 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 850152992 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.91
Current children cumulated vsize (KiB) 610040

[startup+51.1005 s]
/proc/loadavg: 2.14 2.03 1.39 4/510 2974
/proc/meminfo: memFree=21706240/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=293080 CPUtime=0.46 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 9633 933 1 0 32 14 0 0 18 0 2 0 850152866 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2965/statm: 73270 7139 1870 364 0 8157 0
[pid=2971] ppid=2965 vsize=283688 CPUtime=0.48 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1121 0 0 0 33 15 0 0 15 0 1 0 850152992 290496512 5761 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636623 0 0 16781312 33554946 271418156168249344 0 0 17 7 0 0 0
/proc/2971/statm: 70922 5761 384 364 0 5809 0
[pid=2973] ppid=2971 vsize=40980 CPUtime=49.83 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) R 2971 2973 2973 0 -1 4202496 14938 0 0 0 3968 1015 0 0 18 0 1 0 850152992 41963520 8042 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2973/statm: 10245 8042 807 2317 0 7923 0
[pid=2965/tid=2972] ppid=2963 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 850152992 300113920 7139 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.77
Current children cumulated vsize (KiB) 617748

[startup+102.301 s]
/proc/loadavg: 2.06 2.02 1.42 4/514 2979
/proc/meminfo: memFree=21535488/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=303876 CPUtime=0.49 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 10496 933 1 0 35 14 0 0 19 0 3 0 850152866 311169024 7266 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2965/statm: 75969 7266 1873 364 0 10853 0
[pid=2971] ppid=2965 vsize=293932 CPUtime=0.6 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1278 0 0 0 41 19 0 0 17 0 2 0 850152992 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2971/statm: 73483 5817 414 364 0 8370 0
[pid=2973] ppid=2971 vsize=40980 CPUtime=59.64 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) T 2971 2973 2973 0 -1 4202496 16257 0 0 0 4737 1227 0 0 18 0 1 0 850152992 41963520 8051 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2973/statm: 10245 8051 807 2317 0 7923 0
[pid=2971/tid=2975] ppid=2965 vsize=293932 CPUtime=0 cores=1,3,5,7
/proc/2971/task/2975/stat : 2975 (python) S 2965 2965 2733 0 -1 4202560 39 0 0 0 0 0 0 0 17 0 2 0 850158958 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604469116000256 0 0 -1 7 0 0 0
[pid=2976] ppid=2965 vsize=293632 CPUtime=0.16 cores=1,3,5,7
/proc/2976/stat : 2976 (python) S 2965 2965 2733 0 -1 4202560 947 0 0 0 7 9 0 0 15 0 1 0 850158960 300679168 5762 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636678 0 0 16781312 33554946 5623753486446373761 0 0 17 7 0 0 0
/proc/2976/statm: 73408 5762 373 364 0 8292 0
[pid=2978] ppid=2976 vsize=105948 CPUtime=41.36 cores=1,3,5,7
/proc/2978/stat : 2978 (wbo1.4a) R 2976 2978 2978 0 -1 4202496 26263 0 0 0 4096 40 0 0 25 0 1 0 850158960 108490752 25998 33554432000 134512640 135751879 4286889856 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/2978/statm: 26487 25998 143 303 0 26182 0
[pid=2965/tid=2972] ppid=2963 vsize=303876 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 3 0 850152992 311169024 7266 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
[pid=2965/tid=2977] ppid=2963 vsize=303876 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2977/stat : 2977 (python) S 2963 2965 2733 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 3 0 850158960 311169024 7266 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 1038368

[startup+162.302 s]
/proc/loadavg: 2.12 2.05 1.46 4/540 3008
/proc/meminfo: memFree=21237452/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=324588 CPUtime=0.54 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 12226 933 1 0 39 15 0 0 19 0 5 0 850152866 332378112 7312 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2965/statm: 81147 7312 1877 364 0 16025 0
[pid=2971] ppid=2965 vsize=293932 CPUtime=0.6 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1278 0 0 0 41 19 0 0 17 0 2 0 850152992 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2971/statm: 73483 5817 414 364 0 8370 0
[pid=2973] ppid=2971 vsize=40980 CPUtime=59.64 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) T 2971 2973 2973 0 -1 4202496 16257 0 0 0 4737 1227 0 0 18 0 1 0 850152992 41963520 8051 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2973/statm: 10245 8051 807 2317 0 7923 0
[pid=2971/tid=2975] ppid=2965 vsize=293932 CPUtime=0 cores=1,3,5,7
/proc/2971/task/2975/stat : 2975 (python) S 2965 2965 2733 0 -1 4202560 39 0 0 0 0 0 0 0 17 0 2 0 850158958 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604469116000256 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=2989/tid=3006] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3006/stat : 3006 (java) T 2987 2989 2989 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=3007] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3007/stat : 3007 (java) T 2987 2989 2989 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2989/tid=3008] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3008/stat : 3008 (java) T 2987 2989 2989 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850168349 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2987/tid=3042] ppid=2965 vsize=314344 CPUtime=0 cores=1,3,5,7
/proc/2987/task/3042/stat : 3042 (python) S 2965 2965 2733 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 850172928 321888256 5829 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604463007537024 0 0 -1 5 0 0 0
[pid=2965/tid=2972] ppid=2963 vsize=324588 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 5 0 850152992 332378112 7331 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
[pid=2965/tid=2977] ppid=2963 vsize=324588 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2977/stat : 2977 (python) S 2963 2965 2733 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 5 0 850158960 332378112 7331 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 1 0 0 0
[pid=2965/tid=2983] ppid=2963 vsize=324588 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2983/stat : 2983 (python) S 2963 2965 2733 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 5 0 850163576 332378112 7331 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 3 0 0 0
[pid=2965/tid=2988] ppid=2963 vsize=324588 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2988/stat : 2988 (python) S 2963 2965 2733 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 5 0 850168335 332378112 7331 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 224.4
Current children cumulated vsize (KiB) 10231544



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+247.506 s]
/proc/loadavg: 2.11 2.07 1.52 5/536 3068
/proc/meminfo: memFree=22214728/32951124 swapFree=67057920/67111528
[pid=2965] ppid=2963 vsize=335004 CPUtime=0.59 cores=1,3,5,7
/proc/2965/stat : 2965 (python) S 2963 2965 2733 0 -1 4202496 13120 933 1 0 44 15 0 0 19 0 6 0 850152866 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2965/statm: 83751 7358 1879 364 0 18626 0
[pid=2971] ppid=2965 vsize=293932 CPUtime=0.6 cores=1,3,5,7
/proc/2971/stat : 2971 (python) S 2965 2965 2733 0 -1 4202560 1278 0 0 0 41 19 0 0 17 0 2 0 850152992 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2971/statm: 73483 5817 414 364 0 8370 0
[pid=2973] ppid=2971 vsize=40980 CPUtime=59.64 cores=1,3,5,7
/proc/2973/stat : 2973 (scip-2.0.1.linu) T 2971 2973 2973 0 -1 4202496 16257 0 0 0 4737 1227 0 0 18 0 1 0 850152992 41963520 8051 33554432000 4194304 13684479 140736641787024 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2973/statm: 10245 8051 807 2317 0 7923 0
[pid=2971/tid=2975] ppid=2965 vsize=293932 CPUtime=0 cores=1,3,5,7
/proc/2971/task/2975/stat : 2975 (python) S 2965 2965 2733 0 -1 4202560 39 0 0 0 0 0 0 0 17 0 2 0 850158958 300986368 5817 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604469116000256 0 0 -1 7 0 0 0
[pid=2976] ppid=2965 vsize=293632 CPUtime=0.19 cores=1,3,5,7
/proc/2976/stat : 2976 (python) S 2965 2965 2733 0 -1 4202560 1111 0 0 0 9 10 0 0 16 0 2 0 850158960 300679168 5787 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2976/statm: 73408 5787 397 364 0 8292 0
[pid=2978] ppid=2976 vsize=115900 CPUtime=46.11 cores=1,3,5,7
/proc/2978/stat : 2978 (wbo1.4a) T 2976 2978 2978 0 -1 4202496 28754 0 0 0 4566 45 0 0 25 0 1 0 850158960 118681600 28489 33554432000 134512640 135751879 4286889856 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/2978/statm: 28975 28489 143 303 0 28670 0
[pid=2976/tid=2981] ppid=2965 vsize=293632 CPUtime=0 cores=1,3,5,7
/proc/2976/task/2981/stat : 2981 (python) S 2965 2965 2733 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 850163573 300679168 5787 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604470157904000 0 0 -1 7 0 0 0
[pid=2982] ppid=2965 vsize=303584 CPUtime=0.37 cores=1,3,5,7
/proc/2982/stat : 2982 (python) S 2965 2965 2733 0 -1 4202560 1110 0 0 0 17 20 0 0 15 0 2 0 850163575 310870016 5730 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2982/statm: 75896 5730 397 364 0 10777 0
[pid=2984] ppid=2982 vsize=1860 CPUtime=93.71 cores=1,3,5,7
/proc/2984/stat : 2984 (clasp-1.3.7-x86) T 2982 2984 2984 0 -1 4202496 477 0 0 0 9371 0 0 0 25 0 1 0 850163576 1904640 217 33554432000 134512640 136139019 4288375392 18446744073709551615 134642524 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/2984/statm: 465 217 184 398 0 65 0
[pid=2982/tid=2986] ppid=2965 vsize=303584 CPUtime=0 cores=1,3,5,7
/proc/2982/task/2986/stat : 2986 (python) S 2965 2965 2733 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 850168332 310870016 5730 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604469258916032 0 0 -1 7 0 0 0
[pid=2987] ppid=2965 vsize=314344 CPUtime=0.19 cores=1,3,5,7
/proc/2987/stat : 2987 (python) S 2965 2965 2733 0 -1 4202560 1126 0 0 0 8 11 0 0 16 0 2 0 850168334 321888256 5829 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/2987/statm: 78586 5829 397 364 0 13464 0
[pid=2989] ppid=2987 vsize=8542724 CPUtime=47.61 cores=1,3,5,7
/proc/2989/stat : 2989 (java) T 2987 2989 2989 0 -1 4202496 105149 0 1 0 4741 20 0 0 18 0 19 0 850168335 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/2989/statm: 2135681 78914 2234 9 0 2126422 0
[pid=2989/tid=2990] ppid=2987 vsize=8542724 CPUtime=45.59 cores=1,3,5,7
/proc/2989/task/2990/stat : 2990 (java) T 2987 2989 2989 0 -1 4202560 57123 0 1 0 4550 9 0 0 25 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 46912505893299 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2989/tid=2991] ppid=2987 vsize=8542724 CPUtime=0.07 cores=1,3,5,7
/proc/2989/task/2991/stat : 2991 (java) T 2987 2989 2989 0 -1 4202560 3870 0 0 0 6 1 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2989/tid=2992] ppid=2987 vsize=8542724 CPUtime=0.05 cores=1,3,5,7
/proc/2989/task/2992/stat : 2992 (java) T 2987 2989 2989 0 -1 4202560 3179 0 0 0 5 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2989/tid=2993] ppid=2987 vsize=8542724 CPUtime=0.08 cores=1,3,5,7
/proc/2989/task/2993/stat : 2993 (java) T 2987 2989 2989 0 -1 4202560 4154 0 0 0 8 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2989/tid=2994] ppid=2987 vsize=8542724 CPUtime=0.07 cores=1,3,5,7
/proc/2989/task/2994/stat : 2994 (java) T 2987 2989 2989 0 -1 4202560 5238 0 0 0 7 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2989/tid=2995] ppid=2987 vsize=8542724 CPUtime=0.07 cores=1,3,5,7
/proc/2989/task/2995/stat : 2995 (java) T 2987 2989 2989 0 -1 4202560 3853 0 0 0 7 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2989/tid=2996] ppid=2987 vsize=8542724 CPUtime=0.09 cores=1,3,5,7
/proc/2989/task/2996/stat : 2996 (java) T 2987 2989 2989 0 -1 4202560 5075 0 0 0 8 1 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=2997] ppid=2987 vsize=8542724 CPUtime=0.06 cores=1,3,5,7
/proc/2989/task/2997/stat : 2997 (java) T 2987 2989 2989 0 -1 4202560 4586 0 0 0 6 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2989/tid=2998] ppid=2987 vsize=8542724 CPUtime=0.08 cores=1,3,5,7
/proc/2989/task/2998/stat : 2998 (java) T 2987 2989 2989 0 -1 4202560 5038 0 0 0 8 0 0 0 15 0 19 0 850168336 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=2999] ppid=2987 vsize=8542724 CPUtime=0.02 cores=1,3,5,7
/proc/2989/task/2999/stat : 2999 (java) T 2987 2989 2989 0 -1 4202560 138 0 0 0 1 1 0 0 15 0 19 0 850168337 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273433088 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2989/tid=3001] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3001/stat : 3001 (java) T 2987 2989 2989 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850168338 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=3002] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3002/stat : 3002 (java) T 2987 2989 2989 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 850168338 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=3003] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3003/stat : 3003 (java) T 2987 2989 2989 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273440177 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=3004] ppid=2987 vsize=8542724 CPUtime=0.67 cores=1,3,5,7
/proc/2989/task/3004/stat : 3004 (java) T 2987 2989 2989 0 -1 4202560 4979 0 0 0 67 0 0 0 15 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2989/tid=3005] ppid=2987 vsize=8542724 CPUtime=0.62 cores=1,3,5,7
/proc/2989/task/3005/stat : 3005 (java) T 2987 2989 2989 0 -1 4202560 6525 0 0 0 62 0 0 0 15 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2989/tid=3006] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3006/stat : 3006 (java) T 2987 2989 2989 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2989/tid=3007] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3007/stat : 3007 (java) T 2987 2989 2989 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 850168340 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2989/tid=3008] ppid=2987 vsize=8542724 CPUtime=0 cores=1,3,5,7
/proc/2989/task/3008/stat : 3008 (java) T 2987 2989 2989 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850168349 8747749376 78914 33554432000 1073741824 1073778376 140733727082384 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2987/tid=3042] ppid=2965 vsize=314344 CPUtime=0 cores=1,3,5,7
/proc/2987/task/3042/stat : 3042 (python) S 2965 2965 2733 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 850172928 321888256 5829 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554946 18446604463007537024 0 0 -1 5 0 0 0
[pid=3047] ppid=2965 vsize=324760 CPUtime=0 cores=1,3,5,7
/proc/3047/stat : 3047 (python) S 2965 2965 2733 0 -1 4202560 817 0 0 0 0 0 0 0 15 0 1 0 850177551 332554240 5824 33554432000 4194304 5683644 140735579298528 18446744073709551615 254261636678 0 0 16781312 33554946 1909242688264208384 0 0 17 3 0 0 0
/proc/3047/statm: 81190 5824 349 364 0 16065 0
[pid=3049] ppid=3047 vsize=8548464 CPUtime=1.04 cores=1,3,5,7
/proc/3049/stat : 3049 (java) S 3047 3049 3049 0 -1 4202496 22252 0 1 0 101 3 0 0 17 0 19 0 850177552 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/3049/statm: 2137116 18694 2235 9 0 2127857 0
[pid=3049/tid=3050] ppid=3047 vsize=8548464 CPUtime=0.65 cores=1,3,5,7
/proc/3049/task/3050/stat : 3050 (java) R 3047 3049 3049 0 -1 4202560 12823 0 1 0 63 2 0 0 25 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 46912505596726 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=3049/tid=3051] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3051/stat : 3051 (java) S 3047 3049 3049 0 -1 4202560 155 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3052] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3052/stat : 3052 (java) S 3047 3049 3049 0 -1 4202560 80 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 3 0 0 0
[pid=3049/tid=3053] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3053/stat : 3053 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3054] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3054/stat : 3054 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3056] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3056/stat : 3056 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3057] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3057/stat : 3057 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3058] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3058/stat : 3058 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3059] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3059/stat : 3059 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 850177553 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 7 0 0 0
[pid=3049/tid=3060] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3060/stat : 3060 (java) S 3047 3049 3049 0 -1 4202560 247 0 0 0 0 0 0 0 17 0 19 0 850177554 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273433088 0 0 0 16800975 18446604458633140288 0 0 -1 3 0 0 0
[pid=3049/tid=3061] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3061/stat : 3061 (java) S 3047 3049 3049 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850177555 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 1 0 0 0
[pid=3049/tid=3062] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3062/stat : 3062 (java) S 3047 3049 3049 0 -1 4202560 9 0 0 0 0 0 0 0 19 0 19 0 850177555 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 1 0 0 0
[pid=3049/tid=3063] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3063/stat : 3063 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850177557 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273440177 0 4 0 16800975 18446604458633140288 0 0 -1 3 0 0 0
[pid=3049/tid=3064] ppid=3047 vsize=8548464 CPUtime=0.23 cores=1,3,5,7
/proc/3049/task/3064/stat : 3064 (java) R 3047 3049 3049 0 -1 4202560 6116 0 0 0 23 0 0 0 16 0 19 0 850177557 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 47167807332023 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3049/tid=3065] ppid=3047 vsize=8548464 CPUtime=0.14 cores=1,3,5,7
/proc/3049/task/3065/stat : 3065 (java) S 3047 3049 3049 0 -1 4202560 1434 0 0 0 14 0 0 0 23 0 19 0 850177557 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 5 0 0 0
[pid=3049/tid=3066] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3066/stat : 3066 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850177557 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273432473 0 4 0 16800975 18446604458633140288 0 0 -1 3 0 0 0
[pid=3049/tid=3067] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3067/stat : 3067 (java) S 3047 3049 3049 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 850177557 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273433088 0 4 0 16800975 18446604458633140288 0 0 -1 5 0 0 0
[pid=3049/tid=3068] ppid=3047 vsize=8548464 CPUtime=0 cores=1,3,5,7
/proc/3049/task/3068/stat : 3068 (java) S 3047 3049 3049 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 850177566 8753627136 18694 33554432000 1073741824 1073778376 140736239863104 18446744073709551615 254273433088 0 4 0 16800975 18446604458633140288 0 0 -1 3 0 0 0
[pid=2965/tid=2972] ppid=2963 vsize=335004 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2972/stat : 2972 (python) S 2963 2965 2733 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 6 0 850152992 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 7 0 0 0
[pid=2965/tid=2977] ppid=2963 vsize=335004 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2977/stat : 2977 (python) S 2963 2965 2733 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 6 0 850158960 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 1 0 0 0
[pid=2965/tid=2983] ppid=2963 vsize=335004 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2983/stat : 2983 (python) S 2963 2965 2733 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 6 0 850163576 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 3 0 0 0
[pid=2965/tid=2988] ppid=2963 vsize=335004 CPUtime=0 cores=1,3,5,7
/proc/2965/task/2988/stat : 2988 (python) S 2963 2965 2733 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 6 0 850168335 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 3 0 0 0
[pid=2965/tid=3048] ppid=2963 vsize=335004 CPUtime=0 cores=1,3,5,7
/proc/2965/task/3048/stat : 3048 (python) S 2963 2965 2733 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 6 0 850177551 343044096 7358 33554432000 4194304 5683644 140735579298528 18446744073709551615 254273440177 0 0 16781312 33554434 18446604454481357888 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 250.05
Current children cumulated vsize (KiB) 19115184

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2965 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=445932
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=160975
# CPU time returned by wait4() is 0.606907
# while last known CPU time is 250.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 247.587
CPU time (s): 250.05
CPU user time (s): 236.35
CPU system time (s): 13.7
CPU usage (%): 100.995
Max. virtual memory (cumulated for all children) (KiB): 19115184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.445932
system time used= 0.160975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14055
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2876
involuntary context switches= 24

runsolver used 1.56876 second user time and 3.09653 second system time

The end

Launcher Data 

Begin job on node140 at 2011-06-09 01:56:15
IDJOB=3481915
IDBENCH=2923
IDSOLVER=1970
FILE ID=node140/3481915-1307577375
RUNJOBID= node140-1307576354-2756
PBS_JOBID= 13547659
Free space on /tmp= 73628 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_5_40_1.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481915-1307577375/watcher-3481915-1307577375 -o /tmp/evaluation-result-3481915-1307577375/solver-3481915-1307577375 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481915-1307577375.opb -seed 1719461105 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bf563c7058af01702ea80887f1d43ad
RANDOM SEED=1719461105

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21834008 kB
Buffers:        144804 kB
Cached:         483740 kB
SwapCached:       7060 kB
Active:       10676792 kB
Inactive:       165832 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21834008 kB
SwapTotal:    67111528 kB
SwapFree:     67057920 kB
Dirty:          101808 kB
Writeback:           0 kB
AnonPages:    10212112 kB
Mapped:          53040 kB
Slab:           144684 kB
PageTables:      61920 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 146582892 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73476 MiB
End job on node140 at 2011-06-09 02:00:25