Trace number 3481910

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 350.73 347.589

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_6_50_3.opb
MD5SUM8d16c34d0eecf3c16ca4b890652c15ca
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark5
Best CPU time to get the best result obtained on this benchmark1798.37
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 7
Optimality of the best value was proved NO
Number of variables146
Total number of constraints12
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints12
Minimum length of a constraint64
Maximum length of a constraint66
Number of terms in the objective function 96
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 3060
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1270
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 4321
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.42/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.42/0.70	c INFO: solving HOME/instance-3481910-1307577328.opb
0.42/0.70	c INFO: parsing took 0.00 s
0.42/0.70	c INFO: features took 0.00 CPU seconds
0.42/0.73	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.15)
60.39/60.21	c INFO: running wbo1.4a@0 for 45 with 1752 remaining (b = 0.03)
111.66/111.30	c INFO: running clasp-1.3.7@0 for 91 with 1701 remaining (b = 0.02)
204.81/204.11	c INFO: running sat4j-pb-v20101225@0 for 91 with 1608 remaining (b = 0.01)
297.26/295.01	c INFO: running scip-2.0.1-clp@0 for 45 with 1516 remaining (b = 0.00)
349.65/347.05	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1470 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481910-1307577328/watcher-3481910-1307577328 -o /tmp/evaluation-result-3481910-1307577328/solver-3481910-1307577328 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481910-1307577328.opb -seed 1710174457 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 1.95 1.29 2/580 23569
/proc/meminfo: memFree=24525148/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/23569/stat : 23569 (python) R 23567 23569 23050 0 -1 4202496 899 0 0 0 0 0 0 0 19 0 1 0 869330776 16158720 780 33554432000 4194304 5683644 140734481921872 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23569/statm: 3944 779 343 364 0 431 0

[startup+0.096418 s]
/proc/loadavg: 2.00 1.95 1.29 2/580 23569
/proc/meminfo: memFree=24525148/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=84568 CPUtime=0.06 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 2399 0 0 0 4 2 0 0 17 0 1 0 869330776 86597632 2127 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 5 0 0 0
/proc/23569/statm: 21142 2127 707 364 0 1359 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 84568

[startup+0.100396 s]
/proc/loadavg: 2.00 1.95 1.29 2/580 23569
/proc/meminfo: memFree=24525148/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=85364 CPUtime=0.06 cores=1,3,5,7
/proc/23569/stat : 23569 (python) R 23567 23569 23050 0 -1 4202496 2588 0 0 0 4 2 0 0 17 0 1 0 869330776 87412736 2312 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550580871 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23569/statm: 21340 2311 710 364 0 1557 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85364

[startup+0.300335 s]
/proc/loadavg: 2.00 1.95 1.29 2/580 23569
/proc/meminfo: memFree=24525148/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=123740 CPUtime=0.17 cores=1,3,5,7
/proc/23569/stat : 23569 (python) R 23567 23569 23050 0 -1 4202496 5358 931 1 0 11 6 0 0 16 0 1 0 869330776 126709760 3744 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550533637 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23569/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123740

[startup+0.700288 s]
/proc/loadavg: 2.00 1.95 1.29 2/580 23569
/proc/meminfo: memFree=24525148/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=282268 CPUtime=0.42 cores=1,3,5,7
/proc/23569/stat : 23569 (python) R 23567 23569 23050 0 -1 4202496 8997 931 1 0 29 13 0 0 15 0 1 0 869330776 289042432 6885 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550535680 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23569/statm: 70567 6885 1763 364 0 5460 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 282268

[startup+1.50113 s]
/proc/loadavg: 1.92 1.93 1.29 3/584 23577
/proc/meminfo: memFree=24486676/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=282836 CPUtime=0 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 814 0 0 0 0 0 0 0 15 0 1 0 869330849 289624064 5624 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 4144135401843458048 0 0 17 3 0 0 0
/proc/23575/statm: 70709 5624 358 364 0 5596 0
[pid=23577] ppid=23575 vsize=25800 CPUtime=0.75 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 6005 0 0 0 58 17 0 0 18 0 1 0 869330849 26419200 4220 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 6450 4220 807 2317 0 4128 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 601716

[startup+3.10082 s]
/proc/loadavg: 1.92 1.93 1.29 3/584 23577
/proc/meminfo: memFree=24483824/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=282836 CPUtime=0 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 819 0 0 0 0 0 0 0 15 0 1 0 869330849 289624064 5624 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 2373367630342914048 0 0 17 3 0 0 0
/proc/23575/statm: 70709 5624 358 364 0 5596 0
[pid=23577] ppid=23575 vsize=29772 CPUtime=2.35 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 7482 0 0 0 185 50 0 0 18 0 1 0 869330849 30486528 5180 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 7443 5180 807 2317 0 5121 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 605688

[startup+6.30025 s]
/proc/loadavg: 2.01 1.95 1.30 3/584 23577
/proc/meminfo: memFree=24479968/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=282968 CPUtime=0.03 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 959 0 0 0 2 1 0 0 15 0 1 0 869330849 289759232 5650 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 3264213322924294144 0 0 17 7 0 0 0
/proc/23575/statm: 70742 5650 382 364 0 5629 0
[pid=23577] ppid=23575 vsize=28852 CPUtime=5.55 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 8973 0 0 0 441 114 0 0 18 0 1 0 869330849 29544448 4956 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 7213 4956 807 2317 0 4891 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 604900

[startup+12.7011 s]
/proc/loadavg: 2.01 1.95 1.30 3/584 23577
/proc/meminfo: memFree=24481444/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=282968 CPUtime=0.09 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 982 0 0 0 5 4 0 0 15 0 1 0 869330849 289759232 5669 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 686524627907772416 0 0 17 7 0 0 0
/proc/23575/statm: 70742 5669 384 364 0 5629 0
[pid=23577] ppid=23575 vsize=33944 CPUtime=11.95 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 24184 0 0 0 964 231 0 0 18 0 1 0 869330849 34758656 6246 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 8486 6246 807 2317 0 6164 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.49
Current children cumulated vsize (KiB) 609992

[startup+25.5007 s]
/proc/loadavg: 2.00 1.95 1.31 3/584 23578
/proc/meminfo: memFree=24471200/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=283104 CPUtime=0.19 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 1015 0 0 0 11 8 0 0 15 0 1 0 869330849 289898496 5699 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 4138258576617504768 0 0 17 7 0 0 0
/proc/23575/statm: 70776 5699 384 364 0 5663 0
[pid=23577] ppid=23575 vsize=40992 CPUtime=24.75 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 31167 0 0 0 1984 491 0 0 18 0 1 0 869330849 41975808 8074 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 10248 8074 807 2317 0 7926 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 617176

[startup+51.1011 s]
/proc/loadavg: 2.00 1.95 1.33 3/584 23578
/proc/meminfo: memFree=24453236/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=293080 CPUtime=0.45 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 9692 931 1 0 32 13 0 0 18 0 2 0 869330776 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 73270 7140 1870 364 0 8157 0
[pid=23575] ppid=23569 vsize=283456 CPUtime=0.4 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 1075 0 0 0 25 15 0 0 15 0 1 0 869330849 290258944 5747 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557711 0 0 16781312 33554946 2438909316611178496 0 0 17 7 0 0 0
/proc/23575/statm: 70864 5747 384 364 0 5751 0
[pid=23577] ppid=23575 vsize=59952 CPUtime=50.35 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) R 23575 23577 23577 0 -1 4202496 37807 0 0 0 4017 1018 0 0 18 0 1 0 869330849 61390848 12891 33554432000 4194304 13684479 140736166406336 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23577/statm: 14988 12891 807 2317 0 12666 0
[pid=23569/tid=23576] ppid=23567 vsize=293080 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 2 0 869330849 300113920 7140 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.2
Current children cumulated vsize (KiB) 636488

[startup+102.318 s]
/proc/loadavg: 2.00 1.96 1.37 3/588 23584
/proc/meminfo: memFree=24331548/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=303880 CPUtime=0.47 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 10497 931 1 0 34 13 0 0 19 0 3 0 869330776 311173120 7268 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23569/statm: 75970 7268 1873 364 0 10854 0
[pid=23575] ppid=23569 vsize=293700 CPUtime=0.5 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 1257 0 0 0 31 19 0 0 17 0 2 0 869330849 300748800 5797 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23575/statm: 73425 5797 414 364 0 8312 0
[pid=23577] ppid=23575 vsize=69512 CPUtime=59.43 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) T 23575 23577 23577 0 -1 4202496 40799 0 0 0 4750 1193 0 0 18 0 1 0 869330849 71180288 14975 33554432000 4194304 13684479 140736166406336 18446744073709551615 4693205 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23577/statm: 17378 14975 807 2317 0 15056 0
[pid=23575/tid=23580] ppid=23569 vsize=293700 CPUtime=0 cores=1,3,5,7
/proc/23575/task/23580/stat : 23580 (python) S 23569 23569 23050 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869336794 300748800 5797 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604465850928192 0 0 -1 7 0 0 0
[pid=23581] ppid=23569 vsize=293636 CPUtime=0.17 cores=1,3,5,7
/proc/23581/stat : 23581 (python) S 23569 23569 23050 0 -1 4202560 936 0 0 0 7 10 0 0 15 0 1 0 869336797 300683264 5764 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557766 0 0 16781312 33554946 5623753486446373549 0 0 17 7 0 0 0
/proc/23581/statm: 73409 5764 373 364 0 8293 0
[pid=23583] ppid=23581 vsize=111588 CPUtime=42.08 cores=1,3,5,7
/proc/23583/stat : 23583 (wbo1.4a) R 23581 23583 23583 0 -1 4202496 27689 0 0 0 4160 48 0 0 25 0 1 0 869336797 114266112 27426 33554432000 134512640 135751879 4293548912 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 1 0 0 0
/proc/23583/statm: 27897 27426 143 303 0 27592 0
[pid=23569/tid=23576] ppid=23567 vsize=303880 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 3 0 869330849 311173120 7268 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
[pid=23569/tid=23582] ppid=23567 vsize=303880 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23582/stat : 23582 (python) S 23567 23569 23050 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 3 0 869336797 311173120 7268 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.65
Current children cumulated vsize (KiB) 1072316

[startup+162.301 s]
/proc/loadavg: 2.00 1.96 1.40 3/592 23589
/proc/meminfo: memFree=24303312/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=313864 CPUtime=0.5 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 11390 931 1 0 36 14 0 0 20 0 4 0 869330776 321396736 7206 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/23569/statm: 78466 7206 1875 364 0 13347 0
[pid=23575] ppid=23569 vsize=293700 CPUtime=0.5 cores=1,3,5,7

################
# More data... #
################

[pid=23569/tid=23582] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23582/stat : 23582 (python) S 23567 23569 23050 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 7 0 869336797 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
[pid=23569/tid=23587] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23587/stat : 23587 (python) S 23567 23569 23050 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 7 0 869341906 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23594] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23594/stat : 23594 (python) S 23567 23569 23050 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 7 0 869351187 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23618] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23618/stat : 23618 (python) S 23567 23569 23050 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 7 0 869360277 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23632] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23632/stat : 23632 (python) S 23567 23569 23050 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 869365482 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 350.73
Current children cumulated vsize (KiB) 19613780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+347.502 s]
/proc/loadavg: 2.08 2.05 1.53 6/640 23651
/proc/meminfo: memFree=24059908/32951124 swapFree=55639044/67111528
[pid=23569] ppid=23567 vsize=345076 CPUtime=0.57 cores=1,3,5,7
/proc/23569/stat : 23569 (python) S 23567 23569 23050 0 -1 4202496 13919 931 1 0 43 14 0 0 20 0 7 0 869330776 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/23569/statm: 86269 7339 1881 364 0 21141 0
[pid=23575] ppid=23569 vsize=293700 CPUtime=0.5 cores=1,3,5,7
/proc/23575/stat : 23575 (python) S 23569 23569 23050 0 -1 4202560 1257 0 0 0 31 19 0 0 17 0 2 0 869330849 300748800 5797 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23575/statm: 73425 5797 414 364 0 8312 0
[pid=23577] ppid=23575 vsize=69512 CPUtime=59.43 cores=1,3,5,7
/proc/23577/stat : 23577 (scip-2.0.1.linu) T 23575 23577 23577 0 -1 4202496 40799 0 0 0 4750 1193 0 0 18 0 1 0 869330849 71180288 14975 33554432000 4194304 13684479 140736166406336 18446744073709551615 4693205 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23577/statm: 17378 14975 807 2317 0 15056 0
[pid=23575/tid=23580] ppid=23569 vsize=293700 CPUtime=0 cores=1,3,5,7
/proc/23575/task/23580/stat : 23580 (python) S 23569 23569 23050 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869336794 300748800 5797 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604465850928192 0 0 -1 7 0 0 0
[pid=23581] ppid=23569 vsize=293636 CPUtime=0.2 cores=1,3,5,7
/proc/23581/stat : 23581 (python) S 23569 23569 23050 0 -1 4202560 1099 0 0 0 8 12 0 0 16 0 2 0 869336797 300683264 5789 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23581/statm: 73409 5789 397 364 0 8293 0
[pid=23583] ppid=23581 vsize=131292 CPUtime=51.04 cores=1,3,5,7
/proc/23583/stat : 23583 (wbo1.4a) T 23581 23583 23583 0 -1 4202496 32605 0 0 0 5047 57 0 0 25 0 1 0 869336797 134443008 32342 33554432000 134512640 135751879 4293548912 18446744073709551615 134604779 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/23583/statm: 32823 32342 143 303 0 32518 0
[pid=23581/tid=23585] ppid=23569 vsize=293636 CPUtime=0 cores=1,3,5,7
/proc/23581/task/23585/stat : 23585 (python) S 23569 23569 23050 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869341904 300683264 5789 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604468941746240 0 0 -1 7 0 0 0
[pid=23586] ppid=23569 vsize=303620 CPUtime=0.35 cores=1,3,5,7
/proc/23586/stat : 23586 (python) S 23569 23569 23050 0 -1 4202560 1111 0 0 0 17 18 0 0 16 0 2 0 869341906 310906880 5725 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23586/statm: 75905 5725 397 364 0 10786 0
[pid=23588] ppid=23586 vsize=1860 CPUtime=92.78 cores=1,3,5,7
/proc/23588/stat : 23588 (clasp-1.3.7-x86) T 23586 23588 23588 0 -1 4202496 485 0 0 0 9278 0 0 0 25 0 1 0 869341907 1904640 222 33554432000 134512640 136139019 4289820672 18446744073709551615 134640605 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/23588/statm: 465 222 184 398 0 65 0
[pid=23586/tid=23592] ppid=23569 vsize=303620 CPUtime=0 cores=1,3,5,7
/proc/23586/task/23592/stat : 23592 (python) S 23569 23569 23050 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869351185 310906880 5725 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604456609244096 0 0 -1 7 0 0 0
[pid=23593] ppid=23569 vsize=314320 CPUtime=0.42 cores=1,3,5,7
/proc/23593/stat : 23593 (python) S 23569 23569 23050 0 -1 4202560 1160 0 0 0 18 24 0 0 17 0 2 0 869351187 321863680 5824 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23593/statm: 78580 5824 397 364 0 13458 0
[pid=23595] ppid=23593 vsize=8608168 CPUtime=92 cores=1,3,5,7
/proc/23595/stat : 23595 (java) T 23593 23595 23595 0 -1 4202496 40720 0 1 0 9192 8 0 0 15 0 19 0 869351188 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/23595/statm: 2152042 35032 2242 9 0 2142783 0
[pid=23595/tid=23596] ppid=23593 vsize=8608168 CPUtime=89.25 cores=1,3,5,7
/proc/23595/task/23596/stat : 23596 (java) T 23593 23595 23595 0 -1 4202560 28832 0 1 0 8921 4 0 0 25 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23597] ppid=23593 vsize=8608168 CPUtime=0.11 cores=1,3,5,7
/proc/23595/task/23597/stat : 23597 (java) T 23593 23595 23595 0 -1 4202560 96 0 0 0 11 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271550490935 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23598] ppid=23593 vsize=8608168 CPUtime=0.12 cores=1,3,5,7
/proc/23595/task/23598/stat : 23598 (java) T 23593 23595 23595 0 -1 4202560 27 0 0 0 12 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271550490935 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23595/tid=23599] ppid=23593 vsize=8608168 CPUtime=0.12 cores=1,3,5,7
/proc/23595/task/23599/stat : 23599 (java) T 23593 23595 23595 0 -1 4202560 237 0 0 0 12 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23600] ppid=23593 vsize=8608168 CPUtime=0.12 cores=1,3,5,7
/proc/23595/task/23600/stat : 23600 (java) T 23593 23595 23595 0 -1 4202560 40 0 0 0 12 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23595/tid=23601] ppid=23593 vsize=8608168 CPUtime=0.13 cores=1,3,5,7
/proc/23595/task/23601/stat : 23601 (java) T 23593 23595 23595 0 -1 4202560 49 0 0 0 13 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271550490935 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23595/tid=23602] ppid=23593 vsize=8608168 CPUtime=0.1 cores=1,3,5,7
/proc/23595/task/23602/stat : 23602 (java) T 23593 23595 23595 0 -1 4202560 87 0 0 0 10 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 47572784817314 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23595/tid=23603] ppid=23593 vsize=8608168 CPUtime=0.11 cores=1,3,5,7
/proc/23595/task/23603/stat : 23603 (java) T 23593 23595 23595 0 -1 4202560 236 0 0 0 11 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271550490935 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23595/tid=23604] ppid=23593 vsize=8608168 CPUtime=0.1 cores=1,3,5,7
/proc/23595/task/23604/stat : 23604 (java) T 23593 23595 23595 0 -1 4202560 163 0 0 0 10 0 0 0 15 0 19 0 869351189 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 47572784267504 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23605] ppid=23593 vsize=8608168 CPUtime=1.07 cores=1,3,5,7
/proc/23595/task/23605/stat : 23605 (java) T 23593 23595 23595 0 -1 4202560 1268 0 0 0 106 1 0 0 15 0 19 0 869351190 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23595/tid=23606] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23606/stat : 23606 (java) T 23593 23595 23595 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 19 0 869351191 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23607] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23607/stat : 23607 (java) T 23593 23595 23595 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869351191 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23595/tid=23608] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23608/stat : 23608 (java) T 23593 23595 23595 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869351193 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562361265 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23609] ppid=23593 vsize=8608168 CPUtime=0.39 cores=1,3,5,7
/proc/23595/task/23609/stat : 23609 (java) T 23593 23595 23595 0 -1 4202560 5138 0 0 0 39 0 0 0 15 0 19 0 869351193 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23610] ppid=23593 vsize=8608168 CPUtime=0.28 cores=1,3,5,7
/proc/23595/task/23610/stat : 23610 (java) T 23593 23595 23595 0 -1 4202560 3152 0 0 0 28 0 0 0 15 0 19 0 869351193 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23595/tid=23611] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23611/stat : 23611 (java) T 23593 23595 23595 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869351193 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23612] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23612/stat : 23612 (java) T 23593 23595 23595 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869351193 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23595/tid=23613] ppid=23593 vsize=8608168 CPUtime=0 cores=1,3,5,7
/proc/23595/task/23613/stat : 23613 (java) T 23593 23595 23595 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869351203 8814764032 35032 33554432000 1073741824 1073778376 140735561387744 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23593/tid=23616] ppid=23569 vsize=314320 CPUtime=0 cores=1,3,5,7
/proc/23593/task/23616/stat : 23616 (python) S 23569 23569 23050 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869360274 321863680 5824 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604458682165120 0 0 -1 7 0 0 0
[pid=23617] ppid=23569 vsize=324576 CPUtime=0.42 cores=1,3,5,7
/proc/23617/stat : 23617 (python) S 23569 23569 23050 0 -1 4202560 1221 0 0 0 25 17 0 0 17 0 2 0 869360277 332365824 5849 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23617/statm: 81144 5849 398 364 0 16019 0
[pid=23619] ppid=23617 vsize=47492 CPUtime=52 cores=1,3,5,7
/proc/23619/stat : 23619 (scip-2.0.1.linu) T 23617 23619 23619 0 -1 4202496 57161 0 0 0 4606 594 0 0 18 0 1 0 869360277 48631808 9130 33554432000 4194304 15243407 140733271507072 18446744073709551615 4693205 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23619/statm: 11873 9130 936 2698 0 9168 0
[pid=23617/tid=23630] ppid=23569 vsize=324576 CPUtime=0 cores=1,3,5,7
/proc/23617/task/23630/stat : 23630 (python) S 23569 23569 23050 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869365479 332365824 5849 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554946 18446604459107456000 0 0 -1 7 0 0 0
[pid=23631] ppid=23569 vsize=334832 CPUtime=0 cores=1,3,5,7
/proc/23631/stat : 23631 (python) S 23569 23569 23050 0 -1 4202560 814 0 0 0 0 0 0 0 18 0 1 0 869365482 342867968 5803 33554432000 4194304 5683644 140734481921872 18446744073709551615 271550557766 0 0 16781312 33554946 4294934789 0 0 17 1 0 0 0
/proc/23631/statm: 83708 5803 349 364 0 18580 0
[pid=23633] ppid=23631 vsize=8545696 CPUtime=1.02 cores=1,3,5,7
/proc/23633/stat : 23633 (java) S 23631 23633 23633 0 -1 4202496 22533 0 1 0 99 3 0 0 20 0 19 0 869365482 8750792704 18312 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/23633/statm: 2136424 18313 2199 9 0 2127165 0
[pid=23633/tid=23634] ppid=23631 vsize=8545696 CPUtime=0.44 cores=1,3,5,7
/proc/23633/task/23634/stat : 23634 (java) R 23631 23633 23633 0 -1 4202560 10883 0 1 0 43 1 0 0 25 0 19 0 869365483 8750792704 18506 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 46912505578702 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=23633/tid=23635] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23635/stat : 23635 (java) S 23631 23633 23633 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 19 0 869365483 8750792704 18507 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23636] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23636/stat : 23636 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365483 8750792704 18507 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23637] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23637/stat : 23637 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365483 8750792704 18507 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23638] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23638/stat : 23638 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365483 8750792704 18507 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23639] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23639/stat : 23639 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365483 8750792704 18508 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23640] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23640/stat : 23640 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365483 8750792704 18508 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23641] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23641/stat : 23641 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365484 8750792704 18508 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23642] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23642/stat : 23642 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869365484 8750792704 18509 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23643] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23643/stat : 23643 (java) S 23631 23633 23633 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 19 0 869365485 8750792704 18509 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562354176 0 0 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23644] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23644/stat : 23644 (java) S 23631 23633 23633 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 19 0 869365485 8750792704 18509 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23645] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23645/stat : 23645 (java) S 23631 23633 23633 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 19 0 869365485 8750792704 18509 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23646] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23646/stat : 23646 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869365487 8750792704 18510 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562361265 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23647] ppid=23631 vsize=8545696 CPUtime=0.27 cores=1,3,5,7
/proc/23633/task/23647/stat : 23647 (java) R 23631 23633 23633 0 -1 4202560 6003 0 0 0 27 0 0 0 25 0 19 0 869365487 8750792704 18510 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 47377588847575 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=23633/tid=23648] ppid=23631 vsize=8545696 CPUtime=0.29 cores=1,3,5,7
/proc/23633/task/23648/stat : 23648 (java) R 23631 23633 23633 0 -1 4202560 4442 0 0 0 29 0 0 0 17 0 19 0 869365487 8750792704 18511 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 47377584946347 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=23633/tid=23649] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23649/stat : 23649 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869365487 8750792704 18514 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562353561 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23633/tid=23650] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23650/stat : 23650 (java) S 23631 23633 23633 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869365487 8750792704 18515 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562354176 0 4 0 16800975 18446604461740915520 0 0 -1 7 0 0 0
[pid=23633/tid=23651] ppid=23631 vsize=8545696 CPUtime=0 cores=1,3,5,7
/proc/23633/task/23651/stat : 23651 (java) S 23631 23633 23633 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869365497 8750792704 18516 33554432000 1073741824 1073778376 140737213752528 18446744073709551615 271562354176 0 4 0 16800975 18446604461740915520 0 0 -1 5 0 0 0
[pid=23569/tid=23576] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23576/stat : 23576 (python) S 23567 23569 23050 0 -1 4202560 23 931 0 0 0 0 0 0 18 0 7 0 869330849 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
[pid=23569/tid=23582] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23582/stat : 23582 (python) S 23567 23569 23050 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 7 0 869336797 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 5 0 0 0
[pid=23569/tid=23587] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23587/stat : 23587 (python) S 23567 23569 23050 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 7 0 869341906 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23594] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23594/stat : 23594 (python) S 23567 23569 23050 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 7 0 869351187 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23618] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23618/stat : 23618 (python) S 23567 23569 23050 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 7 0 869360277 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 1 0 0 0
[pid=23569/tid=23632] ppid=23567 vsize=345076 CPUtime=0 cores=1,3,5,7
/proc/23569/task/23632/stat : 23632 (python) S 23567 23569 23050 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 869365482 353357824 7339 33554432000 4194304 5683644 140734481921872 18446744073709551615 271562361265 0 0 16781312 33554434 18446604464364058752 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 350.73
Current children cumulated vsize (KiB) 19613780

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23569 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=439933
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=151976
# CPU time returned by wait4() is 0.591909
# while last known CPU time is 350.73
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 347.589
CPU time (s): 350.73
CPU user time (s): 331.14
CPU system time (s): 19.59
CPU usage (%): 100.904
Max. virtual memory (cumulated for all children) (KiB): 19613780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.439933
system time used= 0.151976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14854
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2871
involuntary context switches= 15

runsolver used 2.10068 second user time and 4.65929 second system time

The end

Launcher Data 

Begin job on node133 at 2011-06-09 01:55:28
IDJOB=3481910
IDBENCH=2910
IDSOLVER=1970
FILE ID=node133/3481910-1307577328
RUNJOBID= node133-1307576356-23069
PBS_JOBID= 13547666
Free space on /tmp= 73772 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_6_50_3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481910-1307577328/watcher-3481910-1307577328 -o /tmp/evaluation-result-3481910-1307577328/solver-3481910-1307577328 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481910-1307577328.opb -seed 1710174457 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d16c34d0eecf3c16ca4b890652c15ca
RANDOM SEED=1710174457

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24525312 kB
Buffers:        151180 kB
Cached:         605024 kB
SwapCached:      10460 kB
Active:        7965604 kB
Inactive:       173272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24525312 kB
SwapTotal:    67111528 kB
SwapFree:     55639044 kB
Dirty:          101816 kB
Writeback:           0 kB
AnonPages:     7379748 kB
Mapped:          60964 kB
Slab:           143700 kB
PageTables:      73116 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 125039700 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73672 MiB
End job on node133 at 2011-06-09 02:01:19