Trace number 3481535

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 1358.76 1348.44

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_500_60_4.opb
MD5SUM468c9636f2c99e512d4c3bca04b78033
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-38
Best CPU time to get the best result obtained on this benchmark1800.17
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -42
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint60
Maximum length of a constraint106
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)37458
Sum of products size (including duplicates)74916
Number of different products18729
Sum of products size37458

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.31/0.47	c INFO: solving HOME/instance-3481535-1307578077.opb
0.38/0.76	c INFO: wrote linearized instance to HOME/tmpxH25r8.opb
0.89/1.05	c INFO: parsing took 0.27 s
1.37/3.16	c INFO: features took 0.59 CPU seconds
1.37/3.16	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.10)
48.55/48.41	c INFO: running wbo1.4a@0 for 45 with 1752 remaining (b = 0.02)
99.13/98.73	c INFO: running scip-2.0.1-clp@0 for 45 with 1702 remaining (b = 0.01)
146.10/145.59	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1656 remaining (b = 0.01)
194.20/190.50	c INFO: running scip-2.0.1-spx@46 for 45 with 1608 remaining (b = 0.01)
242.92/238.90	c INFO: running scip-2.0.1-spx@94 for 228 with 1560 remaining (b = 0.04)
473.67/468.37	c INFO: running scip-2.0.1-clp@46 for 45 with 1333 remaining (b = 0.01)
520.30/514.78	c INFO: running scip-2.0.1-clp@92 for 91 with 1287 remaining (b = 0.02)
613.40/607.34	c INFO: running clasp-1.3.7@0 for 91 with 1194 remaining (b = 0.02)
710.21/703.61	c INFO: running scip-2.0.1-clp@184 for 593 with 1098 remaining (b = 0.06)
1310.41/1300.39	c INFO: running bsolo_pb10-l3@0 for 45 with 506 remaining (b = 0.01)
1358.35/1348.07	c INFO: running sat4j-pb-v20101225@0 for 91 with 458 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481535-1307578077/watcher-3481535-1307578077 -o /tmp/evaluation-result-3481535-1307578077/solver-3481535-1307578077 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481535-1307578077.opb -seed 1028587990 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.97 2.11 1.77 3/880 8616
/proc/meminfo: memFree=21675124/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=15772 CPUtime=0 cores=0,2,4,6
/proc/8616/stat : 8616 (python) R 8614 8616 7156 0 -1 4202496 868 0 0 0 0 0 0 0 20 0 1 0 948038433 16150528 750 33554432000 4194304 5683644 140737273651328 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/8616/statm: 3943 752 343 364 0 430 0

[startup+0.0381779 s]
/proc/loadavg: 1.97 2.11 1.77 3/880 8616
/proc/meminfo: memFree=21675124/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=18884 CPUtime=0.02 cores=0,2,4,6
/proc/8616/stat : 8616 (python) R 8614 8616 7156 0 -1 4202496 1287 0 0 0 2 0 0 0 20 0 1 0 948038433 19337216 1140 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284591640 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/8616/statm: 4721 1140 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.101167 s]
/proc/loadavg: 1.97 2.11 1.77 3/880 8616
/proc/meminfo: memFree=21675124/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=96124 CPUtime=0.07 cores=0,2,4,6
/proc/8616/stat : 8616 (python) R 8614 8616 7156 0 -1 4202496 3168 929 1 0 6 1 0 0 18 0 1 0 948038433 98430976 2483 33554432000 4194304 5683644 140737273651328 18446744073709551615 5177504 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/8616/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96124

[startup+0.301154 s]
/proc/loadavg: 1.97 2.11 1.77 3/880 8616
/proc/meminfo: memFree=21675124/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=202988 CPUtime=0.23 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 6670 929 1 0 17 6 0 0 17 0 1 0 948038433 207859712 4956 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/8616/statm: 50748 4959 1472 364 0 3710 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 202988

[startup+0.701035 s]
/proc/loadavg: 1.97 2.11 1.77 3/880 8616
/proc/meminfo: memFree=21675124/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=284768 CPUtime=0.38 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 9768 929 1 0 29 9 0 0 18 0 1 0 948038433 291602432 7500 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945935 0 0 16781312 2 3926233809493688320 0 0 17 6 0 0 0
/proc/8616/statm: 71192 7500 1777 364 0 6085 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 284768

[startup+1.50093 s]
/proc/loadavg: 1.97 2.11 1.78 3/881 8622
/proc/meminfo: memFree=21639040/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=292556 CPUtime=1.37 cores=0,2,4,6
/proc/8616/stat : 8616 (python) R 8614 8616 7156 0 -1 4202496 15231 1449 1 0 101 9 23 4 18 0 1 0 948038433 299577344 9486 33554432000 4194304 5683644 140737273651328 18446744073709551615 47468354814253 0 0 16781312 33554434 0 0 0 17 0 0 0 0
/proc/8616/statm: 73139 9486 1817 364 0 8032 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 292556

[startup+3.68352 s]
/proc/loadavg: 1.97 2.11 1.78 3/881 8622
/proc/meminfo: memFree=21639040/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=303416 CPUtime=1.55 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 16041 1449 1 0 118 10 23 4 21 0 2 0 948038433 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8616/statm: 75854 9694 1871 364 0 10741 0
Current children cumulated CPU time (s) 1.55
Current children cumulated vsize (KiB) 303416
heavy processes:

[startup+6.30116 s]
/proc/loadavg: 1.97 2.11 1.78 3/884 8625
/proc/meminfo: memFree=21534416/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=303416 CPUtime=1.55 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 16041 1449 1 0 118 10 23 4 21 0 2 0 948038433 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8616/statm: 75854 9694 1871 364 0 10741 0
[pid=8623] ppid=8616 vsize=293172 CPUtime=0.02 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 899 0 0 0 1 1 0 0 15 0 1 0 948038601 300208128 8161 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945935 0 0 16781312 33554946 112925608018706432 0 0 17 6 0 0 0
/proc/8623/statm: 73293 8161 342 364 0 8180 0
[pid=8625] ppid=8623 vsize=118524 CPUtime=4.62 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) R 8623 8625 8625 0 -1 4202496 28529 0 0 0 452 10 0 0 25 0 1 0 948038601 121368576 26668 33554432000 4194304 13684479 140733604265392 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8625/statm: 29631 26668 859 2317 0 27309 0
[pid=8616/tid=8624] ppid=8614 vsize=303416 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 28 1449 0 0 0 0 23 4 21 0 2 0 948038601 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 715112

[startup+12.7011 s]
/proc/loadavg: 1.98 2.11 1.78 3/884 8625
/proc/meminfo: memFree=21522520/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=303416 CPUtime=1.55 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 16041 1449 1 0 118 10 23 4 21 0 2 0 948038433 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8616/statm: 75854 9694 1871 364 0 10741 0
[pid=8623] ppid=8616 vsize=293172 CPUtime=0.05 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 907 0 0 0 3 2 0 0 15 0 1 0 948038601 300208128 8161 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945935 0 0 16781312 33554946 3385128394747281408 0 0 17 2 0 0 0
/proc/8623/statm: 73293 8161 342 364 0 8180 0
[pid=8625] ppid=8623 vsize=130056 CPUtime=11.01 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) R 8623 8625 8625 0 -1 4202496 31929 0 0 0 1086 15 0 0 18 0 1 0 948038601 133177344 29811 33554432000 4194304 13684479 140733604265392 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8625/statm: 32514 29811 762 2317 0 30192 0
[pid=8616/tid=8624] ppid=8614 vsize=303416 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 28 1449 0 0 0 0 23 4 21 0 2 0 948038601 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 726644

[startup+25.5009 s]
/proc/loadavg: 1.98 2.10 1.78 3/884 8627
/proc/meminfo: memFree=21505260/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=303416 CPUtime=1.55 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 16041 1449 1 0 118 10 23 4 21 0 2 0 948038433 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8616/statm: 75854 9694 1871 364 0 10741 0
[pid=8623] ppid=8616 vsize=293172 CPUtime=0.13 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 919 0 0 0 7 6 0 0 15 0 1 0 948038601 300208128 8161 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945935 0 0 16781312 33554946 1280198101600043008 0 0 17 6 0 0 0
/proc/8623/statm: 73293 8161 342 364 0 8180 0
[pid=8625] ppid=8623 vsize=145688 CPUtime=23.81 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) R 8623 8625 8625 0 -1 4202496 35794 0 0 0 2358 23 0 0 25 0 1 0 948038601 149184512 33528 33554432000 4194304 13684479 140733604265392 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8625/statm: 36422 33528 763 2317 0 34100 0
[pid=8616/tid=8624] ppid=8614 vsize=303416 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 28 1449 0 0 0 0 23 4 21 0 2 0 948038601 310697984 9694 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 742276

[startup+51.1007 s]
/proc/loadavg: 2.04 2.11 1.79 3/888 8631
/proc/meminfo: memFree=21456488/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=313672 CPUtime=1.58 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 16915 1449 1 0 121 10 23 4 20 0 3 0 948038433 321200128 9701 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/8616/statm: 78418 9701 1874 364 0 13302 0
[pid=8623] ppid=8616 vsize=303416 CPUtime=0.29 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 1133 0 0 0 15 14 0 0 16 0 2 0 948038601 310697984 8229 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8623/statm: 75854 8229 405 364 0 10741 0
[pid=8625] ppid=8623 vsize=145688 CPUtime=46.7 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) T 8623 8625 8625 0 -1 4202496 35807 0 0 0 4635 35 0 0 18 0 1 0 948038601 149184512 33541 33554432000 4194304 13684479 140733604265392 18446744073709551615 4907434 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8625/statm: 36422 33541 763 2317 0 34100 0
[pid=8623/tid=8628] ppid=8616 vsize=303416 CPUtime=0 cores=0,2,4,6
/proc/8623/task/8628/stat : 8628 (python) S 8616 8616 7156 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 948043272 310697984 8229 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604444541279104 0 0 -1 6 0 0 0
[pid=8629] ppid=8616 vsize=303428 CPUtime=0 cores=0,2,4,6
/proc/8629/stat : 8629 (python) S 8616 8616 7156 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 948043275 310710272 8142 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945990 0 0 16781312 33554946 7648573663041519874 0 0 17 6 0 0 0
/proc/8629/statm: 75857 8142 319 364 0 10741 0
[pid=8631] ppid=8629 vsize=60996 CPUtime=2.67 cores=0,2,4,6
/proc/8631/stat : 8631 (wbo1.4a) R 8629 8631 8631 0 -1 4202496 16039 0 0 0 265 2 0 0 25 0 1 0 948043275 62459904 14745 33554432000 134512640 135751879 4291912224 18446744073709551615 134541480 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/8631/statm: 15249 14745 143 303 0 14944 0
[pid=8616/tid=8624] ppid=8614 vsize=313672 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 28 1449 0 0 0 0 23 4 21 0 3 0 948038601 321200128 9701 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
[pid=8616/tid=8630] ppid=8614 vsize=313672 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8630/stat : 8630 (python) S 8614 8616 7156 0 -1 4202560 29 1449 0 0 0 0 23 4 20 0 3 0 948043275 321200128 9701 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.24
Current children cumulated vsize (KiB) 1127200

[startup+102.301 s]
/proc/loadavg: 2.02 2.09 1.80 3/892 8637
/proc/meminfo: memFree=21086268/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=323928 CPUtime=1.6 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 17813 1449 1 0 123 10 23 4 20 0 4 0 948038433 331702272 9707 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/8616/statm: 80982 9707 1876 364 0 15863 0
[pid=8623] ppid=8616 vsize=303416 CPUtime=0.29 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 1133 0 0 0 15 14 0 0 16 0 2 0 948038601 310697984 8229 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8623/statm: 75854 8229 405 364 0 10741 0
[pid=8625] ppid=8623 vsize=145688 CPUtime=46.7 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) T 8623 8625 8625 0 -1 4202496 35807 0 0 0 4635 35 0 0 18 0 1 0 948038601 149184512 33541 33554432000 4194304 13684479 140733604265392 18446744073709551615 4907434 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8625/statm: 36422 33541 763 2317 0 34100 0
[pid=8623/tid=8628] ppid=8616 vsize=303416 CPUtime=0 cores=0,2,4,6
/proc/8623/task/8628/stat : 8628 (python) S 8616 8616 7156 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 948043272 310697984 8229 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604444541279104 0 0 -1 6 0 0 0
[pid=8629] ppid=8616 vsize=303428 CPUtime=0.29 cores=0,2,4,6
/proc/8629/stat : 8629 (python) S 8616 8616 7156 0 -1 4202560 1214 0 0 0 15 14 0 0 16 0 2 0 948043275 310710272 8220 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/8629/statm: 75857 8220 396 364 0 10741 0
[pid=8631] ppid=8629 vsize=310412 CPUtime=50.27 cores=0,2,4,6
/proc/8631/stat : 8631 (wbo1.4a) T 8629 8631 8631 0 -1 4202496 83725 0 0 0 4995 32 0 0 25 0 1 0 948043275 317861888 76962 33554432000 134512640 135751879 4291912224 18446744073709551615 134517414 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/8631/statm: 77603 76962 146 303 0 77298 0
[pid=8629/tid=8634] ppid=8616 vsize=303428 CPUtime=0 cores=0,2,4,6
/proc/8629/task/8634/stat : 8634 (python) S 8616 8616 7156 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 948048304 310710272 8220 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604446929686656 0 0 -1 0 0 0 0
[pid=8635] ppid=8616 vsize=313684 CPUtime=0.02 cores=0,2,4,6
/proc/8635/stat : 8635 (python) S 8616 8616 7156 0 -1 4202560 1033 0 0 0 1 1 0 0 15 0 1 0 948048307 321212416 8175 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945990 0 0 16781312 33554946 4294934785 0 0 17 0 0 0 0
/proc/8635/statm: 78421 8175 348 364 0 13302 0
[pid=8637] ppid=8635 vsize=120080 CPUtime=3.54 cores=0,2,4,6
/proc/8637/stat : 8637 (scip-2.0.1.linu) R 8635 8637 8637 0 -1 4202496 27762 0 0 0 345 9 0 0 24 0 1 0 948048307 122961920 26221 33554432000 4194304 15243407 140734981919984 18446744073709551615 7323043 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/8637/statm: 30020 26221 851 2698 0 27315 0
[pid=8616/tid=8624] ppid=8614 vsize=323928 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 28 1449 0 0 0 0 23 4 21 0 4 0 948038601 331702272 9707 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
[pid=8616/tid=8630] ppid=8614 vsize=323928 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8630/stat : 8630 (python) S 8614 8616 7156 0 -1 4202560 29 1449 0 0 0 0 23 4 20 0 4 0 948043275 331702272 9707 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
[pid=8616/tid=8636] ppid=8614 vsize=323928 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8636/stat : 8636 (python) S 8614 8616 7156 0 -1 4202560 26 1449 0 0 0 0 23 4 20 0 4 0 948048307 331702272 9707 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.71
Current children cumulated vsize (KiB) 1820636

[startup+162.302 s]
/proc/loadavg: 2.00 2.07 1.81 3/914 8659

################
# More data... #
################

[pid=8616/tid=9255] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/9255/stat : 9255 (python) S 8614 8616 7156 0 -1 4202560 25 1449 0 0 0 0 23 4 20 0 8 0 948173241 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1358.76
Current children cumulated vsize (KiB) 20489588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1348.3 s]
/proc/loadavg: 1.17 1.49 1.76 5/988 9273
/proc/meminfo: memFree=13457756/32951124 swapFree=33333036/67111528
[pid=8616] ppid=8614 vsize=364952 CPUtime=1.78 cores=0,2,4,6
/proc/8616/stat : 8616 (python) S 8614 8616 7156 0 -1 4202496 21511 1449 1 0 140 11 23 4 20 0 8 0 948038433 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/8616/statm: 91238 9731 1884 364 0 26107 0
[pid=8623] ppid=8616 vsize=303416 CPUtime=1.84 cores=0,2,4,6
/proc/8623/stat : 8623 (python) S 8616 8616 7156 0 -1 4202560 1214 0 0 0 91 93 0 0 15 0 2 0 948038601 310697984 8231 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8623/statm: 75854 8231 407 364 0 10741 0
[pid=8625] ppid=8623 vsize=145812 CPUtime=324.53 cores=0,2,4,6
/proc/8625/stat : 8625 (scip-2.0.1.linu) T 8623 8625 8625 0 -1 4202496 38978 0 0 0 32197 256 0 0 25 0 1 0 948038601 149311488 33621 33554432000 4194304 13684479 140733604265392 18446744073709551615 7398956 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8625/statm: 36453 33621 806 2317 0 34131 0
[pid=8623/tid=8628] ppid=8616 vsize=303416 CPUtime=0 cores=0,2,4,6
/proc/8623/task/8628/stat : 8628 (python) S 8616 8616 7156 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 948043272 310697984 8231 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604444541279104 0 0 -1 6 0 0 0
[pid=8629] ppid=8616 vsize=303428 CPUtime=0.29 cores=0,2,4,6
/proc/8629/stat : 8629 (python) S 8616 8616 7156 0 -1 4202560 1214 0 0 0 15 14 0 0 16 0 2 0 948043275 310710272 8220 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/8629/statm: 75857 8220 396 364 0 10741 0
[pid=8631] ppid=8629 vsize=310412 CPUtime=50.27 cores=0,2,4,6
/proc/8631/stat : 8631 (wbo1.4a) T 8629 8631 8631 0 -1 4202496 83725 0 0 0 4995 32 0 0 25 0 1 0 948043275 317861888 76962 33554432000 134512640 135751879 4291912224 18446744073709551615 134517414 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/8631/statm: 77603 76962 146 303 0 77298 0
[pid=8629/tid=8634] ppid=8616 vsize=303428 CPUtime=0 cores=0,2,4,6
/proc/8629/task/8634/stat : 8634 (python) S 8616 8616 7156 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 948048304 310710272 8220 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604446929686656 0 0 -1 0 0 0 0
[pid=8635] ppid=8616 vsize=313684 CPUtime=4.89 cores=0,2,4,6
/proc/8635/stat : 8635 (python) S 8616 8616 7156 0 -1 4202560 1352 0 0 0 253 236 0 0 15 0 2 0 948048307 321212416 8225 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8635/statm: 78421 8225 397 364 0 13302 0
[pid=8637] ppid=8635 vsize=207880 CPUtime=782.15 cores=0,2,4,6
/proc/8637/stat : 8637 (scip-2.0.1.linu) T 8635 8637 8637 0 -1 4202496 243055 0 0 0 77726 489 0 0 18 0 1 0 948048307 212869120 48805 33554432000 4194304 15243407 140734981919984 18446744073709551615 8045280 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/8637/statm: 51970 48805 947 2698 0 49265 0
[pid=8635/tid=8638] ppid=8616 vsize=313684 CPUtime=0 cores=0,2,4,6
/proc/8635/task/8638/stat : 8638 (python) S 8616 8616 7156 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 948052990 321212416 8225 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604447416901952 0 0 -1 0 0 0 0
[pid=8639] ppid=8616 vsize=323940 CPUtime=0.25 cores=0,2,4,6
/proc/8639/stat : 8639 (python) S 8616 8616 7156 0 -1 4202560 1168 0 0 0 12 13 0 0 16 0 2 0 948052993 331714560 8222 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8639/statm: 80985 8222 390 364 0 15863 0
[pid=8641] ppid=8639 vsize=8550704 CPUtime=47.81 cores=0,2,4,6
/proc/8641/stat : 8641 (java) T 8639 8641 8641 0 -1 4202496 571044 0 1 0 4718 63 0 0 18 0 19 0 948052993 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296728549 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/8641/statm: 2137676 566795 2252 9 0 2128417 0
[pid=8641/tid=8642] ppid=8639 vsize=8550704 CPUtime=44.5 cores=0,2,4,6
/proc/8641/task/8642/stat : 8642 (java) T 8639 8641 8641 0 -1 4202560 471469 0 1 0 4401 49 0 0 25 0 19 0 948052994 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 46912506035501 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8643] ppid=8639 vsize=8550704 CPUtime=0.2 cores=0,2,4,6
/proc/8641/task/8643/stat : 8643 (java) T 8639 8641 8641 0 -1 4202560 17474 0 0 0 18 2 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8641/tid=8644] ppid=8639 vsize=8550704 CPUtime=0.11 cores=0,2,4,6
/proc/8641/task/8644/stat : 8644 (java) T 8639 8641 8641 0 -1 4202560 7969 0 0 0 11 0 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=8641/tid=8645] ppid=8639 vsize=8550704 CPUtime=0.09 cores=0,2,4,6
/proc/8641/task/8645/stat : 8645 (java) T 8639 8641 8641 0 -1 4202560 7200 0 0 0 8 1 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8646] ppid=8639 vsize=8550704 CPUtime=0.08 cores=0,2,4,6
/proc/8641/task/8646/stat : 8646 (java) T 8639 8641 8641 0 -1 4202560 7319 0 0 0 8 0 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8641/tid=8647] ppid=8639 vsize=8550704 CPUtime=0.14 cores=0,2,4,6
/proc/8641/task/8647/stat : 8647 (java) T 8639 8641 8641 0 -1 4202560 11715 0 0 0 13 1 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=8641/tid=8648] ppid=8639 vsize=8550704 CPUtime=0.2 cores=0,2,4,6
/proc/8641/task/8648/stat : 8648 (java) T 8639 8641 8641 0 -1 4202560 16441 0 0 0 19 1 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=8641/tid=8649] ppid=8639 vsize=8550704 CPUtime=0.13 cores=0,2,4,6
/proc/8641/task/8649/stat : 8649 (java) T 8639 8641 8641 0 -1 4202560 10311 0 0 0 12 1 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8650] ppid=8639 vsize=8550704 CPUtime=0.1 cores=0,2,4,6
/proc/8641/task/8650/stat : 8650 (java) T 8639 8641 8641 0 -1 4202560 8218 0 0 0 9 1 0 0 15 0 19 0 948052995 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=8641/tid=8651] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8651/stat : 8651 (java) T 8639 8641 8641 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 948052996 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296742400 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8652] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8652/stat : 8652 (java) T 8639 8641 8641 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 948052996 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8653] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8653/stat : 8653 (java) T 8639 8641 8641 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 948052996 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8654] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8654/stat : 8654 (java) T 8639 8641 8641 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948052999 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296749489 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8655] ppid=8639 vsize=8550704 CPUtime=1.19 cores=0,2,4,6
/proc/8641/task/8655/stat : 8655 (java) T 8639 8641 8641 0 -1 4202560 4733 0 0 0 119 0 0 0 15 0 19 0 948052999 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8641/tid=8656] ppid=8639 vsize=8550704 CPUtime=0.94 cores=0,2,4,6
/proc/8641/task/8656/stat : 8656 (java) T 8639 8641 8641 0 -1 4202560 5529 0 0 0 94 0 0 0 15 0 19 0 948052999 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=8641/tid=8657] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8657/stat : 8657 (java) T 8639 8641 8641 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948052999 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296741785 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8641/tid=8658] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8658/stat : 8658 (java) T 8639 8641 8641 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 948052999 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296742400 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=8641/tid=8659] ppid=8639 vsize=8550704 CPUtime=0 cores=0,2,4,6
/proc/8641/task/8659/stat : 8659 (java) T 8639 8641 8641 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 948053070 8755920896 566795 33554432000 1073741824 1073778376 140735722821328 18446744073709551615 224296742400 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=8639/tid=8662] ppid=8616 vsize=323940 CPUtime=0 cores=0,2,4,6
/proc/8639/task/8662/stat : 8662 (python) S 8616 8616 7156 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 948057481 331714560 8222 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604452396128064 0 0 -1 6 0 0 0
[pid=9021] ppid=8616 vsize=334196 CPUtime=0.49 cores=0,2,4,6
/proc/9021/stat : 9021 (python) S 8616 8616 7156 0 -1 4202560 1195 0 0 0 24 25 0 0 17 0 2 0 948099168 342216704 8226 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/9021/statm: 83549 8226 390 364 0 18424 0
[pid=9023] ppid=9021 vsize=17512 CPUtime=96.24 cores=0,2,4,6
/proc/9023/stat : 9023 (clasp-1.3.7-x86) T 9021 9023 9023 0 -1 4202496 4751 0 0 0 9623 1 0 0 25 0 1 0 948099168 17932288 4125 33554432000 134512640 136139019 4287664848 18446744073709551615 134599833 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/9023/statm: 4378 4125 187 398 0 3978 0
[pid=9021/tid=9067] ppid=8616 vsize=334196 CPUtime=0 cores=0,2,4,6
/proc/9021/task/9067/stat : 9067 (python) S 8616 8616 7156 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 948108793 342216704 8226 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604443397974080 0 0 -1 6 0 0 0
[pid=9250] ppid=8616 vsize=344452 CPUtime=0.25 cores=0,2,4,6
/proc/9250/stat : 9250 (python) S 8616 8616 7156 0 -1 4202560 1169 0 0 0 12 13 0 0 16 0 2 0 948168472 352718848 8230 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296752587 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/9250/statm: 86113 8230 390 364 0 20985 0
[pid=9252] ppid=9250 vsize=81604 CPUtime=47.66 cores=0,2,4,6
/proc/9252/stat : 9252 (bsolo_pb10) T 9250 9252 9252 0 -1 4202496 18589 0 0 0 4763 3 0 0 25 0 1 0 948168473 83562496 17891 33554432000 134512640 137138936 4288193472 18446744073709551615 134542319 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/9252/statm: 20401 17891 192 642 0 19757 0
[pid=9250/tid=9253] ppid=8616 vsize=344452 CPUtime=0 cores=0,2,4,6
/proc/9250/task/9253/stat : 9253 (python) S 8616 8616 7156 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 948173240 352718848 8230 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554946 18446604451561233280 0 0 -1 6 0 0 0
[pid=9254] ppid=8616 vsize=354708 CPUtime=0 cores=0,2,4,6
/proc/9254/stat : 9254 (python) S 8616 8616 7156 0 -1 4202560 826 0 0 0 0 0 0 0 19 0 1 0 948173241 363220992 8162 33554432000 4194304 5683644 140737273651328 18446744073709551615 224284945990 0 0 16781312 33554946 1708589104754589696 0 0 17 0 0 0 0
/proc/9254/statm: 88677 8162 319 364 0 23546 0
[pid=9256] ppid=9254 vsize=8532888 CPUtime=0.31 cores=0,2,4,6
/proc/9256/stat : 9256 (java) S 9254 9256 9256 0 -1 4202496 6655 0 1 0 30 1 0 0 20 0 18 0 948173241 8737677312 6109 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296728549 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/9256/statm: 2133222 6109 2175 9 0 2123963 0
[pid=9256/tid=9257] ppid=9254 vsize=8532888 CPUtime=0.25 cores=0,2,4,6
/proc/9256/task/9257/stat : 9257 (java) R 9254 9256 9256 0 -1 4202560 4375 0 1 0 24 1 0 0 18 0 18 0 948173242 8737677312 6195 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 47158470462291 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=9256/tid=9258] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9258/stat : 9258 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 948173243 8737677312 6195 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 6 0 0 0
[pid=9256/tid=9259] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9259/stat : 9259 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 6 0 0 0
[pid=9256/tid=9260] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9260/stat : 9260 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 6 0 0 0
[pid=9256/tid=9261] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9261/stat : 9261 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9262] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9262/stat : 9262 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9263] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9263/stat : 9263 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9264] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9264/stat : 9264 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173243 8737677312 6196 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9265] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9265/stat : 9265 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173243 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9266] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9266/stat : 9266 (java) S 9254 9256 9256 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 948173244 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296742400 0 0 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9267] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9267/stat : 9267 (java) S 9254 9256 9256 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 948173244 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9268] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9268/stat : 9268 (java) S 9254 9256 9256 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 948173244 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 0 0 0 0
[pid=9256/tid=9269] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9269/stat : 9269 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173247 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296749489 0 4 0 16800975 18446604452396126272 0 0 -1 6 0 0 0
[pid=9256/tid=9270] ppid=9254 vsize=8532888 CPUtime=0.04 cores=0,2,4,6
/proc/9256/task/9270/stat : 9270 (java) R 9254 9256 9256 0 -1 4202560 381 0 0 0 4 0 0 0 25 0 18 0 948173247 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 47158469155584 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=9256/tid=9271] ppid=9254 vsize=8532888 CPUtime=0.02 cores=0,2,4,6
/proc/9256/task/9271/stat : 9271 (java) R 9254 9256 9256 0 -1 4202560 592 0 0 0 2 0 0 0 25 0 18 0 948173247 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=9256/tid=9272] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9272/stat : 9272 (java) S 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948173247 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296741785 0 4 0 16800975 18446604452396126272 0 0 -1 6 0 0 0
[pid=9256/tid=9273] ppid=9254 vsize=8532888 CPUtime=0 cores=0,2,4,6
/proc/9256/task/9273/stat : 9273 (java) R 9254 9256 9256 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 948173247 8737677312 6197 33554432000 1073741824 1073778376 140735843485824 18446744073709551615 224296742400 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=8616/tid=8624] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8624/stat : 8624 (python) S 8614 8616 7156 0 -1 4202560 35 1449 0 0 0 0 23 4 18 0 8 0 948038601 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
[pid=8616/tid=8630] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8630/stat : 8630 (python) S 8614 8616 7156 0 -1 4202560 29 1449 0 0 0 0 23 4 20 0 8 0 948043275 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
[pid=8616/tid=8636] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8636/stat : 8636 (python) S 8614 8616 7156 0 -1 4202560 35 1449 0 0 0 0 23 4 15 0 8 0 948048307 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
[pid=8616/tid=8640] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/8640/stat : 8640 (python) S 8614 8616 7156 0 -1 4202560 26 1449 0 0 0 0 23 4 20 0 8 0 948052993 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
[pid=8616/tid=9022] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/9022/stat : 9022 (python) S 8614 8616 7156 0 -1 4202560 27 1449 0 0 0 0 23 4 20 0 8 0 948099168 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
[pid=8616/tid=9251] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/9251/stat : 9251 (python) S 8614 8616 7156 0 -1 4202560 29 1449 0 0 0 0 23 4 20 0 8 0 948168472 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 0 0 0 0
[pid=8616/tid=9255] ppid=8614 vsize=364952 CPUtime=0.27 cores=0,2,4,6
/proc/8616/task/9255/stat : 9255 (python) S 8614 8616 7156 0 -1 4202560 25 1449 0 0 0 0 23 4 20 0 8 0 948173241 373710848 9731 33554432000 4194304 5683644 140737273651328 18446744073709551615 224296749489 0 0 16781312 33554434 18446604447111546752 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1358.76
Current children cumulated vsize (KiB) 20489588

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8616 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=642750
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=160975
# CPU time returned by wait4() is 1.80373
# while last known CPU time is 1358.76
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1348.44
CPU time (s): 1358.76
CPU user time (s): 1346.22
CPU system time (s): 12.54
CPU usage (%): 100.765
Max. virtual memory (cumulated for all children) (KiB): 20489588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.64275
system time used= 0.160975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22965
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13610
involuntary context switches= 38

runsolver used 13.095 second user time and 26.9219 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-09 02:07:57
IDJOB=3481535
IDBENCH=48202
IDSOLVER=1970
FILE ID=node118/3481535-1307578077
RUNJOBID= node118-1307576359-7174
PBS_JOBID= 13547681
Free space on /tmp= 73404 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_500_60_4.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481535-1307578077/watcher-3481535-1307578077 -o /tmp/evaluation-result-3481535-1307578077/solver-3481535-1307578077 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481535-1307578077.opb -seed 1028587990 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 468c9636f2c99e512d4c3bca04b78033
RANDOM SEED=1028587990

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21675156 kB
Buffers:        145540 kB
Cached:         900340 kB
SwapCached:      16428 kB
Active:       10767936 kB
Inactive:       143748 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21675156 kB
SwapTotal:    67111528 kB
SwapFree:     33333036 kB
Dirty:          103296 kB
Writeback:           0 kB
AnonPages:     9862888 kB
Mapped:         106732 kB
Slab:           145744 kB
PageTables:     142612 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 201029804 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73240 MiB
End job on node118 at 2011-06-09 02:30:28