Trace number 3481802

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 197.56 194.606

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/
sorensson/garden/normalized-g100x100.opb
MD5SUMb7796d84094d982e45331121511974b4
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2757
Best CPU time to get the best result obtained on this benchmark1800.16
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 2297
Optimality of the best value was proved NO
Number of variables10000
Total number of constraints10000
Number of constraints which are clauses10000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint3
Maximum length of a constraint5
Number of terms in the objective function 10000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 10000
Number of bits of the sum of numbers in the objective function 14
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 10000
Number of bits of the biggest sum of numbers14
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.28/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.28/0.49	c INFO: solving HOME/instance-3481802-1307576882.opb
0.36/0.59	c INFO: parsing took 0.10 s
0.55/0.79	c INFO: features took 0.20 CPU seconds
0.65/0.82	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.34)
49.16/49.22	c INFO: running sat4j-pb-v20101225@0 for 45 with 1751 remaining (b = 0.10)
99.62/97.74	c INFO: running scip-2.0.1-clp@0 for 45 with 1701 remaining (b = 0.03)
148.14/146.15	c INFO: running wbo1.4a@0 for 45 with 1652 remaining (b = 0.01)
195.86/193.77	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1606 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481802-1307576882/watcher-3481802-1307576882 -o /tmp/evaluation-result-3481802-1307576882/solver-3481802-1307576882 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481802-1307576882.opb -seed 271738601 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.57 0.76 2/435 17032
/proc/meminfo: memFree=26801100/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 936 0 0 0 0 0 0 0 20 0 1 0 947918810 16154624 814 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020393984 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/17032/statm: 3944 814 356 364 0 431 0

[startup+0.0415281 s]
/proc/loadavg: 1.92 1.57 0.76 2/435 17032
/proc/meminfo: memFree=26801100/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=18888 CPUtime=0.02 cores=1,3,5,7
/proc/17032/stat : 17032 (python) R 17030 17032 16077 0 -1 4202496 1289 0 0 0 2 0 0 0 20 0 1 0 947918810 19341312 1141 33554432000 4194304 5683644 140733517217024 18446744073709551615 4509181 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17032/statm: 4722 1141 421 364 0 691 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18888

[startup+0.100484 s]
/proc/loadavg: 1.92 1.57 0.76 2/435 17032
/proc/meminfo: memFree=26801100/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=96128 CPUtime=0.06 cores=1,3,5,7
/proc/17032/stat : 17032 (python) R 17030 17032 16077 0 -1 4202496 3170 934 1 0 5 1 0 0 18 0 1 0 947918810 98435072 2484 33554432000 4194304 5683644 140733517217024 18446744073709551615 5177920 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17032/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96128

[startup+0.300523 s]
/proc/loadavg: 1.92 1.57 0.76 2/435 17032
/proc/meminfo: memFree=26801100/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=177692 CPUtime=0.2 cores=1,3,5,7
/proc/17032/stat : 17032 (python) R 17030 17032 16077 0 -1 4202496 6258 934 1 0 16 4 0 0 17 0 1 0 947918810 181956608 4567 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020393984 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/17032/statm: 44423 4567 1238 364 0 3535 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 177692

[startup+0.700441 s]
/proc/loadavg: 1.92 1.57 0.76 2/435 17032
/proc/meminfo: memFree=26801100/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=286852 CPUtime=0.55 cores=1,3,5,7
/proc/17032/stat : 17032 (python) R 17030 17032 16077 0 -1 4202496 10727 934 1 0 48 7 0 0 17 0 1 0 947918810 293736448 8053 33554432000 4194304 5683644 140733517217024 18446744073709551615 47143733758456 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/17032/statm: 71713 8053 1816 364 0 6606 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 286852

[startup+1.50026 s]
/proc/loadavg: 1.93 1.57 0.77 3/439 17041
/proc/meminfo: memFree=26732860/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=297276 CPUtime=0.67 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11074 934 1 0 60 7 0 0 19 0 2 0 947918810 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17032/statm: 74319 8169 1862 364 0 9206 0
[pid=17039] ppid=17032 vsize=287032 CPUtime=0 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 749 0 0 0 0 0 0 0 16 0 1 0 947918892 293920768 6655 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416015 0 0 16781312 33554946 9551697105240686852 0 0 17 5 0 0 0
/proc/17039/statm: 71758 6655 352 364 0 6645 0
[pid=17041] ppid=17039 vsize=79464 CPUtime=0.66 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) R 17039 17041 17041 0 -1 4202496 18268 0 0 0 61 5 0 0 21 0 1 0 947918892 81371136 17019 33554432000 4194304 13684479 140734695884096 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17041/statm: 19866 17019 763 2317 0 17544 0
[pid=17032/tid=17040] ppid=17030 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 947918892 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 663772

[startup+3.10097 s]
/proc/loadavg: 1.93 1.57 0.77 3/439 17041
/proc/meminfo: memFree=26702108/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=297276 CPUtime=0.67 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11074 934 1 0 60 7 0 0 19 0 2 0 947918810 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17032/statm: 74319 8169 1862 364 0 9206 0
[pid=17039] ppid=17032 vsize=287032 CPUtime=0 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 947918892 293920768 6655 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416015 0 0 16781312 33554946 9551697105240686852 0 0 17 5 0 0 0
/proc/17039/statm: 71758 6655 352 364 0 6645 0
[pid=17041] ppid=17039 vsize=83452 CPUtime=2.26 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) R 17039 17041 17041 0 -1 4202496 19567 0 0 0 219 7 0 0 25 0 1 0 947918892 85454848 18129 33554432000 4194304 13684479 140734695884096 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17041/statm: 20863 18129 723 2317 0 18541 0
[pid=17032/tid=17040] ppid=17030 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 947918892 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 667760

[startup+6.30038 s]
/proc/loadavg: 1.93 1.58 0.78 3/439 17041
/proc/meminfo: memFree=26702752/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=297276 CPUtime=0.67 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11074 934 1 0 60 7 0 0 19 0 2 0 947918810 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17032/statm: 74319 8169 1862 364 0 9206 0
[pid=17039] ppid=17032 vsize=287032 CPUtime=0 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 899 0 0 0 0 0 0 0 15 0 1 0 947918892 293920768 6679 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416015 0 0 16781312 33554946 9551697861154930948 0 0 17 7 0 0 0
/proc/17039/statm: 71758 6679 376 364 0 6645 0
[pid=17041] ppid=17039 vsize=84712 CPUtime=5.47 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) R 17039 17041 17041 0 -1 4202496 19608 0 0 0 538 9 0 0 25 0 1 0 947918892 86745088 18170 33554432000 4194304 13684479 140734695884096 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17041/statm: 21178 18170 727 2317 0 18856 0
[pid=17032/tid=17040] ppid=17030 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 947918892 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 669020

[startup+12.7012 s]
/proc/loadavg: 1.94 1.59 0.78 3/439 17041
/proc/meminfo: memFree=26700204/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=297276 CPUtime=0.67 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11074 934 1 0 60 7 0 0 19 0 2 0 947918810 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17032/statm: 74319 8169 1862 364 0 9206 0
[pid=17039] ppid=17032 vsize=287032 CPUtime=0.02 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 901 0 0 0 1 1 0 0 15 0 1 0 947918892 293920768 6679 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416015 0 0 16781312 33554946 5623753486446373600 0 0 17 7 0 0 0
/proc/17039/statm: 71758 6679 376 364 0 6645 0
[pid=17041] ppid=17039 vsize=85508 CPUtime=11.86 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) R 17039 17041 17041 0 -1 4202496 20978 0 0 0 1175 11 0 0 25 0 1 0 947918892 87560192 18394 33554432000 4194304 13684479 140734695884096 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17041/statm: 21377 18394 724 2317 0 19055 0
[pid=17032/tid=17040] ppid=17030 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 947918892 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 669816

[startup+25.5009 s]
/proc/loadavg: 1.95 1.61 0.80 3/439 17041
/proc/meminfo: memFree=26696364/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=297276 CPUtime=0.67 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11074 934 1 0 60 7 0 0 19 0 2 0 947918810 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17032/statm: 74319 8169 1862 364 0 9206 0
[pid=17039] ppid=17032 vsize=287032 CPUtime=0.06 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 911 0 0 0 3 3 0 0 15 0 1 0 947918892 293920768 6679 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416015 0 0 16781312 33554946 5623753486446373600 0 0 17 7 0 0 0
/proc/17039/statm: 71758 6679 376 364 0 6645 0
[pid=17041] ppid=17039 vsize=90608 CPUtime=24.66 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) R 17039 17041 17041 0 -1 4202496 23826 0 0 0 2453 13 0 0 25 0 1 0 947918892 92782592 19635 33554432000 4194304 13684479 140734695884096 18446744073709551615 7357966 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17041/statm: 22652 19635 739 2317 0 20330 0
[pid=17032/tid=17040] ppid=17030 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 947918892 304410624 8169 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 674916

[startup+51.1012 s]
/proc/loadavg: 2.13 1.67 0.84 3/465 17068
/proc/meminfo: memFree=26549828/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=308036 CPUtime=0.7 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 11967 934 1 0 62 8 0 0 20 0 3 0 947918810 315428864 8282 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/17032/statm: 77009 8282 1865 364 0 11893 0
[pid=17039] ppid=17032 vsize=297276 CPUtime=0.13 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 1090 0 0 0 5 8 0 0 17 0 2 0 947918892 304410624 6715 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17039/statm: 74319 6715 407 364 0 9206 0
[pid=17041] ppid=17039 vsize=96156 CPUtime=48.36 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) T 17039 17041 17041 0 -1 4202496 30089 0 0 0 4819 17 0 0 25 0 1 0 947918892 98463744 20323 33554432000 4194304 13684479 140734695884096 18446744073709551615 7455065 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/17041/statm: 24039 20323 724 2317 0 21717 0
[pid=17039/tid=17047] ppid=17032 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17039/task/17047/stat : 17047 (python) S 17032 17032 16077 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 947923730 304410624 6715 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604455561860032 0 0 -1 7 0 0 0
[pid=17048] ppid=17032 vsize=297792 CPUtime=0 cores=1,3,5,7
/proc/17048/stat : 17048 (python) S 17032 17032 16077 0 -1 4202560 775 0 0 0 0 0 0 0 15 0 1 0 947923732 304939008 6762 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416070 0 0 16781312 33554946 1591563190242639872 0 0 17 5 0 0 0
/proc/17048/statm: 74448 6762 349 364 0 9332 0
[pid=17050] ppid=17048 vsize=8539608 CPUtime=3.08 cores=1,3,5,7
/proc/17050/stat : 17050 (java) S 17048 17050 17050 0 -1 4202496 33828 0 1 0 303 5 0 0 20 0 19 0 947923733 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/17050/statm: 2134902 28749 2236 9 0 2125643 0
[pid=17050/tid=17051] ppid=17048 vsize=8539608 CPUtime=1.85 cores=1,3,5,7
/proc/17050/task/17051/stat : 17051 (java) R 17048 17050 17050 0 -1 4202560 24357 0 1 0 182 3 0 0 25 0 19 0 947923733 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 46912505977723 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17050/tid=17052] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17052/stat : 17052 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 1 0 0 0
[pid=17050/tid=17053] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17053/stat : 17053 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17054] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17054/stat : 17054 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17055] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17055/stat : 17055 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17056] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17056/stat : 17056 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17057] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17057/stat : 17057 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17058] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17058/stat : 17058 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17059] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17059/stat : 17059 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947923734 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17060] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17060/stat : 17060 (java) S 17048 17050 17050 0 -1 4202560 6 0 0 0 0 0 0 0 18 0 19 0 947923735 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032212480 0 0 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17061] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17061/stat : 17061 (java) S 17048 17050 17050 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 19 0 947923735 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 1 0 0 0
[pid=17050/tid=17062] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17062/stat : 17062 (java) S 17048 17050 17050 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 19 0 947923735 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 1 0 0 0
[pid=17050/tid=17063] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17063/stat : 17063 (java) S 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 947923737 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032219569 0 4 0 16800975 18446604467411462976 0 0 -1 1 0 0 0
[pid=17050/tid=17064] ppid=17048 vsize=8539608 CPUtime=0.59 cores=1,3,5,7
/proc/17050/task/17064/stat : 17064 (java) S 17048 17050 17050 0 -1 4202560 4791 0 0 0 59 0 0 0 15 0 19 0 947923737 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 1 0 0 0
[pid=17050/tid=17065] ppid=17048 vsize=8539608 CPUtime=0.61 cores=1,3,5,7
/proc/17050/task/17065/stat : 17065 (java) S 17048 17050 17050 0 -1 4202560 3277 0 0 0 61 0 0 0 15 0 19 0 947923737 8744558592 28749 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446604467411462976 0 0 -1 7 0 0 0
[pid=17050/tid=17066] ppid=17048 vsize=8539608 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

[pid=17168/tid=17182] ppid=17166 vsize=8603664 CPUtime=0.46 cores=1,3,5,7
/proc/17168/task/17182/stat : 17182 (java) S 17166 17168 17168 0 -1 4202560 4072 0 0 0 45 1 0 0 16 0 19 0 947938192 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 1 0 0 0
[pid=17168/tid=17183] ppid=17166 vsize=8603664 CPUtime=0.4 cores=1,3,5,7
/proc/17168/task/17183/stat : 17183 (java) S 17166 17168 17168 0 -1 4202560 3706 0 0 0 40 0 0 0 16 0 19 0 947938192 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17184] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17184/stat : 17184 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947938192 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17185] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17185/stat : 17185 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 947938193 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032212480 0 4 0 16800975 18446604459355639936 0 0 -1 3 0 0 0
[pid=17168/tid=17186] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17186/stat : 17186 (java) S 17166 17168 17168 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 947938249 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032212480 0 4 0 16800975 18446604459355639936 0 0 -1 3 0 0 0
[pid=17032/tid=17040] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 6 0 947918892 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
[pid=17032/tid=17049] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17049/stat : 17049 (python) S 17030 17032 16077 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 6 0 947923733 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 1 0 0 0
[pid=17032/tid=17076] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17076/stat : 17076 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 6 0 947928585 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 3 0 0 0
[pid=17032/tid=17157] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17157/stat : 17157 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 6 0 947933426 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
[pid=17032/tid=17167] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17167/stat : 17167 (python) S 17030 17032 16077 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 6 0 947938188 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 197.56
Current children cumulated vsize (KiB) 19317932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+194.502 s]
/proc/loadavg: 2.02 1.80 1.01 4/513 17186
/proc/meminfo: memFree=25443700/32951124 swapFree=67056304/67111528
[pid=17032] ppid=17030 vsize=338804 CPUtime=0.78 cores=1,3,5,7
/proc/17032/stat : 17032 (python) S 17030 17032 16077 0 -1 4202496 14740 934 1 0 69 9 0 0 20 0 6 0 947918810 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/17032/statm: 84701 8308 1879 364 0 19576 0
[pid=17039] ppid=17032 vsize=297276 CPUtime=0.13 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 17032 17032 16077 0 -1 4202560 1090 0 0 0 5 8 0 0 17 0 2 0 947918892 304410624 6715 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17039/statm: 74319 6715 407 364 0 9206 0
[pid=17041] ppid=17039 vsize=96156 CPUtime=48.36 cores=1,3,5,7
/proc/17041/stat : 17041 (scip-2.0.1.linu) T 17039 17041 17041 0 -1 4202496 30089 0 0 0 4819 17 0 0 25 0 1 0 947918892 98463744 20323 33554432000 4194304 13684479 140734695884096 18446744073709551615 7455065 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/17041/statm: 24039 20323 724 2317 0 21717 0
[pid=17039/tid=17047] ppid=17032 vsize=297276 CPUtime=0 cores=1,3,5,7
/proc/17039/task/17047/stat : 17047 (python) S 17032 17032 16077 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 947923730 304410624 6715 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604455561860032 0 0 -1 7 0 0 0
[pid=17048] ppid=17032 vsize=297792 CPUtime=0.14 cores=1,3,5,7
/proc/17048/stat : 17048 (python) S 17032 17032 16077 0 -1 4202560 1092 0 0 0 7 7 0 0 17 0 2 0 947923732 304939008 6811 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/17048/statm: 74448 6811 397 364 0 9332 0
[pid=17050] ppid=17048 vsize=8539436 CPUtime=50.31 cores=1,3,5,7
/proc/17050/stat : 17050 (java) T 17048 17050 17050 0 -1 4202496 123826 0 1 0 5012 19 0 0 18 0 19 0 947923733 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/17050/statm: 2134859 117650 2261 9 0 2125600 0
[pid=17050/tid=17051] ppid=17048 vsize=8539436 CPUtime=47.87 cores=1,3,5,7
/proc/17050/task/17051/stat : 17051 (java) T 17048 17050 17050 0 -1 4202560 35292 0 1 0 4783 4 0 0 25 0 19 0 947923733 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 46912506050093 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17050/tid=17052] ppid=17048 vsize=8539436 CPUtime=0.05 cores=1,3,5,7
/proc/17050/task/17052/stat : 17052 (java) T 17048 17050 17050 0 -1 4202560 5897 0 0 0 5 0 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17050/tid=17053] ppid=17048 vsize=8539436 CPUtime=0.06 cores=1,3,5,7
/proc/17050/task/17053/stat : 17053 (java) T 17048 17050 17050 0 -1 4202560 7684 0 0 0 5 1 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17050/tid=17054] ppid=17048 vsize=8539436 CPUtime=0.07 cores=1,3,5,7
/proc/17050/task/17054/stat : 17054 (java) T 17048 17050 17050 0 -1 4202560 6986 0 0 0 7 0 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17055] ppid=17048 vsize=8539436 CPUtime=0.08 cores=1,3,5,7
/proc/17050/task/17055/stat : 17055 (java) T 17048 17050 17050 0 -1 4202560 10459 0 0 0 6 2 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17050/tid=17056] ppid=17048 vsize=8539436 CPUtime=0.06 cores=1,3,5,7
/proc/17050/task/17056/stat : 17056 (java) T 17048 17050 17050 0 -1 4202560 9339 0 0 0 5 1 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17057] ppid=17048 vsize=8539436 CPUtime=0.11 cores=1,3,5,7
/proc/17050/task/17057/stat : 17057 (java) T 17048 17050 17050 0 -1 4202560 11356 0 0 0 9 2 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17058] ppid=17048 vsize=8539436 CPUtime=0.07 cores=1,3,5,7
/proc/17050/task/17058/stat : 17058 (java) T 17048 17050 17050 0 -1 4202560 9076 0 0 0 6 1 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17059] ppid=17048 vsize=8539436 CPUtime=0.04 cores=1,3,5,7
/proc/17050/task/17059/stat : 17059 (java) T 17048 17050 17050 0 -1 4202560 9614 0 0 0 3 1 0 0 15 0 19 0 947923734 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17050/tid=17060] ppid=17048 vsize=8539436 CPUtime=0.39 cores=1,3,5,7
/proc/17050/task/17060/stat : 17060 (java) T 17048 17050 17050 0 -1 4202560 8248 0 0 0 39 0 0 0 15 0 19 0 947923735 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032212480 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=17050/tid=17061] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17061/stat : 17061 (java) T 17048 17050 17050 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 947923735 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17062] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17062/stat : 17062 (java) T 17048 17050 17050 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 947923735 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17063] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17063/stat : 17063 (java) T 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 947923737 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032219569 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17064] ppid=17048 vsize=8539436 CPUtime=0.63 cores=1,3,5,7
/proc/17050/task/17064/stat : 17064 (java) T 17048 17050 17050 0 -1 4202560 4832 0 0 0 63 0 0 0 15 0 19 0 947923737 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17050/tid=17065] ppid=17048 vsize=8539436 CPUtime=0.75 cores=1,3,5,7
/proc/17050/task/17065/stat : 17065 (java) T 17048 17050 17050 0 -1 4202560 3646 0 0 0 75 0 0 0 15 0 19 0 947923737 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17066] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17066/stat : 17066 (java) T 17048 17050 17050 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 947923737 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032211865 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17050/tid=17067] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17067/stat : 17067 (java) T 17048 17050 17050 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 947923737 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032212480 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17050/tid=17068] ppid=17048 vsize=8539436 CPUtime=0 cores=1,3,5,7
/proc/17050/task/17068/stat : 17068 (java) T 17048 17050 17050 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 947923793 8744382464 117650 33554432000 1073741824 1073778376 140735890537120 18446744073709551615 260032212480 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17048/tid=17074] ppid=17032 vsize=297792 CPUtime=0 cores=1,3,5,7
/proc/17048/task/17074/stat : 17074 (python) S 17032 17032 16077 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 947928582 304939008 6811 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604455561860928 0 0 -1 1 0 0 0
[pid=17075] ppid=17032 vsize=308048 CPUtime=0.13 cores=1,3,5,7
/proc/17075/stat : 17075 (python) S 17032 17032 16077 0 -1 4202560 1125 0 0 0 5 8 0 0 16 0 2 0 947928585 315441152 6815 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/17075/statm: 77012 6815 397 364 0 11893 0
[pid=17077] ppid=17075 vsize=82964 CPUtime=48.37 cores=1,3,5,7
/proc/17077/stat : 17077 (scip-2.0.1.linu) T 17075 17077 17077 0 -1 4202496 118546 0 0 0 4818 19 0 0 25 0 1 0 947928585 84955136 17104 33554432000 4194304 15243407 140733862527664 18446744073709551615 8096954 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/17077/statm: 20741 17104 823 2698 0 18036 0
[pid=17075/tid=17155] ppid=17032 vsize=308048 CPUtime=0 cores=1,3,5,7
/proc/17075/task/17155/stat : 17155 (python) S 17032 17032 16077 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 947933423 315441152 6815 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604456704102656 0 0 -1 3 0 0 0
[pid=17156] ppid=17032 vsize=318304 CPUtime=0.17 cores=1,3,5,7
/proc/17156/stat : 17156 (python) S 17032 17032 16077 0 -1 4202560 1145 0 0 0 9 8 0 0 17 0 2 0 947933426 325943296 6820 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032222667 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17156/statm: 79576 6820 398 364 0 14454 0
[pid=17158] ppid=17156 vsize=106928 CPUtime=47.57 cores=1,3,5,7
/proc/17158/stat : 17158 (wbo1.4a) T 17156 17158 17158 0 -1 4202496 66870 0 0 0 4683 74 0 0 25 0 1 0 947933426 109494272 26151 33554432000 134512640 135751879 4287372128 18446744073709551615 134517428 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/17158/statm: 26732 26151 146 303 0 26427 0
[pid=17156/tid=17165] ppid=17032 vsize=318304 CPUtime=0 cores=1,3,5,7
/proc/17156/task/17165/stat : 17165 (python) S 17032 17032 16077 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 947938185 325943296 6820 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554946 18446604459355641728 0 0 -1 7 0 0 0
[pid=17166] ppid=17032 vsize=328560 CPUtime=0 cores=1,3,5,7
/proc/17166/stat : 17166 (python) S 17032 17032 16077 0 -1 4202560 795 0 0 0 0 0 0 0 15 0 1 0 947938187 336445440 6774 33554432000 4194304 5683644 140733517217024 18446744073709551615 260020416070 0 0 16781312 33554946 1054620736972357896 0 0 17 5 0 0 0
/proc/17166/statm: 82140 6774 349 364 0 17015 0
[pid=17168] ppid=17166 vsize=8603664 CPUtime=1.6 cores=1,3,5,7
/proc/17168/stat : 17168 (java) S 17166 17168 17168 0 -1 4202496 24426 0 1 0 156 4 0 0 20 0 19 0 947938188 8810151936 19836 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17168/statm: 2150916 19836 2229 9 0 2141657 0
[pid=17168/tid=17169] ppid=17166 vsize=8603664 CPUtime=0.72 cores=1,3,5,7
/proc/17168/task/17169/stat : 17169 (java) R 17166 17168 17168 0 -1 4202560 15255 0 1 0 70 2 0 0 19 0 19 0 947938188 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 46912505220473 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17168/tid=17170] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17170/stat : 17170 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17171] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17171/stat : 17171 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17172] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17172/stat : 17172 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17173] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17173/stat : 17173 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 1 0 0 0
[pid=17168/tid=17174] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17174/stat : 17174 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 7 0 0 0
[pid=17168/tid=17175] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17175/stat : 17175 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 1 0 0 0
[pid=17168/tid=17176] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17176/stat : 17176 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 1 0 0 0
[pid=17168/tid=17177] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17177/stat : 17177 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 947938189 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 7 0 0 0
[pid=17168/tid=17178] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17178/stat : 17178 (java) S 17166 17168 17168 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 947938190 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032212480 0 0 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17179] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17179/stat : 17179 (java) S 17166 17168 17168 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 947938190 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17180] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17180/stat : 17180 (java) S 17166 17168 17168 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 19 0 947938190 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 7 0 0 0
[pid=17168/tid=17181] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17181/stat : 17181 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 947938192 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032219569 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17182] ppid=17166 vsize=8603664 CPUtime=0.46 cores=1,3,5,7
/proc/17168/task/17182/stat : 17182 (java) S 17166 17168 17168 0 -1 4202560 4072 0 0 0 45 1 0 0 16 0 19 0 947938192 8810151936 19837 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 1 0 0 0
[pid=17168/tid=17183] ppid=17166 vsize=8603664 CPUtime=0.4 cores=1,3,5,7
/proc/17168/task/17183/stat : 17183 (java) S 17166 17168 17168 0 -1 4202560 3706 0 0 0 40 0 0 0 16 0 19 0 947938192 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17184] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17184/stat : 17184 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 947938192 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032211865 0 4 0 16800975 18446604459355639936 0 0 -1 5 0 0 0
[pid=17168/tid=17185] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17185/stat : 17185 (java) S 17166 17168 17168 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 19 0 947938193 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032212480 0 4 0 16800975 18446604459355639936 0 0 -1 3 0 0 0
[pid=17168/tid=17186] ppid=17166 vsize=8603664 CPUtime=0 cores=1,3,5,7
/proc/17168/task/17186/stat : 17186 (java) S 17166 17168 17168 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 947938249 8810151936 19838 33554432000 1073741824 1073778376 140734820243024 18446744073709551615 260032212480 0 4 0 16800975 18446604459355639936 0 0 -1 3 0 0 0
[pid=17032/tid=17040] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17040/stat : 17040 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 6 0 947918892 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
[pid=17032/tid=17049] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17049/stat : 17049 (python) S 17030 17032 16077 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 6 0 947923733 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 1 0 0 0
[pid=17032/tid=17076] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17076/stat : 17076 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 6 0 947928585 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 3 0 0 0
[pid=17032/tid=17157] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17157/stat : 17157 (python) S 17030 17032 16077 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 6 0 947933426 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 7 0 0 0
[pid=17032/tid=17167] ppid=17030 vsize=338804 CPUtime=0 cores=1,3,5,7
/proc/17032/task/17167/stat : 17167 (python) S 17030 17032 16077 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 6 0 947938188 346935296 8308 33554432000 4194304 5683644 140733517217024 18446744073709551615 260032219569 0 0 16781312 33554434 18446604464518391872 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 197.56
Current children cumulated vsize (KiB) 19317932

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17032 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=700893
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=93985
# CPU time returned by wait4() is 0.794878
# while last known CPU time is 197.56
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 194.606
CPU time (s): 197.56
CPU user time (s): 195.83
CPU system time (s): 1.73
CPU usage (%): 101.518
Max. virtual memory (cumulated for all children) (KiB): 19317932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.700893
system time used= 0.093985
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15677
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1007
involuntary context switches= 23

runsolver used 0.804877 second user time and 1.78773 second system time

The end

Launcher Data 

Begin job on node110 at 2011-06-09 01:48:02
IDJOB=3481802
IDBENCH=2218
IDSOLVER=1970
FILE ID=node110/3481802-1307576882
RUNJOBID= node110-1307576440-16096
PBS_JOBID= 13547695
Free space on /tmp= 73876 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/sorensson/garden/normalized-g100x100.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481802-1307576882/watcher-3481802-1307576882 -o /tmp/evaluation-result-3481802-1307576882/solver-3481802-1307576882 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481802-1307576882.opb -seed 271738601 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b7796d84094d982e45331121511974b4
RANDOM SEED=271738601

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26801256 kB
Buffers:        176220 kB
Cached:         597576 kB
SwapCached:       8464 kB
Active:        5703828 kB
Inactive:       188368 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26801256 kB
SwapTotal:    67111528 kB
SwapFree:     67056304 kB
Dirty:          103400 kB
Writeback:           0 kB
AnonPages:     5117068 kB
Mapped:          62180 kB
Slab:           157684 kB
PageTables:      33184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 79407544 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73732 MiB
End job on node110 at 2011-06-09 01:51:19