Trace number 3481559

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 704.46 697.498

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_500_60_3.opb
MD5SUMa83973bc04af54d38c05a30d36c8573f
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-44
Best CPU time to get the best result obtained on this benchmark1797.3
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -41
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)74920
Sum of products size (including duplicates)149840
Number of different products37460
Sum of products size74920

Solver Data 

0.32/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.32/0.69	c INFO: solving HOME/instance-3481559-1307578176.opb
1.15/1.25	c INFO: wrote linearized instance to HOME/tmpHNmHJn.opb
1.74/1.80	c INFO: parsing took 0.54 s
2.74/2.85	c INFO: features took 1.05 CPU seconds
2.74/2.87	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.08)
50.95/50.81	c INFO: running wbo1.4a@0 for 45 with 1750 remaining (b = 0.02)
99.88/99.55	c INFO: running scip-2.0.1-clp@0 for 45 with 1702 remaining (b = 0.01)
149.01/148.47	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1653 remaining (b = 0.01)
196.89/193.76	c INFO: running scip-2.0.1-spx@47 for 45 with 1606 remaining (b = 0.01)
243.47/240.02	c INFO: running scip-2.0.1-spx@93 for 228 with 1560 remaining (b = 0.03)
472.41/467.81	c INFO: running scip-2.0.1-clp@48 for 45 with 1333 remaining (b = 0.01)
517.85/513.09	c INFO: running clasp-1.3.7@0 for 91 with 1288 remaining (b = 0.02)
611.22/605.93	c INFO: running scip-2.0.1-clp@93 for 91 with 1195 remaining (b = 0.01)
702.09/696.41	c INFO: running sat4j-pb-v20101225@0 for 91 with 1105 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481559-1307578176/watcher-3481559-1307578176 -o /tmp/evaluation-result-3481559-1307578176/solver-3481559-1307578176 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481559-1307578176.opb -seed 1582326413 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.23 2.12 1.80 3/787 25175
/proc/meminfo: memFree=14352556/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=16236 CPUtime=0 cores=1,3,5,7
/proc/25175/stat : 25175 (python) R 25173 25175 23102 0 -1 4202496 1045 0 0 0 0 0 0 0 17 0 1 0 869414751 16625664 916 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476388820 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25175/statm: 4059 916 381 364 0 546 0

[startup+0.116134 s]
/proc/loadavg: 2.23 2.12 1.80 3/787 25175
/proc/meminfo: memFree=14352556/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=96128 CPUtime=0.06 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 3033 465 1 0 4 2 0 0 18 0 1 0 869414751 98435072 2483 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476694784 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/25175/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96128

[startup+0.200393 s]
/proc/loadavg: 2.23 2.12 1.80 3/787 25175
/proc/meminfo: memFree=14352556/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=117900 CPUtime=0.13 cores=1,3,5,7
/proc/25175/stat : 25175 (python) R 25173 25175 23102 0 -1 4202496 4915 930 1 0 9 4 0 0 17 0 1 0 869414751 120729600 3342 33554432000 4194304 5683644 140736164065232 18446744073709551615 5214075 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25175/statm: 29475 3343 916 364 0 2445 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 117900

[startup+0.300362 s]
/proc/loadavg: 2.23 2.12 1.80 3/787 25175
/proc/meminfo: memFree=14352556/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=123740 CPUtime=0.16 cores=1,3,5,7
/proc/25175/stat : 25175 (python) R 25173 25175 23102 0 -1 4202496 5357 930 1 0 10 6 0 0 16 0 1 0 869414751 126709760 3744 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476690949 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25175/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 123740

[startup+0.700275 s]
/proc/loadavg: 2.23 2.12 1.80 3/787 25175
/proc/meminfo: memFree=14352556/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=282408 CPUtime=0.4 cores=1,3,5,7
/proc/25175/stat : 25175 (python) R 25173 25175 23102 0 -1 4202496 9073 930 1 0 27 13 0 0 15 0 1 0 869414751 289185792 6936 33554432000 4194304 5683644 140736164065232 18446744073709551615 5188376 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25175/statm: 70602 6936 1775 364 0 5495 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 282408

[startup+1.50113 s]
/proc/loadavg: 2.23 2.12 1.80 3/789 25181
/proc/meminfo: memFree=14320380/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=297260 CPUtime=1.45 cores=1,3,5,7
/proc/25175/stat : 25175 (python) R 25173 25175 23102 0 -1 4202496 14753 1590 1 0 57 37 40 11 16 0 1 0 869414751 304394240 10557 33554432000 4194304 5683644 140736164065232 18446744073709551615 4603456 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25175/statm: 74315 10557 1782 364 0 9208 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 297260

[startup+3.10076 s]
/proc/loadavg: 2.23 2.12 1.80 3/788 25181
/proc/meminfo: memFree=14301788/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=315472 CPUtime=2.82 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 22259 1590 1 0 193 38 40 11 19 0 2 0 869414751 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/25175/statm: 78868 12708 1871 364 0 13755 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 315472

[startup+6.30121 s]
/proc/loadavg: 2.37 2.15 1.81 3/791 25184
/proc/meminfo: memFree=13995096/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=315472 CPUtime=2.82 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 22259 1590 1 0 193 38 40 11 19 0 2 0 869414751 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/25175/statm: 78868 12708 1871 364 0 13755 0
[pid=25182] ppid=25175 vsize=305228 CPUtime=0 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 713 0 0 0 0 0 0 0 15 0 1 0 869415039 312553472 11151 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476715023 0 0 16781312 33554946 11471672349841916164 0 0 17 5 0 0 0
/proc/25182/statm: 76307 11151 318 364 0 11194 0
[pid=25184] ppid=25182 vsize=346468 CPUtime=3.39 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) R 25182 25184 25184 0 -1 4202496 84911 0 0 0 305 34 0 0 25 0 1 0 869415039 354783232 80350 33554432000 4194304 13684479 140734951040576 18446744073709551615 7416137 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25184/statm: 86617 80350 869 2317 0 84295 0
[pid=25175/tid=25183] ppid=25173 vsize=315472 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 26 1590 0 0 0 0 40 11 19 0 2 0 869415039 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 967168

[startup+12.701 s]
/proc/loadavg: 2.34 2.15 1.81 3/791 25185
/proc/meminfo: memFree=13956300/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=315472 CPUtime=2.82 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 22259 1590 1 0 193 38 40 11 19 0 2 0 869414751 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/25175/statm: 78868 12708 1871 364 0 13755 0
[pid=25182] ppid=25175 vsize=305228 CPUtime=0.04 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 870 0 0 0 2 2 0 0 15 0 1 0 869415039 312553472 11175 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476715023 0 0 16781312 33554946 5623753486446373613 0 0 17 7 0 0 0
/proc/25182/statm: 76307 11175 342 364 0 11194 0
[pid=25184] ppid=25182 vsize=363176 CPUtime=9.78 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) R 25182 25184 25184 0 -1 4202496 91060 0 0 0 942 36 0 0 25 0 1 0 869415039 371892224 86016 33554432000 4194304 13684479 140734951040576 18446744073709551615 7343071 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25184/statm: 90794 86016 817 2317 0 88472 0
[pid=25175/tid=25183] ppid=25173 vsize=315472 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 26 1590 0 0 0 0 40 11 19 0 2 0 869415039 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 983876

[startup+25.5005 s]
/proc/loadavg: 2.35 2.16 1.82 3/791 25185
/proc/meminfo: memFree=13960260/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=315472 CPUtime=2.82 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 22259 1590 1 0 193 38 40 11 19 0 2 0 869414751 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/25175/statm: 78868 12708 1871 364 0 13755 0
[pid=25182] ppid=25175 vsize=305228 CPUtime=0.09 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 876 0 0 0 5 4 0 0 15 0 1 0 869415039 312553472 11175 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476715023 0 0 16781312 33554946 5623753486446373613 0 0 17 7 0 0 0
/proc/25182/statm: 76307 11175 342 364 0 11194 0
[pid=25184] ppid=25182 vsize=363176 CPUtime=22.58 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) R 25182 25184 25184 0 -1 4202496 91110 0 0 0 2220 38 0 0 25 0 1 0 869415039 371892224 86057 33554432000 4194304 13684479 140734951040576 18446744073709551615 7390870 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25184/statm: 90794 86057 834 2317 0 88472 0
[pid=25175/tid=25183] ppid=25173 vsize=315472 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 26 1590 0 0 0 0 40 11 19 0 2 0 869415039 323043328 12708 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 983876

[startup+51.1006 s]
/proc/loadavg: 2.30 2.16 1.83 3/791 25186
/proc/meminfo: memFree=13951236/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=325728 CPUtime=2.85 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 23153 1590 1 0 196 38 40 11 20 0 3 0 869414751 333545472 12715 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/25175/statm: 81432 12715 1874 364 0 16316 0
[pid=25182] ppid=25175 vsize=315472 CPUtime=0.24 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 1096 0 0 0 12 12 0 0 16 0 2 0 869415039 323043328 11243 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25182/statm: 78868 11243 405 364 0 13755 0
[pid=25184] ppid=25182 vsize=370244 CPUtime=47.88 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) T 25182 25184 25184 0 -1 4202496 92420 0 0 0 4747 41 0 0 25 0 1 0 869415039 379129856 87341 33554432000 4194304 13684479 140734951040576 18446744073709551615 7159343 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/25184/statm: 92561 87341 812 2317 0 90239 0
[pid=25175/tid=25183] ppid=25173 vsize=325728 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 26 1590 0 0 0 0 40 11 19 0 3 0 869415039 333545472 12715 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 1011444

[startup+102.301 s]
/proc/loadavg: 2.21 2.16 1.84 3/799 25195
/proc/meminfo: memFree=13517408/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=335984 CPUtime=2.87 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 24093 1590 1 0 198 38 40 11 19 0 4 0 869414751 344047616 12721 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25175/statm: 83996 12721 1876 364 0 18877 0
[pid=25182] ppid=25175 vsize=315472 CPUtime=0.24 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 1096 0 0 0 12 12 0 0 16 0 2 0 869415039 323043328 11243 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25182/statm: 78868 11243 405 364 0 13755 0
[pid=25184] ppid=25182 vsize=370244 CPUtime=47.88 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) T 25182 25184 25184 0 -1 4202496 92420 0 0 0 4747 41 0 0 25 0 1 0 869415039 379129856 87341 33554432000 4194304 13684479 140734951040576 18446744073709551615 7159343 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/25184/statm: 92561 87341 812 2317 0 90239 0
[pid=25182/tid=25187] ppid=25175 vsize=315472 CPUtime=0 cores=1,3,5,7
/proc/25182/task/25187/stat : 25187 (python) S 25175 25175 23102 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869419831 323043328 11243 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604455733014656 0 0 -1 7 0 0 0
[pid=25188] ppid=25175 vsize=315484 CPUtime=0.27 cores=1,3,5,7
/proc/25188/stat : 25188 (python) S 25175 25175 23102 0 -1 4202560 1196 0 0 0 12 15 0 0 17 0 2 0 869419833 323055616 11234 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25188/statm: 78871 11234 396 364 0 13755 0
[pid=25190] ppid=25188 vsize=85252 CPUtime=48.7 cores=1,3,5,7
/proc/25190/stat : 25190 (wbo1.4a) T 25188 25190 25190 0 -1 4202496 23895 0 0 0 4831 39 0 0 25 0 1 0 869419833 87298048 20717 33554432000 134512640 135751879 4291172288 18446744073709551615 134518928 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/25190/statm: 21313 20717 146 303 0 21008 0
[pid=25188/tid=25192] ppid=25175 vsize=315484 CPUtime=0 cores=1,3,5,7
/proc/25188/task/25192/stat : 25192 (python) S 25175 25175 23102 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 869424704 323055616 11234 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604459825587328 0 0 -1 7 0 0 0
[pid=25193] ppid=25175 vsize=325740 CPUtime=0 cores=1,3,5,7
/proc/25193/stat : 25193 (python) S 25175 25175 23102 0 -1 4202560 880 0 0 0 0 0 0 0 15 0 1 0 869424707 333557760 11167 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476715078 0 0 16781312 33554946 16080538120944058628 0 0 17 5 0 0 0
/proc/25193/statm: 81435 11167 326 364 0 16316 0
[pid=25195] ppid=25193 vsize=319060 CPUtime=2.75 cores=1,3,5,7
/proc/25195/stat : 25195 (scip-2.0.1.linu) R 25193 25195 25195 0 -1 4202496 73400 0 0 0 245 30 0 0 25 0 1 0 869424707 326717440 71534 33554432000 4194304 15243407 140733608204432 18446744073709551615 13354455 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25195/statm: 79765 71534 892 2698 0 77060 0
[pid=25175/tid=25183] ppid=25173 vsize=335984 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 26 1590 0 0 0 0 40 11 19 0 4 0 869415039 344047616 12721 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25189] ppid=25173 vsize=335984 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25189/stat : 25189 (python) S 25173 25175 23102 0 -1 4202560 27 1590 0 0 0 0 40 11 20 0 4 0 869419833 344047616 12721 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25194] ppid=25173 vsize=335984 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25194/stat : 25194 (python) S 25173 25175 23102 0 -1 4202560 28 1590 0 0 0 0 40 11 20 0 4 0 869424707 344047616 12721 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.71
Current children cumulated vsize (KiB) 2067236

[startup+162.301 s]
/proc/loadavg: 2.23 2.18 1.87 3/821 25219
/proc/meminfo: memFree=12323396/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=346240 CPUtime=2.89 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 25046 1590 1 0 200 38 40 11 20 0 5 0 869414751 354549760 12727 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25175/statm: 86560 12727 1878 364 0 21438 0
[pid=25182] ppid=25175 vsize=315472 CPUtime=0.24 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 1096 0 0 0 12 12 0 0 16 0 2 0 869415039 323043328 11243 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25182/statm: 78868 11243 405 364 0 13755 0
[pid=25184] ppid=25182 vsize=370244 CPUtime=47.88 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) T 25182 25184 25184 0 -1 4202496 92420 0 0 0 4747 41 0 0 25 0 1 0 869415039 379129856 87341 33554432000 4194304 13684479 140734951040576 18446744073709551615 7159343 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/25184/statm: 92561 87341 812 2317 0 90239 0
[pid=25182/tid=25187] ppid=25175 vsize=315472 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

[pid=25175/tid=25189] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25189/stat : 25189 (python) S 25173 25175 23102 0 -1 4202560 27 1590 0 0 0 0 40 11 20 0 7 0 869419833 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25194] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25194/stat : 25194 (python) S 25173 25175 23102 0 -1 4202560 37 1590 0 0 0 0 40 11 18 0 7 0 869424707 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
[pid=25175/tid=25199] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25199/stat : 25199 (python) S 25173 25175 23102 0 -1 4202560 30 1590 0 0 0 0 40 11 20 0 7 0 869429599 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25231] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25231/stat : 25231 (python) S 25173 25175 23102 0 -1 4202560 29 1590 0 0 0 0 40 11 20 0 7 0 869466061 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
[pid=25175/tid=25240] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25240/stat : 25240 (python) S 25173 25175 23102 0 -1 4202560 28 1590 0 0 0 0 40 11 20 0 7 0 869484393 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 704.46
Current children cumulated vsize (KiB) 20506680

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+697.401 s]
/proc/loadavg: 2.10 2.11 1.94 6/847 25259
/proc/meminfo: memFree=10344844/32950928 swapFree=67056572/67111528
[pid=25175] ppid=25173 vsize=366752 CPUtime=3.03 cores=1,3,5,7
/proc/25175/stat : 25175 (python) S 25173 25175 23102 0 -1 4202496 27069 1590 1 0 213 39 40 11 19 0 7 0 869414751 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25175/statm: 91688 12739 1882 364 0 26560 0
[pid=25182] ppid=25175 vsize=315472 CPUtime=1.63 cores=1,3,5,7
/proc/25182/stat : 25182 (python) S 25175 25175 23102 0 -1 4202560 1177 0 0 0 75 88 0 0 15 0 2 0 869415039 323043328 11244 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25182/statm: 78868 11244 406 364 0 13755 0
[pid=25184] ppid=25182 vsize=549684 CPUtime=321.9 cores=1,3,5,7
/proc/25184/stat : 25184 (scip-2.0.1.linu) T 25182 25184 25184 0 -1 4202496 141585 0 0 0 32089 101 0 0 25 0 1 0 869415039 562876416 134428 33554432000 4194304 13684479 140734951040576 18446744073709551615 7361336 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/25184/statm: 137421 134428 1712 2317 0 135099 0
[pid=25182/tid=25187] ppid=25175 vsize=315472 CPUtime=0 cores=1,3,5,7
/proc/25182/task/25187/stat : 25187 (python) S 25175 25175 23102 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 869419831 323043328 11244 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604455733014656 0 0 -1 3 0 0 0
[pid=25188] ppid=25175 vsize=315484 CPUtime=0.27 cores=1,3,5,7
/proc/25188/stat : 25188 (python) S 25175 25175 23102 0 -1 4202560 1196 0 0 0 12 15 0 0 17 0 2 0 869419833 323055616 11234 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25188/statm: 78871 11234 396 364 0 13755 0
[pid=25190] ppid=25188 vsize=85252 CPUtime=48.7 cores=1,3,5,7
/proc/25190/stat : 25190 (wbo1.4a) T 25188 25190 25190 0 -1 4202496 23895 0 0 0 4831 39 0 0 25 0 1 0 869419833 87298048 20717 33554432000 134512640 135751879 4291172288 18446744073709551615 134518928 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/25190/statm: 21313 20717 146 303 0 21008 0
[pid=25188/tid=25192] ppid=25175 vsize=315484 CPUtime=0 cores=1,3,5,7
/proc/25188/task/25192/stat : 25192 (python) S 25175 25175 23102 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 869424704 323055616 11234 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604459825587328 0 0 -1 7 0 0 0
[pid=25193] ppid=25175 vsize=325740 CPUtime=0.97 cores=1,3,5,7
/proc/25193/stat : 25193 (python) S 25175 25175 23102 0 -1 4202560 1257 0 0 0 42 55 0 0 15 0 2 0 869424707 333557760 11238 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25193/statm: 81435 11238 396 364 0 16316 0
[pid=25195] ppid=25193 vsize=355376 CPUtime=184.61 cores=1,3,5,7
/proc/25195/stat : 25195 (scip-2.0.1.linu) T 25193 25195 25195 0 -1 4202496 370804 0 0 0 18376 85 0 0 25 0 1 0 869424707 363905024 73654 33554432000 4194304 15243407 140733608204432 18446744073709551615 8115337 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/25195/statm: 88844 73654 908 2698 0 86139 0
[pid=25193/tid=25197] ppid=25175 vsize=325740 CPUtime=0 cores=1,3,5,7
/proc/25193/task/25197/stat : 25197 (python) S 25175 25175 23102 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869429596 333557760 11238 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604456629080192 0 0 -1 7 0 0 0
[pid=25198] ppid=25175 vsize=335996 CPUtime=0.25 cores=1,3,5,7
/proc/25198/stat : 25198 (python) S 25175 25175 23102 0 -1 4202560 1181 0 0 0 12 13 0 0 16 0 2 0 869429599 344059904 11236 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25198/statm: 83999 11236 390 364 0 18877 0
[pid=25200] ppid=25198 vsize=8548912 CPUtime=47.58 cores=1,3,5,7
/proc/25200/stat : 25200 (java) T 25198 25200 25200 0 -1 4202496 548202 0 1 0 4700 58 0 0 18 0 19 0 869429599 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25200/statm: 2137228 543339 2249 9 0 2127969 0
[pid=25200/tid=25201] ppid=25198 vsize=8548912 CPUtime=44.95 cores=1,3,5,7
/proc/25200/task/25201/stat : 25201 (java) T 25198 25200 25200 0 -1 4202560 484078 0 1 0 4445 50 0 0 25 0 19 0 869429600 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 46912505980129 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25200/tid=25202] ppid=25198 vsize=8548912 CPUtime=0.13 cores=1,3,5,7
/proc/25200/task/25202/stat : 25202 (java) T 25198 25200 25200 0 -1 4202560 10145 0 0 0 12 1 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25200/tid=25203] ppid=25198 vsize=8548912 CPUtime=0.12 cores=1,3,5,7
/proc/25200/task/25203/stat : 25203 (java) T 25198 25200 25200 0 -1 4202560 8912 0 0 0 12 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=25200/tid=25204] ppid=25198 vsize=8548912 CPUtime=0.05 cores=1,3,5,7
/proc/25200/task/25204/stat : 25204 (java) T 25198 25200 25200 0 -1 4202560 4049 0 0 0 5 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=25200/tid=25205] ppid=25198 vsize=8548912 CPUtime=0.07 cores=1,3,5,7
/proc/25200/task/25205/stat : 25205 (java) T 25198 25200 25200 0 -1 4202560 6008 0 0 0 7 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25200/tid=25206] ppid=25198 vsize=8548912 CPUtime=0.06 cores=1,3,5,7
/proc/25200/task/25206/stat : 25206 (java) T 25198 25200 25200 0 -1 4202560 4669 0 0 0 6 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25200/tid=25207] ppid=25198 vsize=8548912 CPUtime=0.07 cores=1,3,5,7
/proc/25200/task/25207/stat : 25207 (java) T 25198 25200 25200 0 -1 4202560 6011 0 0 0 7 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=25200/tid=25208] ppid=25198 vsize=8548912 CPUtime=0.04 cores=1,3,5,7
/proc/25200/task/25208/stat : 25208 (java) T 25198 25200 25200 0 -1 4202560 3746 0 0 0 4 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25209] ppid=25198 vsize=8548912 CPUtime=0.08 cores=1,3,5,7
/proc/25200/task/25209/stat : 25209 (java) T 25198 25200 25200 0 -1 4202560 6936 0 0 0 8 0 0 0 15 0 19 0 869429601 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=25200/tid=25210] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25210/stat : 25210 (java) T 25198 25200 25200 0 -1 4202560 1268 0 0 0 0 0 0 0 15 0 19 0 869429602 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488511488 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25211] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25211/stat : 25211 (java) T 25198 25200 25200 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869429602 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25212] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25212/stat : 25212 (java) T 25198 25200 25200 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869429602 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25213] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25213/stat : 25213 (java) T 25198 25200 25200 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869429604 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488518577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25214] ppid=25198 vsize=8548912 CPUtime=0.82 cores=1,3,5,7
/proc/25200/task/25214/stat : 25214 (java) T 25198 25200 25200 0 -1 4202560 4136 0 0 0 82 0 0 0 15 0 19 0 869429604 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25200/tid=25215] ppid=25198 vsize=8548912 CPUtime=1.04 cores=1,3,5,7
/proc/25200/task/25215/stat : 25215 (java) T 25198 25200 25200 0 -1 4202560 6845 0 0 0 104 0 0 0 15 0 19 0 869429604 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25216] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25216/stat : 25216 (java) T 25198 25200 25200 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869429604 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25200/tid=25217] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25217/stat : 25217 (java) T 25198 25200 25200 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869429604 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488511488 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25200/tid=25218] ppid=25198 vsize=8548912 CPUtime=0 cores=1,3,5,7
/proc/25200/task/25218/stat : 25218 (java) T 25198 25200 25200 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869429682 8754085888 543339 33554432000 1073741824 1073778376 140734020229584 18446744073709551615 239488511488 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25198/tid=25220] ppid=25175 vsize=335996 CPUtime=0 cores=1,3,5,7
/proc/25198/task/25220/stat : 25220 (python) S 25175 25175 23102 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869434125 344059904 11236 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604461448823104 0 0 -1 7 0 0 0
[pid=25230] ppid=25175 vsize=346252 CPUtime=0.46 cores=1,3,5,7
/proc/25230/stat : 25230 (python) S 25175 25175 23102 0 -1 4202560 1206 0 0 0 19 27 0 0 16 0 2 0 869466061 354562048 11240 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/25230/statm: 86563 11240 390 364 0 21438 0
[pid=25232] ppid=25230 vsize=59300 CPUtime=92.81 cores=1,3,5,7
/proc/25232/stat : 25232 (clasp-1.3.7-x86) T 25230 25232 25232 0 -1 4202496 15600 0 0 0 9280 1 0 0 25 0 1 0 869466061 60723200 14581 33554432000 134512640 136139019 4290796192 18446744073709551615 134626571 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/25232/statm: 14825 14581 189 398 0 14425 0
[pid=25230/tid=25235] ppid=25175 vsize=346252 CPUtime=0 cores=1,3,5,7
/proc/25230/task/25235/stat : 25235 (python) S 25175 25175 23102 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869475343 354562048 11240 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554946 18446604455187899584 0 0 -1 1 0 0 0
[pid=25239] ppid=25175 vsize=356508 CPUtime=0 cores=1,3,5,7
/proc/25239/stat : 25239 (python) S 25175 25175 23102 0 -1 4202560 806 0 0 0 0 0 0 0 15 0 1 0 869484393 365064192 11172 33554432000 4194304 5683644 140736164065232 18446744073709551615 239476715078 0 0 16781312 33554946 2935790659996483584 0 0 17 7 0 0 0
/proc/25239/statm: 89127 11172 319 364 0 23999 0
[pid=25241] ppid=25239 vsize=8545952 CPUtime=2.25 cores=1,3,5,7
/proc/25241/stat : 25241 (java) S 25239 25241 25241 0 -1 4202496 59449 0 1 0 216 9 0 0 17 0 19 0 869484393 8751054848 55944 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25241/statm: 2136488 55944 2244 9 0 2127229 0
[pid=25241/tid=25242] ppid=25239 vsize=8545952 CPUtime=0.92 cores=1,3,5,7
/proc/25241/task/25242/stat : 25242 (java) R 25239 25241 25241 0 -1 4202560 35254 0 1 0 88 4 0 0 19 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 46912505964170 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25241/tid=25243] ppid=25239 vsize=8545952 CPUtime=0.05 cores=1,3,5,7
/proc/25241/task/25243/stat : 25243 (java) S 25239 25241 25241 0 -1 4202560 4030 0 0 0 5 0 0 0 16 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25244] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25244/stat : 25244 (java) S 25239 25241 25241 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25245] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25245/stat : 25245 (java) S 25239 25241 25241 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 7 0 0 0
[pid=25241/tid=25246] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25246/stat : 25246 (java) S 25239 25241 25241 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25247] ppid=25239 vsize=8545952 CPUtime=0.01 cores=1,3,5,7
/proc/25241/task/25247/stat : 25247 (java) S 25239 25241 25241 0 -1 4202560 1297 0 0 0 1 0 0 0 15 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 3 0 0 0
[pid=25241/tid=25248] ppid=25239 vsize=8545952 CPUtime=0.05 cores=1,3,5,7
/proc/25241/task/25248/stat : 25248 (java) S 25239 25241 25241 0 -1 4202560 4113 0 0 0 5 0 0 0 16 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 7 0 0 0
[pid=25241/tid=25249] ppid=25239 vsize=8545952 CPUtime=0.02 cores=1,3,5,7
/proc/25241/task/25249/stat : 25249 (java) S 25239 25241 25241 0 -1 4202560 1497 0 0 0 2 0 0 0 15 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 1 0 0 0
[pid=25241/tid=25250] ppid=25239 vsize=8545952 CPUtime=0.03 cores=1,3,5,7
/proc/25241/task/25250/stat : 25250 (java) S 25239 25241 25241 0 -1 4202560 2660 0 0 0 3 0 0 0 16 0 19 0 869484395 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 1 0 0 0
[pid=25241/tid=25251] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25251/stat : 25251 (java) S 25239 25241 25241 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 19 0 869484396 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488511488 0 0 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25252] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25252/stat : 25252 (java) S 25239 25241 25241 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 19 0 869484397 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 1 0 0 0
[pid=25241/tid=25253] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25253/stat : 25253 (java) S 25239 25241 25241 0 -1 4202560 10 0 0 0 0 0 0 0 16 0 19 0 869484397 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25254] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25254/stat : 25254 (java) S 25239 25241 25241 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869484399 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488518577 0 4 0 16800975 18446604463932796992 0 0 -1 1 0 0 0
[pid=25241/tid=25255] ppid=25239 vsize=8545952 CPUtime=0.53 cores=1,3,5,7
/proc/25241/task/25255/stat : 25255 (java) S 25239 25241 25241 0 -1 4202560 4076 0 0 0 53 0 0 0 16 0 19 0 869484399 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 3 0 0 0
[pid=25241/tid=25256] ppid=25239 vsize=8545952 CPUtime=0.55 cores=1,3,5,7
/proc/25241/task/25256/stat : 25256 (java) S 25239 25241 25241 0 -1 4202560 5050 0 0 0 55 0 0 0 15 0 19 0 869484399 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 1 0 0 0
[pid=25241/tid=25257] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25257/stat : 25257 (java) S 25239 25241 25241 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 19 0 869484399 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488510873 0 4 0 16800975 18446604463932796992 0 0 -1 5 0 0 0
[pid=25241/tid=25258] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25258/stat : 25258 (java) S 25239 25241 25241 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869484399 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488511488 0 4 0 16800975 18446604463932796992 0 0 -1 3 0 0 0
[pid=25241/tid=25259] ppid=25239 vsize=8545952 CPUtime=0 cores=1,3,5,7
/proc/25241/task/25259/stat : 25259 (java) S 25239 25241 25241 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869484484 8751054848 55945 33554432000 1073741824 1073778376 140735698695808 18446744073709551615 239488511488 0 4 0 16800975 18446604463932796992 0 0 -1 7 0 0 0
[pid=25175/tid=25183] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25183/stat : 25183 (python) S 25173 25175 23102 0 -1 4202560 31 1590 0 0 0 0 40 11 18 0 7 0 869415039 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25189] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25189/stat : 25189 (python) S 25173 25175 23102 0 -1 4202560 27 1590 0 0 0 0 40 11 20 0 7 0 869419833 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25194] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25194/stat : 25194 (python) S 25173 25175 23102 0 -1 4202560 37 1590 0 0 0 0 40 11 18 0 7 0 869424707 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
[pid=25175/tid=25199] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25199/stat : 25199 (python) S 25173 25175 23102 0 -1 4202560 30 1590 0 0 0 0 40 11 20 0 7 0 869429599 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 7 0 0 0
[pid=25175/tid=25231] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25231/stat : 25231 (python) S 25173 25175 23102 0 -1 4202560 29 1590 0 0 0 0 40 11 20 0 7 0 869466061 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
[pid=25175/tid=25240] ppid=25173 vsize=366752 CPUtime=0.51 cores=1,3,5,7
/proc/25175/task/25240/stat : 25240 (python) S 25173 25175 23102 0 -1 4202560 28 1590 0 0 0 0 40 11 20 0 7 0 869484393 375554048 12739 33554432000 4194304 5683644 140736164065232 18446744073709551615 239488518577 0 0 16781312 33554434 18446604458686048960 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 704.46
Current children cumulated vsize (KiB) 20506680

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25175 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=537614
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=517921
# CPU time returned by wait4() is 3.05553
# while last known CPU time is 704.46
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 697.498
CPU time (s): 704.46
CPU user time (s): 699.05
CPU system time (s): 5.41
CPU usage (%): 100.998
Max. virtual memory (cumulated for all children) (KiB): 20506680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.53761
system time used= 0.517921
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28662
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29943
involuntary context switches= 30

runsolver used 5.73413 second user time and 13.9969 second system time

The end

Launcher Data 

Begin job on node148 at 2011-06-09 02:09:36
IDJOB=3481559
IDBENCH=48226
IDSOLVER=1970
FILE ID=node148/3481559-1307578176
RUNJOBID= node148-1307576353-23121
PBS_JOBID= 13547651
Free space on /tmp= 73564 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_500_60_3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481559-1307578176/watcher-3481559-1307578176 -o /tmp/evaluation-result-3481559-1307578176/solver-3481559-1307578176 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481559-1307578176.opb -seed 1582326413 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a83973bc04af54d38c05a30d36c8573f
RANDOM SEED=1582326413

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14349000 kB
Buffers:        189676 kB
Cached:         840420 kB
SwapCached:       8984 kB
Active:       18068624 kB
Inactive:       236160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14349000 kB
SwapTotal:    67111528 kB
SwapFree:     67056572 kB
Dirty:          102692 kB
Writeback:          20 kB
AnonPages:    17271900 kB
Mapped:         115092 kB
Slab:           138164 kB
PageTables:      84868 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 185104644 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73460 MiB
End job on node148 at 2011-06-09 02:21:16