Trace number 3481538

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 151.91 148.684

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_200_25_5.opb
MD5SUMcdccc05ac387e7ee9cb8ab81f53ca6f8
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-31
Best CPU time to get the best result obtained on this benchmark1797.67
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -31
Optimality of the best value was proved NO
Number of variables200
Total number of constraints200
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints200
Minimum length of a constraint25
Maximum length of a constraint49
Number of terms in the objective function 200
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 200
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)6226
Sum of products size (including duplicates)12452
Number of different products3113
Sum of products size6226

Solver Data 

0.43/0.71	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.43/0.71	c INFO: solving HOME/instance-3481538-1307578080.opb
0.43/0.75	c INFO: wrote linearized instance to HOME/tmpI_eksp.opb
0.54/0.80	c INFO: parsing took 0.04 s
0.54/0.88	c INFO: features took 0.08 CPU seconds
0.64/0.91	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.35)
52.98/53.00	c INFO: running scip-2.0.1-clp@0 for 45 with 1753 remaining (b = 0.08)
101.37/101.06	c INFO: running sat4j-pb-v20101225@0 for 45 with 1707 remaining (b = 0.03)
150.25/147.98	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1659 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481538-1307578080/watcher-3481538-1307578080 -o /tmp/evaluation-result-3481538-1307578080/solver-3481538-1307578080 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481538-1307578080.opb -seed 1844147195 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.05 1.71 2/793 23280
/proc/meminfo: memFree=18297484/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=16236 CPUtime=0 cores=1,3,5,7
/proc/23280/stat : 23280 (python) R 23278 23280 21667 0 -1 4202496 1037 0 0 0 0 0 0 0 17 0 1 0 948038750 16625664 908 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415052485 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23280/statm: 4059 908 380 364 0 546 0

[startup+0.0501739 s]
/proc/loadavg: 2.00 2.05 1.71 2/793 23280
/proc/meminfo: memFree=18297484/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=18884 CPUtime=0.02 cores=1,3,5,7
/proc/23280/stat : 23280 (python) R 23278 23280 21667 0 -1 4202496 1288 0 0 0 2 0 0 0 17 0 1 0 948038750 19337216 1140 33554432000 4194304 5683644 140737111240608 18446744073709551615 4439516 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23280/statm: 4721 1140 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.101171 s]
/proc/loadavg: 2.00 2.05 1.71 2/793 23280
/proc/meminfo: memFree=18297484/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=85356 CPUtime=0.07 cores=1,3,5,7
/proc/23280/stat : 23280 (python) R 23278 23280 21667 0 -1 4202496 2585 0 0 0 5 2 0 0 17 0 1 0 948038750 87404544 2309 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415391488 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23280/statm: 21339 2309 709 364 0 1556 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 85356

[startup+0.301123 s]
/proc/loadavg: 2.00 2.05 1.71 2/793 23280
/proc/meminfo: memFree=18297484/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=123740 CPUtime=0.17 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 5357 928 1 0 13 4 0 0 16 0 1 0 948038750 126709760 3744 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415387653 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/23280/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123740

[startup+0.701045 s]
/proc/loadavg: 2.00 2.05 1.71 2/793 23280
/proc/meminfo: memFree=18297484/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=273712 CPUtime=0.43 cores=1,3,5,7
/proc/23280/stat : 23280 (python) R 23278 23280 21667 0 -1 4202496 8827 928 1 0 31 12 0 0 15 0 1 0 948038750 280281088 6760 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415391488 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/23280/statm: 68428 6760 1720 364 0 5461 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 273712

[startup+1.50094 s]
/proc/loadavg: 2.00 2.05 1.71 3/797 23289
/proc/meminfo: memFree=18251944/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 741 0 0 0 0 0 0 0 15 0 1 0 948038841 291696640 6060 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 3459306624592642048 0 0 17 1 0 0 0
/proc/23287/statm: 71215 6060 319 364 0 6102 0
[pid=23289] ppid=23287 vsize=45292 CPUtime=0.57 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 9628 0 0 0 45 12 0 0 18 0 1 0 948038841 46379008 8965 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 11323 8965 756 2317 0 9001 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 625256

[startup+3.10058 s]
/proc/loadavg: 2.00 2.05 1.71 3/797 23289
/proc/meminfo: memFree=18251944/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 749 0 0 0 0 0 0 0 15 0 1 0 948038841 291696640 6060 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 4294934790 0 0 17 1 0 0 0
/proc/23287/statm: 71215 6060 319 364 0 6102 0
[pid=23289] ppid=23287 vsize=55388 CPUtime=2.17 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 12284 0 0 0 198 19 0 0 18 0 1 0 948038841 56717312 11570 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 13847 11570 765 2317 0 11525 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 635352

[startup+6.30097 s]
/proc/loadavg: 2.16 2.08 1.72 5/797 23289
/proc/meminfo: memFree=18225396/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0.02 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 887 0 0 0 1 1 0 0 15 0 1 0 948038841 291696640 6084 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 268947063914364928 0 0 17 1 0 0 0
/proc/23287/statm: 71215 6084 343 364 0 6102 0
[pid=23289] ppid=23287 vsize=55992 CPUtime=5.38 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 13227 0 0 0 505 33 0 0 20 0 1 0 948038841 57335808 11772 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 13998 11772 803 2317 0 11676 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 635956

[startup+12.7008 s]
/proc/loadavg: 2.13 2.08 1.72 5/797 23289
/proc/meminfo: memFree=18223908/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0.07 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 899 0 0 0 4 3 0 0 15 0 1 0 948038841 291696640 6084 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 4115873512013430784 0 0 17 7 0 0 0
/proc/23287/statm: 71215 6084 343 364 0 6102 0
[pid=23289] ppid=23287 vsize=56304 CPUtime=11.78 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 19792 0 0 0 1069 109 0 0 18 0 1 0 948038841 57655296 11831 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 14076 11831 807 2317 0 11754 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.5
Current children cumulated vsize (KiB) 636268

[startup+25.5213 s]
/proc/loadavg: 2.11 2.07 1.73 5/797 23289
/proc/meminfo: memFree=18208924/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0.15 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 929 0 0 0 8 7 0 0 15 0 1 0 948038841 291696640 6085 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 3602791423138594816 0 0 17 7 0 0 0
/proc/23287/statm: 71215 6085 344 364 0 6102 0
[pid=23289] ppid=23287 vsize=73044 CPUtime=24.6 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 24196 0 0 0 2185 275 0 0 18 0 1 0 948038841 74797056 15949 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 18261 15949 807 2317 0 15939 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 653008

[startup+51.1004 s]
/proc/loadavg: 2.07 2.07 1.73 5/797 23290
/proc/meminfo: memFree=18198848/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=295104 CPUtime=0.65 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 11038 1348 1 0 48 13 3 1 18 0 2 0 948038750 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23280/statm: 73776 7616 1871 364 0 8663 0
[pid=23287] ppid=23280 vsize=284860 CPUtime=0.33 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 956 0 0 0 18 15 0 0 15 0 1 0 948038841 291696640 6085 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411727 0 0 16781312 33554946 1799386697666920448 0 0 17 7 0 0 0
/proc/23287/statm: 71215 6085 344 364 0 6102 0
[pid=23289] ppid=23287 vsize=80632 CPUtime=50.18 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) R 23287 23289 23289 0 -1 4202496 29282 0 0 0 4412 606 0 0 18 0 1 0 948038841 82567168 18022 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23289/statm: 20158 18022 807 2317 0 17836 0
[pid=23280/tid=23288] ppid=23278 vsize=295104 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 2 0 948038841 302186496 7616 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.16
Current children cumulated vsize (KiB) 660596

[startup+102.302 s]
/proc/loadavg: 2.07 2.07 1.75 6/822 23316
/proc/meminfo: memFree=18110424/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=315616 CPUtime=0.71 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 12866 1348 1 0 53 14 3 1 20 0 4 0 948038750 323190784 7629 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23280/statm: 78904 7629 1876 364 0 13785 0
[pid=23287] ppid=23280 vsize=295104 CPUtime=0.35 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 1157 0 0 0 19 16 0 0 16 0 2 0 948038841 302186496 6153 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23287/statm: 73776 6153 407 364 0 8663 0
[pid=23289] ppid=23287 vsize=80632 CPUtime=52.05 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) T 23287 23289 23289 0 -1 4202496 29285 0 0 0 4578 627 0 0 18 0 1 0 948038841 82567168 18025 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/23289/statm: 20158 18025 807 2317 0 17836 0
[pid=23287/tid=23291] ppid=23280 vsize=295104 CPUtime=0 cores=1,3,5,7
/proc/23287/task/23291/stat : 23291 (python) S 23280 23280 21667 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 948044048 302186496 6153 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554946 18446604456198824320 0 0 -1 7 0 0 0
[pid=23292] ppid=23280 vsize=295116 CPUtime=0.33 cores=1,3,5,7
/proc/23292/stat : 23292 (python) S 23280 23280 21667 0 -1 4202560 1198 0 0 0 18 15 0 0 17 0 2 0 948044050 302198784 6138 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23292/statm: 73779 6138 392 364 0 8663 0
[pid=23294] ppid=23292 vsize=80176 CPUtime=48.03 cores=1,3,5,7
/proc/23294/stat : 23294 (scip-2.0.1.linu) T 23292 23294 23294 0 -1 4202496 43905 0 0 0 4583 220 0 0 18 0 1 0 948044050 82100224 17187 33554432000 4194304 15243407 140735537378592 18446744073709551615 7103419 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23294/statm: 20044 17187 930 2698 0 17339 0
[pid=23292/tid=23296] ppid=23280 vsize=295116 CPUtime=0 cores=1,3,5,7
/proc/23292/task/23296/stat : 23296 (python) S 23280 23280 21667 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 948048854 302198784 6138 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554946 18446604465033987072 0 0 -1 7 0 0 0
[pid=23297] ppid=23280 vsize=305372 CPUtime=0 cores=1,3,5,7
/proc/23297/stat : 23297 (python) S 23280 23280 21667 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 1 0 948048857 312700928 6069 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411782 0 0 16781312 33554946 4294934789 0 0 17 3 0 0 0
/proc/23297/statm: 76343 6069 320 364 0 11224 0
[pid=23299] ppid=23297 vsize=8615264 CPUtime=2.38 cores=1,3,5,7
/proc/23299/stat : 23299 (java) S 23297 23299 23299 0 -1 4202496 47190 0 1 0 232 6 0 0 17 0 19 0 948048857 8822030336 40850 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/23299/statm: 2153816 40851 2243 9 0 2144557 0
[pid=23299/tid=23300] ppid=23297 vsize=8615264 CPUtime=1.2 cores=1,3,5,7
/proc/23299/task/23300/stat : 23300 (java) S 23297 23299 23299 0 -1 4202560 31999 0 1 0 116 4 0 0 18 0 19 0 948048858 8822030336 40852 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446604459713026880 0 0 -1 5 0 0 0
[pid=23299/tid=23301] ppid=23297 vsize=8615264 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23301/stat : 23301 (java) R 23297 23299 23299 0 -1 4202560 225 0 0 0 0 0 0 0 18 0 19 0 948048859 8822030336 40854 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 47480292783152 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=23299/tid=23302] ppid=23297 vsize=8615264 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23302/stat : 23302 (java) S 23297 23299 23299 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 948048859 8822030336 40855 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446604459713026880 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=23323/tid=23331] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23331/stat : 23331 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 3 0 0 0
[pid=23323/tid=23332] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23332/stat : 23332 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23323/tid=23333] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23333/stat : 23333 (java) S 23321 23323 23323 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 948053550 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 0 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23334] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23334/stat : 23334 (java) S 23321 23323 23323 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 948053551 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23335] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23335/stat : 23335 (java) S 23321 23323 23323 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 19 0 948053551 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 3 0 0 0
[pid=23323/tid=23336] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23336/stat : 23336 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427215281 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23337] ppid=23321 vsize=8547308 CPUtime=0.46 cores=1,3,5,7
/proc/23323/task/23337/stat : 23337 (java) R 23321 23323 23323 0 -1 4202560 8485 0 0 0 46 0 0 0 20 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 47512685269323 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=23323/tid=23338] ppid=23321 vsize=8547308 CPUtime=0.42 cores=1,3,5,7
/proc/23323/task/23338/stat : 23338 (java) R 23321 23323 23323 0 -1 4202560 7504 0 0 0 42 0 0 0 19 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 47512688147584 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=23323/tid=23339] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23339/stat : 23339 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23340] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23340/stat : 23340 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23323/tid=23341] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23341/stat : 23341 (java) S 23321 23323 23323 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 948053589 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23280/tid=23288] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 5 0 948038841 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
[pid=23280/tid=23293] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23293/stat : 23293 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 20 0 5 0 948044050 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
[pid=23280/tid=23298] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23298/stat : 23298 (python) S 23278 23280 21667 0 -1 4202560 28 1348 0 0 0 0 3 1 20 0 5 0 948048857 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 5 0 0 0
[pid=23280/tid=23322] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23322/stat : 23322 (python) S 23278 23280 21667 0 -1 4202560 29 1348 0 0 0 0 3 1 20 0 5 0 948053548 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 151.91
Current children cumulated vsize (KiB) 18856548

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+148.602 s]
/proc/loadavg: 2.12 2.08 1.77 7/845 23341
/proc/meminfo: memFree=17923152/32950928 swapFree=50514916/67111528
[pid=23280] ppid=23278 vsize=325872 CPUtime=0.73 cores=1,3,5,7
/proc/23280/stat : 23280 (python) S 23278 23280 21667 0 -1 4202496 13803 1348 1 0 55 14 3 1 20 0 5 0 948038750 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/23280/statm: 81468 7635 1878 364 0 16346 0
[pid=23287] ppid=23280 vsize=295104 CPUtime=0.35 cores=1,3,5,7
/proc/23287/stat : 23287 (python) S 23280 23280 21667 0 -1 4202560 1157 0 0 0 19 16 0 0 16 0 2 0 948038841 302186496 6153 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23287/statm: 73776 6153 407 364 0 8663 0
[pid=23289] ppid=23287 vsize=80632 CPUtime=52.05 cores=1,3,5,7
/proc/23289/stat : 23289 (scip-2.0.1.linu) T 23287 23289 23289 0 -1 4202496 29285 0 0 0 4578 627 0 0 18 0 1 0 948038841 82567168 18025 33554432000 4194304 13684479 140734163653520 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/23289/statm: 20158 18025 807 2317 0 17836 0
[pid=23287/tid=23291] ppid=23280 vsize=295104 CPUtime=0 cores=1,3,5,7
/proc/23287/task/23291/stat : 23291 (python) S 23280 23280 21667 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 948044048 302186496 6153 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554946 18446604456198824320 0 0 -1 7 0 0 0
[pid=23292] ppid=23280 vsize=295116 CPUtime=0.33 cores=1,3,5,7
/proc/23292/stat : 23292 (python) S 23280 23280 21667 0 -1 4202560 1198 0 0 0 18 15 0 0 17 0 2 0 948044050 302198784 6138 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23292/statm: 73779 6138 392 364 0 8663 0
[pid=23294] ppid=23292 vsize=80176 CPUtime=48.03 cores=1,3,5,7
/proc/23294/stat : 23294 (scip-2.0.1.linu) T 23292 23294 23294 0 -1 4202496 43905 0 0 0 4583 220 0 0 18 0 1 0 948044050 82100224 17187 33554432000 4194304 15243407 140735537378592 18446744073709551615 7103419 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23294/statm: 20044 17187 930 2698 0 17339 0
[pid=23292/tid=23296] ppid=23280 vsize=295116 CPUtime=0 cores=1,3,5,7
/proc/23292/task/23296/stat : 23296 (python) S 23280 23280 21667 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 948048854 302198784 6138 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554946 18446604465033987072 0 0 -1 7 0 0 0
[pid=23297] ppid=23280 vsize=305372 CPUtime=0.25 cores=1,3,5,7
/proc/23297/stat : 23297 (python) S 23280 23280 21667 0 -1 4202560 1120 0 0 0 12 13 0 0 16 0 2 0 948048857 312700928 6141 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23297/statm: 76343 6141 391 364 0 11224 0
[pid=23299] ppid=23297 vsize=8612228 CPUtime=48.62 cores=1,3,5,7
/proc/23299/stat : 23299 (java) T 23297 23299 23299 0 -1 4202496 73674 0 1 0 4849 13 0 0 15 0 19 0 948048857 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/23299/statm: 2153057 36334 2258 9 0 2143798 0
[pid=23299/tid=23300] ppid=23297 vsize=8612228 CPUtime=45.42 cores=1,3,5,7
/proc/23299/task/23300/stat : 23300 (java) T 23297 23299 23299 0 -1 4202560 37853 0 1 0 4537 5 0 0 25 0 19 0 948048858 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23299/tid=23301] ppid=23297 vsize=8612228 CPUtime=0.11 cores=1,3,5,7
/proc/23299/task/23301/stat : 23301 (java) T 23297 23299 23299 0 -1 4202560 1593 0 0 0 11 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256415344951 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23299/tid=23302] ppid=23297 vsize=8612228 CPUtime=0.09 cores=1,3,5,7
/proc/23299/task/23302/stat : 23302 (java) T 23297 23299 23299 0 -1 4202560 1780 0 0 0 9 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23299/tid=23303] ppid=23297 vsize=8612228 CPUtime=0.12 cores=1,3,5,7
/proc/23299/task/23303/stat : 23303 (java) T 23297 23299 23299 0 -1 4202560 1742 0 0 0 12 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256415344951 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23299/tid=23304] ppid=23297 vsize=8612228 CPUtime=0.08 cores=1,3,5,7
/proc/23299/task/23304/stat : 23304 (java) T 23297 23299 23299 0 -1 4202560 2353 0 0 0 8 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427208646 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23299/tid=23305] ppid=23297 vsize=8612228 CPUtime=0.12 cores=1,3,5,7
/proc/23299/task/23305/stat : 23305 (java) T 23297 23299 23299 0 -1 4202560 1675 0 0 0 12 0 0 0 16 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 47480289895648 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23299/tid=23306] ppid=23297 vsize=8612228 CPUtime=0.09 cores=1,3,5,7
/proc/23299/task/23306/stat : 23306 (java) T 23297 23299 23299 0 -1 4202560 2615 0 0 0 9 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256415344951 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23299/tid=23307] ppid=23297 vsize=8612228 CPUtime=0.09 cores=1,3,5,7
/proc/23299/task/23307/stat : 23307 (java) T 23297 23299 23299 0 -1 4202560 1621 0 0 0 9 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256415344951 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23299/tid=23308] ppid=23297 vsize=8612228 CPUtime=0.1 cores=1,3,5,7
/proc/23299/task/23308/stat : 23308 (java) T 23297 23299 23299 0 -1 4202560 2539 0 0 0 10 0 0 0 15 0 19 0 948048859 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 47480289895644 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23299/tid=23309] ppid=23297 vsize=8612228 CPUtime=1.04 cores=1,3,5,7
/proc/23299/task/23309/stat : 23309 (java) T 23297 23299 23299 0 -1 4202560 5101 0 0 0 101 3 0 0 15 0 19 0 948048860 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23299/tid=23310] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23310/stat : 23310 (java) T 23297 23299 23299 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 948048860 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23299/tid=23311] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23311/stat : 23311 (java) T 23297 23299 23299 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 948048860 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23299/tid=23312] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23312/stat : 23312 (java) T 23297 23299 23299 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948048862 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427215281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23299/tid=23313] ppid=23297 vsize=8612228 CPUtime=0.66 cores=1,3,5,7
/proc/23299/task/23313/stat : 23313 (java) T 23297 23299 23299 0 -1 4202560 4926 0 0 0 66 0 0 0 15 0 19 0 948048862 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23299/tid=23314] ppid=23297 vsize=8612228 CPUtime=0.6 cores=1,3,5,7
/proc/23299/task/23314/stat : 23314 (java) T 23297 23299 23299 0 -1 4202560 8487 0 0 0 60 0 0 0 15 0 19 0 948048862 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23299/tid=23315] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23315/stat : 23315 (java) T 23297 23299 23299 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948048862 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23299/tid=23316] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23316/stat : 23316 (java) T 23297 23299 23299 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 948048862 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427208192 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=23299/tid=23317] ppid=23297 vsize=8612228 CPUtime=0 cores=1,3,5,7
/proc/23299/task/23317/stat : 23317 (java) T 23297 23299 23299 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 948048898 8818921472 36334 33554432000 1073741824 1073778376 140737122954704 18446744073709551615 256427208192 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23297/tid=23320] ppid=23280 vsize=305372 CPUtime=0 cores=1,3,5,7
/proc/23297/task/23320/stat : 23320 (python) S 23280 23280 21667 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 948053545 312700928 6141 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554946 18446604456437442752 0 0 -1 7 0 0 0
[pid=23321] ppid=23280 vsize=315628 CPUtime=0 cores=1,3,5,7
/proc/23321/stat : 23321 (python) R 23280 23280 21667 0 -1 4202560 793 0 0 0 0 0 0 0 15 0 1 0 948053548 323203072 6073 33554432000 4194304 5683644 140737111240608 18446744073709551615 256415411782 0 0 16781312 33554946 0 0 0 17 7 0 0 0
/proc/23321/statm: 78907 6073 320 364 0 13785 0
[pid=23323] ppid=23321 vsize=8546420 CPUtime=1.55 cores=1,3,5,7
/proc/23323/stat : 23323 (java) S 23321 23323 23323 0 -1 4202496 25532 0 1 0 152 3 0 0 20 0 19 0 948053548 8751534080 18542 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/23323/statm: 2136605 18542 2223 9 0 2127346 0
[pid=23323/tid=23324] ppid=23321 vsize=8547308 CPUtime=0.64 cores=1,3,5,7
/proc/23323/task/23324/stat : 23324 (java) R 23321 23323 23323 0 -1 4202560 8414 0 1 0 63 1 0 0 19 0 19 0 948053549 8752443392 18812 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 46912505219208 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=23323/tid=23325] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23325/stat : 23325 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 948053549 8752443392 18812 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23326] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23326/stat : 23326 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 948053549 8752443392 18813 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23327] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23327/stat : 23327 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 948053549 8752443392 18813 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23328] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23328/stat : 23328 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948053549 8752443392 18813 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 3 0 0 0
[pid=23323/tid=23329] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23329/stat : 23329 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23323/tid=23330] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23330/stat : 23330 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 1 0 0 0
[pid=23323/tid=23331] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23331/stat : 23331 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 3 0 0 0
[pid=23323/tid=23332] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23332/stat : 23332 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948053549 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23323/tid=23333] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23333/stat : 23333 (java) S 23321 23323 23323 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 948053550 8752443392 18814 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 0 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23334] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23334/stat : 23334 (java) S 23321 23323 23323 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 948053551 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23335] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23335/stat : 23335 (java) S 23321 23323 23323 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 19 0 948053551 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 3 0 0 0
[pid=23323/tid=23336] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23336/stat : 23336 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427215281 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23337] ppid=23321 vsize=8547308 CPUtime=0.46 cores=1,3,5,7
/proc/23323/task/23337/stat : 23337 (java) R 23321 23323 23323 0 -1 4202560 8485 0 0 0 46 0 0 0 20 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 47512685269323 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=23323/tid=23338] ppid=23321 vsize=8547308 CPUtime=0.42 cores=1,3,5,7
/proc/23323/task/23338/stat : 23338 (java) R 23321 23323 23323 0 -1 4202560 7504 0 0 0 42 0 0 0 19 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 47512688147584 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=23323/tid=23339] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23339/stat : 23339 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427207577 0 4 0 16800975 18446604457724592320 0 0 -1 7 0 0 0
[pid=23323/tid=23340] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23340/stat : 23340 (java) S 23321 23323 23323 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 948053553 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23323/tid=23341] ppid=23321 vsize=8547308 CPUtime=0 cores=1,3,5,7
/proc/23323/task/23341/stat : 23341 (java) S 23321 23323 23323 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 948053589 8752443392 18815 33554432000 1073741824 1073778376 140735485369872 18446744073709551615 256427208192 0 4 0 16800975 18446604457724592320 0 0 -1 5 0 0 0
[pid=23280/tid=23288] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23288/stat : 23288 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 18 0 5 0 948038841 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
[pid=23280/tid=23293] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23293/stat : 23293 (python) S 23278 23280 21667 0 -1 4202560 31 1348 0 0 0 0 3 1 20 0 5 0 948044050 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 3 0 0 0
[pid=23280/tid=23298] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23298/stat : 23298 (python) S 23278 23280 21667 0 -1 4202560 28 1348 0 0 0 0 3 1 20 0 5 0 948048857 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 5 0 0 0
[pid=23280/tid=23322] ppid=23278 vsize=325872 CPUtime=0.04 cores=1,3,5,7
/proc/23280/task/23322/stat : 23322 (python) S 23278 23280 21667 0 -1 4202560 29 1348 0 0 0 0 3 1 20 0 5 0 948053548 333692928 7635 33554432000 4194304 5683644 140737111240608 18446744073709551615 256427215281 0 0 16781312 33554434 18446604471127728320 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 151.91
Current children cumulated vsize (KiB) 18856548

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23280 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=591910
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=158975
# CPU time returned by wait4() is 0.750885
# while last known CPU time is 151.91
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 148.684
CPU time (s): 151.91
CPU user time (s): 142.69
CPU system time (s): 9.22
CPU usage (%): 102.17
Max. virtual memory (cumulated for all children) (KiB): 18856548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.59191
system time used= 0.158975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15152
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5310
involuntary context switches= 22

runsolver used 1.03784 second user time and 2.18867 second system time

The end

Launcher Data 

Begin job on node115 at 2011-06-09 02:08:00
IDJOB=3481538
IDBENCH=48205
IDSOLVER=1970
FILE ID=node115/3481538-1307578080
RUNJOBID= node115-1307576359-21686
PBS_JOBID= 13547684
Free space on /tmp= 73604 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_200_25_5.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481538-1307578080/watcher-3481538-1307578080 -o /tmp/evaluation-result-3481538-1307578080/solver-3481538-1307578080 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481538-1307578080.opb -seed 1844147195 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cdccc05ac387e7ee9cb8ab81f53ca6f8
RANDOM SEED=1844147195

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18297648 kB
Buffers:        168584 kB
Cached:         713168 kB
SwapCached:       9708 kB
Active:       14178228 kB
Inactive:       156896 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18297648 kB
SwapTotal:    67111528 kB
SwapFree:     50514916 kB
Dirty:          101696 kB
Writeback:           4 kB
AnonPages:    13450580 kB
Mapped:          84804 kB
Slab:           137064 kB
PageTables:     107824 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 169099676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node115 at 2011-06-09 02:10:32