Trace number 3481445

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 382.29 378.393

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_25_1.opb
MD5SUM93a95f0846e71f0984a2317cf811edef
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark27
Best CPU time to get the best result obtained on this benchmark1797.12
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 35
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint26
Maximum length of a constraint49
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)15716
Sum of products size (including duplicates)31432
Number of different products15716
Sum of products size31432

Solver Data 

0.29/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.29/0.69	c INFO: solving HOME/instance-3481445-1307577833.opb
0.40/0.86	c INFO: wrote linearized instance to HOME/tmpdHhPzo.opb
0.75/1.07	c INFO: parsing took 0.20 s
1.15/1.45	c INFO: features took 0.38 CPU seconds
1.15/1.48	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.13)
47.88/48.01	c INFO: running scip-2.0.1-clp@0 for 45 with 1753 remaining (b = 0.03)
94.97/95.00	c INFO: running wbo1.4a@0 for 45 with 1706 remaining (b = 0.02)
146.11/145.84	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1655 remaining (b = 0.01)
196.15/193.16	c INFO: running clasp-1.3.7@0 for 91 with 1606 remaining (b = 0.02)
289.19/285.78	c INFO: running scip-2.0.1-spx@45 for 45 with 1514 remaining (b = 0.01)
335.77/332.03	c INFO: running scip-2.0.1-clp@46 for 45 with 1467 remaining (b = 0.01)
382.16/378.27	c INFO: running sat4j-pb-v20101225@0 for 45 with 1421 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481445-1307577833/watcher-3481445-1307577833 -o /tmp/evaluation-result-3481445-1307577833/solver-3481445-1307577833 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481445-1307577833.opb -seed 772710201 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.15 2.08 1.61 3/591 22527
/proc/meminfo: memFree=30296996/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/22527/stat : 22527 (python) R 22525 22527 21589 0 -1 4202496 1049 0 0 0 0 0 0 0 19 0 1 0 850199634 16629760 921 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039349199 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22527/statm: 4060 921 381 364 0 547 0

[startup+0.0614369 s]
/proc/loadavg: 2.15 2.08 1.61 3/591 22527
/proc/meminfo: memFree=30296996/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=38908 CPUtime=0.03 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 1630 0 0 0 3 0 0 0 17 0 1 0 850199634 39841792 1459 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039653376 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/22527/statm: 9727 1459 455 364 0 1027 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 38908

[startup+0.100463 s]
/proc/loadavg: 2.15 2.08 1.61 3/591 22527
/proc/meminfo: memFree=30296996/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=85364 CPUtime=0.05 cores=0,2,4,6
/proc/22527/stat : 22527 (python) D 22525 22527 21589 0 -1 4202496 2585 0 0 0 4 1 0 0 17 0 1 0 850199634 87412736 2310 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039661111 0 0 16781312 2 18446744071562154983 0 0 17 4 0 0 0
/proc/22527/statm: 21341 2310 709 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+0.300611 s]
/proc/loadavg: 2.15 2.08 1.61 3/591 22527
/proc/meminfo: memFree=30296996/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=94068 CPUtime=0.06 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 2796 0 1 0 5 1 0 0 17 0 1 0 850199634 96325632 2468 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039655168 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 20
/proc/22527/statm: 23517 2468 788 364 0 1628 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 94068

[startup+0.700316 s]
/proc/loadavg: 2.15 2.08 1.61 3/591 22527
/proc/meminfo: memFree=30296996/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=282408 CPUtime=0.36 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 9185 933 1 0 30 6 0 0 18 0 1 0 850199634 289185792 6937 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675407 0 0 16781312 2 4038994215890321408 0 0 17 4 0 0 20
/proc/22527/statm: 70602 6937 1777 364 0 5495 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 282408

[startup+1.50017 s]
/proc/loadavg: 2.15 2.08 1.61 3/592 22533
/proc/meminfo: memFree=30263632/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=300916 CPUtime=1.23 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 14620 1450 1 0 96 11 14 2 20 0 2 0 850199634 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 75229 9068 1871 364 0 10116 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 300916

[startup+3.10096 s]
/proc/loadavg: 2.15 2.08 1.61 3/595 22536
/proc/meminfo: memFree=30166776/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=300916 CPUtime=1.23 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 14620 1450 1 0 96 11 14 2 20 0 2 0 850199634 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 75229 9068 1871 364 0 10116 0
[pid=22534] ppid=22527 vsize=290672 CPUtime=0 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 732 0 0 0 0 0 0 0 15 0 1 0 850199783 297648128 7511 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675407 0 0 16781312 33554946 3985927077449695232 0 0 17 4 0 0 0
/proc/22534/statm: 72668 7511 318 364 0 7555 0
[pid=22536] ppid=22534 vsize=189052 CPUtime=1.6 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) R 22534 22536 22536 0 -1 4202496 46565 0 0 0 147 13 0 0 25 0 1 0 850199783 193589248 44465 33554432000 4194304 13684479 140736121256384 18446744073709551615 6427705 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22536/statm: 47263 44465 760 2317 0 44941 0
[pid=22527/tid=22535] ppid=22525 vsize=300916 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 2 0 850199783 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 780640

[startup+6.30038 s]
/proc/loadavg: 2.14 2.08 1.62 3/595 22536
/proc/meminfo: memFree=30080720/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=300916 CPUtime=1.23 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 14620 1450 1 0 96 11 14 2 20 0 2 0 850199634 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 75229 9068 1871 364 0 10116 0
[pid=22534] ppid=22527 vsize=290672 CPUtime=0.02 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 871 0 0 0 1 1 0 0 15 0 1 0 850199783 297648128 7535 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675407 0 0 16781312 33554946 436613645028294656 0 0 17 4 0 0 0
/proc/22534/statm: 72668 7535 342 364 0 7555 0
[pid=22536] ppid=22534 vsize=189052 CPUtime=4.8 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) R 22534 22536 22536 0 -1 4202496 47071 0 0 0 455 25 0 0 25 0 1 0 850199783 193589248 44802 33554432000 4194304 13684479 140736121256384 18446744073709551615 6457236 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22536/statm: 47263 44802 782 2317 0 44941 0
[pid=22527/tid=22535] ppid=22525 vsize=300916 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 2 0 850199783 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 780640

[startup+12.7012 s]
/proc/loadavg: 2.12 2.08 1.62 3/595 22536
/proc/meminfo: memFree=30065336/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=300916 CPUtime=1.23 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 14620 1450 1 0 96 11 14 2 20 0 2 0 850199634 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 75229 9068 1871 364 0 10116 0
[pid=22534] ppid=22527 vsize=290672 CPUtime=0.05 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 874 0 0 0 3 2 0 0 15 0 1 0 850199783 297648128 7535 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675407 0 0 16781312 33554946 3892359346595561472 0 0 17 4 0 0 0
/proc/22534/statm: 72668 7535 342 364 0 7555 0
[pid=22536] ppid=22534 vsize=201164 CPUtime=11.18 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) R 22534 22536 22536 0 -1 4202496 49927 0 0 0 1090 28 0 0 25 0 1 0 850199783 205991936 47655 33554432000 4194304 13684479 140736121256384 18446744073709551615 11065552 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22536/statm: 50291 47655 782 2317 0 47969 0
[pid=22527/tid=22535] ppid=22525 vsize=300916 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 2 0 850199783 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 792752

[startup+25.5009 s]
/proc/loadavg: 2.25 2.11 1.64 3/587 22631
/proc/meminfo: memFree=29944160/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=300916 CPUtime=1.23 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 14620 1450 1 0 96 11 14 2 20 0 2 0 850199634 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 75229 9068 1871 364 0 10116 0
[pid=22534] ppid=22527 vsize=290672 CPUtime=0.11 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 879 0 0 0 6 5 0 0 15 0 1 0 850199783 297648128 7535 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675407 0 0 16781312 33554946 72409437758827433 0 0 17 4 0 0 0
/proc/22534/statm: 72668 7535 342 364 0 7555 0
[pid=22536] ppid=22534 vsize=201168 CPUtime=23.97 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) R 22534 22536 22536 0 -1 4202496 67131 0 0 0 2360 37 0 0 25 0 1 0 850199783 205996032 47836 33554432000 4194304 13684479 140736121256384 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22536/statm: 50292 47836 807 2317 0 47970 0
[pid=22527/tid=22535] ppid=22525 vsize=300916 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 2 0 850199783 308137984 9068 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.31
Current children cumulated vsize (KiB) 792756

[startup+51.1014 s]
/proc/loadavg: 2.16 2.10 1.64 3/591 22636
/proc/meminfo: memFree=29775732/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=311172 CPUtime=1.25 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 15507 1450 1 0 98 11 14 2 20 0 3 0 850199634 318640128 9075 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 20
/proc/22527/statm: 77793 9075 1874 364 0 12677 0
[pid=22534] ppid=22527 vsize=300916 CPUtime=0.22 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 1085 0 0 0 12 10 0 0 17 0 2 0 850199783 308137984 7603 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/22534/statm: 75229 7603 405 364 0 10116 0
[pid=22536] ppid=22534 vsize=202124 CPUtime=46.42 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) T 22534 22536 22536 0 -1 4202496 67257 0 0 0 4599 43 0 0 25 0 1 0 850199783 206974976 47962 33554432000 4194304 13684479 140736121256384 18446744073709551615 7154451 0 0 16781312 2 18446744071562691360 0 0 17 6 0 0 0
/proc/22536/statm: 50531 47962 812 2317 0 48209 0
[pid=22534/tid=22633] ppid=22527 vsize=300916 CPUtime=0 cores=0,2,4,6
/proc/22534/task/22633/stat : 22633 (python) S 22527 22527 21589 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 850204433 308137984 7603 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604444163920960 0 0 -1 4 0 0 0
[pid=22634] ppid=22527 vsize=300928 CPUtime=0 cores=0,2,4,6
/proc/22634/stat : 22634 (python) S 22527 22527 21589 0 -1 4202560 764 0 0 0 0 0 0 0 15 0 1 0 850204436 308150272 7516 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675462 0 0 16781312 33554946 1991658721217871872 0 0 17 4 0 0 0
/proc/22634/statm: 75232 7516 319 364 0 10116 0
[pid=22636] ppid=22634 vsize=188812 CPUtime=3.07 cores=0,2,4,6
/proc/22636/stat : 22636 (scip-2.0.1.linu) R 22634 22636 22636 0 -1 4202496 46314 0 0 0 283 24 0 0 20 0 1 0 850204436 193343488 41335 33554432000 4194304 15243407 140736937582656 18446744073709551615 13277498 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/22636/statm: 47203 41335 867 2698 0 44498 0
[pid=22527/tid=22535] ppid=22525 vsize=311172 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 3 0 850199783 318640128 9075 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22635] ppid=22525 vsize=311172 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22635/stat : 22635 (python) S 22525 22527 21589 0 -1 4202560 32 1450 0 0 0 0 14 2 20 0 3 0 850204436 318640128 9075 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 1303952

[startup+102.321 s]
/proc/loadavg: 2.07 2.08 1.66 3/617 22663
/proc/meminfo: memFree=26920152/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=321428 CPUtime=1.27 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 16425 1450 1 0 100 11 14 2 20 0 4 0 850199634 329142272 9081 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 20
/proc/22527/statm: 80357 9081 1876 364 0 15238 0
[pid=22534] ppid=22527 vsize=300916 CPUtime=0.22 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 1085 0 0 0 12 10 0 0 17 0 2 0 850199783 308137984 7603 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/22534/statm: 75229 7603 405 364 0 10116 0
[pid=22536] ppid=22534 vsize=202124 CPUtime=46.42 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) T 22534 22536 22536 0 -1 4202496 67257 0 0 0 4599 43 0 0 25 0 1 0 850199783 206974976 47962 33554432000 4194304 13684479 140736121256384 18446744073709551615 7154451 0 0 16781312 2 18446744071562691360 0 0 17 6 0 0 0
/proc/22536/statm: 50531 47962 812 2317 0 48209 0
[pid=22534/tid=22633] ppid=22527 vsize=300916 CPUtime=0 cores=0,2,4,6
/proc/22534/task/22633/stat : 22633 (python) S 22527 22527 21589 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 850204433 308137984 7603 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604444163920960 0 0 -1 4 0 0 0
[pid=22634] ppid=22527 vsize=300928 CPUtime=0.23 cores=0,2,4,6
/proc/22634/stat : 22634 (python) S 22527 22527 21589 0 -1 4202560 1186 0 0 0 12 11 0 0 17 0 2 0 850204436 308150272 7594 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/22634/statm: 75232 7594 396 364 0 10116 0
[pid=22636] ppid=22634 vsize=206824 CPUtime=46.95 cores=0,2,4,6
/proc/22636/stat : 22636 (scip-2.0.1.linu) T 22634 22636 22636 0 -1 4202496 73423 0 0 0 4654 41 0 0 25 0 1 0 850204436 211787776 47810 33554432000 4194304 15243407 140736937582656 18446744073709551615 6712022 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/22636/statm: 51706 47810 930 2698 0 49001 0
[pid=22634/tid=22660] ppid=22527 vsize=300928 CPUtime=0 cores=0,2,4,6
/proc/22634/task/22660/stat : 22660 (python) S 22527 22527 21589 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850209132 308150272 7594 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604453973748672 0 0 -1 6 0 0 0
[pid=22661] ppid=22527 vsize=311184 CPUtime=0.02 cores=0,2,4,6
/proc/22661/stat : 22661 (python) S 22527 22527 21589 0 -1 4202560 1010 0 0 0 1 1 0 0 15 0 1 0 850209134 318652416 7550 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675462 0 0 16781312 33554946 4294934785 0 0 17 4 0 0 0
/proc/22661/statm: 77796 7550 349 364 0 12677 0
[pid=22663] ppid=22661 vsize=23012 CPUtime=7.31 cores=0,2,4,6
/proc/22663/stat : 22663 (wbo1.4a) R 22661 22663 22663 0 -1 4202496 6399 0 0 0 727 4 0 0 25 0 1 0 850209135 23564288 5294 33554432000 134512640 135751879 4294874880 18446744073709551615 134518474 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/22663/statm: 5753 5294 146 303 0 5448 0
[pid=22527/tid=22535] ppid=22525 vsize=321428 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 26 1450 0 0 0 0 14 2 20 0 4 0 850199783 329142272 9081 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22635] ppid=22525 vsize=321428 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22635/stat : 22635 (python) S 22525 22527 21589 0 -1 4202560 32 1450 0 0 0 0 14 2 20 0 4 0 850204436 329142272 9081 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=22527/tid=22535] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 32 1450 0 0 0 0 14 2 18 0 7 0 850199783 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22635] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22635/stat : 22635 (python) S 22525 22527 21589 0 -1 4202560 36 1450 0 0 0 0 14 2 18 0 7 0 850204436 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 4 0 0 0
[pid=22527/tid=22662] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22662/stat : 22662 (python) S 22525 22527 21589 0 -1 4202560 29 1450 0 0 0 0 14 2 20 0 7 0 850209135 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22799] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22799/stat : 22799 (python) S 22525 22527 21589 0 -1 4202560 28 1450 0 0 0 0 14 2 20 0 7 0 850214219 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22844] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22844/stat : 22844 (python) S 22525 22527 21589 0 -1 4202560 28 1450 0 0 0 0 14 2 20 0 7 0 850218951 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 2 0 0 0
[pid=22527/tid=22921] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22921/stat : 22921 (python) S 22525 22527 21589 0 -1 4202560 31 1450 0 0 0 0 14 2 20 0 7 0 850237462 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 382.29
Current children cumulated vsize (KiB) 19802096

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+378.302 s]
/proc/loadavg: 2.15 2.09 1.76 4/682 22934
/proc/meminfo: memFree=23522340/32951124 swapFree=39903648/67111528
[pid=22527] ppid=22525 vsize=352196 CPUtime=1.4 cores=0,2,4,6
/proc/22527/stat : 22527 (python) S 22525 22527 21589 0 -1 4202496 19255 1450 1 0 112 12 14 2 20 0 7 0 850199634 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 20
/proc/22527/statm: 88049 9099 1882 364 0 22921 0
[pid=22534] ppid=22527 vsize=300916 CPUtime=0.46 cores=0,2,4,6
/proc/22534/stat : 22534 (python) S 22527 22527 21589 0 -1 4202560 1107 0 0 0 24 22 0 0 15 0 2 0 850199783 308137984 7604 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/22534/statm: 75229 7604 406 364 0 10116 0
[pid=22536] ppid=22534 vsize=214088 CPUtime=92.64 cores=0,2,4,6
/proc/22536/stat : 22536 (scip-2.0.1.linu) T 22534 22536 22536 0 -1 4202496 69971 0 0 0 9209 55 0 0 25 0 1 0 850199783 219226112 50668 33554432000 4194304 13684479 140736121256384 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/22536/statm: 53522 50668 815 2317 0 51200 0
[pid=22534/tid=22633] ppid=22527 vsize=300916 CPUtime=0 cores=0,2,4,6
/proc/22534/task/22633/stat : 22633 (python) S 22527 22527 21589 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 850204433 308137984 7604 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604444163920960 0 0 -1 4 0 0 0
[pid=22634] ppid=22527 vsize=300928 CPUtime=0.45 cores=0,2,4,6
/proc/22634/stat : 22634 (python) S 22527 22527 21589 0 -1 4202560 1209 0 0 0 24 21 0 0 15 0 2 0 850204436 308150272 7594 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/22634/statm: 75232 7594 396 364 0 10116 0
[pid=22636] ppid=22634 vsize=212244 CPUtime=93.18 cores=0,2,4,6
/proc/22636/stat : 22636 (scip-2.0.1.linu) T 22634 22636 22636 0 -1 4202496 76142 0 0 0 9269 49 0 0 25 0 1 0 850204436 217337856 48401 33554432000 4194304 15243407 140736937582656 18446744073709551615 8049731 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/22636/statm: 53061 48401 938 2698 0 50356 0
[pid=22634/tid=22660] ppid=22527 vsize=300928 CPUtime=0 cores=0,2,4,6
/proc/22634/task/22660/stat : 22660 (python) S 22527 22527 21589 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 850209132 308150272 7594 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604453973748672 0 0 -1 6 0 0 0
[pid=22661] ppid=22527 vsize=311184 CPUtime=0.24 cores=0,2,4,6
/proc/22661/stat : 22661 (python) S 22527 22527 21589 0 -1 4202560 1189 0 0 0 14 10 0 0 17 0 2 0 850209134 318652416 7598 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/22661/statm: 77796 7598 396 364 0 12677 0
[pid=22663] ppid=22661 vsize=85664 CPUtime=50.8 cores=0,2,4,6
/proc/22663/stat : 22663 (wbo1.4a) T 22661 22663 22663 0 -1 4202496 22036 0 0 0 5063 17 0 0 25 0 1 0 850209135 87719936 20931 33554432000 134512640 135751879 4294874880 18446744073709551615 134606331 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/22663/statm: 21416 20931 146 303 0 21111 0
[pid=22661/tid=22797] ppid=22527 vsize=311184 CPUtime=0 cores=0,2,4,6
/proc/22661/task/22797/stat : 22797 (python) S 22527 22527 21589 0 -1 4202560 43 0 0 0 0 0 0 0 17 0 2 0 850214216 318652416 7598 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604453944322176 0 0 -1 6 0 0 0
[pid=22798] ppid=22527 vsize=321440 CPUtime=0.22 cores=0,2,4,6
/proc/22798/stat : 22798 (python) S 22527 22527 21589 0 -1 4202560 1148 0 0 0 13 9 0 0 17 0 2 0 850214219 329154560 7596 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0
/proc/22798/statm: 80360 7596 390 364 0 15238 0
[pid=22800] ppid=22798 vsize=8553192 CPUtime=49.86 cores=0,2,4,6
/proc/22800/stat : 22800 (java) T 22798 22800 22800 0 -1 4202496 713990 0 1 0 4913 73 0 0 15 0 19 0 850214219 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051458021 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/22800/statm: 2138298 705393 2251 9 0 2129039 0
[pid=22800/tid=22801] ppid=22798 vsize=8553192 CPUtime=46.99 cores=0,2,4,6
/proc/22800/task/22801/stat : 22801 (java) T 22798 22800 22800 0 -1 4202560 636649 0 1 0 4638 61 0 0 25 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 46912505967500 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22800/tid=22802] ppid=22798 vsize=8553192 CPUtime=0.12 cores=0,2,4,6
/proc/22800/task/22802/stat : 22802 (java) T 22798 22800 22800 0 -1 4202560 10436 0 0 0 11 1 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22800/tid=22803] ppid=22798 vsize=8553192 CPUtime=0.1 cores=0,2,4,6
/proc/22800/task/22803/stat : 22803 (java) T 22798 22800 22800 0 -1 4202560 7713 0 0 0 9 1 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=22800/tid=22804] ppid=22798 vsize=8553192 CPUtime=0.06 cores=0,2,4,6
/proc/22800/task/22804/stat : 22804 (java) T 22798 22800 22800 0 -1 4202560 4955 0 0 0 6 0 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=22800/tid=22805] ppid=22798 vsize=8553192 CPUtime=0.12 cores=0,2,4,6
/proc/22800/task/22805/stat : 22805 (java) T 22798 22800 22800 0 -1 4202560 10938 0 0 0 10 2 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22800/tid=22806] ppid=22798 vsize=8553192 CPUtime=0.1 cores=0,2,4,6
/proc/22800/task/22806/stat : 22806 (java) T 22798 22800 22800 0 -1 4202560 8690 0 0 0 9 1 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=22800/tid=22807] ppid=22798 vsize=8553192 CPUtime=0.05 cores=0,2,4,6
/proc/22800/task/22807/stat : 22807 (java) T 22798 22800 22800 0 -1 4202560 4501 0 0 0 5 0 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=22800/tid=22808] ppid=22798 vsize=8553192 CPUtime=0.08 cores=0,2,4,6
/proc/22800/task/22808/stat : 22808 (java) T 22798 22800 22800 0 -1 4202560 7940 0 0 0 8 0 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=22800/tid=22809] ppid=22798 vsize=8553192 CPUtime=0.07 cores=0,2,4,6
/proc/22800/task/22809/stat : 22809 (java) T 22798 22800 22800 0 -1 4202560 7113 0 0 0 7 0 0 0 15 0 19 0 850214220 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=22800/tid=22810] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22810/stat : 22810 (java) T 22798 22800 22800 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 850214221 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471872 0 0 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=22800/tid=22811] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22811/stat : 22811 (java) T 22798 22800 22800 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850214222 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=22800/tid=22812] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22812/stat : 22812 (java) T 22798 22800 22800 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 850214222 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=22800/tid=22813] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22813/stat : 22813 (java) T 22798 22800 22800 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850214224 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051478961 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22800/tid=22814] ppid=22798 vsize=8553192 CPUtime=0.99 cores=0,2,4,6
/proc/22800/task/22814/stat : 22814 (java) T 22798 22800 22800 0 -1 4202560 7521 0 0 0 98 1 0 0 15 0 19 0 850214224 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 47580841737550 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=22800/tid=22815] ppid=22798 vsize=8553192 CPUtime=1.04 cores=0,2,4,6
/proc/22800/task/22815/stat : 22815 (java) T 22798 22800 22800 0 -1 4202560 4865 0 0 0 104 0 0 0 15 0 19 0 850214224 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=22800/tid=22816] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22816/stat : 22816 (java) T 22798 22800 22800 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850214224 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22800/tid=22817] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22817/stat : 22817 (java) T 22798 22800 22800 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 850214224 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471872 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=22800/tid=22818] ppid=22798 vsize=8553192 CPUtime=0 cores=0,2,4,6
/proc/22800/task/22818/stat : 22818 (java) T 22798 22800 22800 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850214286 8758468608 705393 33554432000 1073741824 1073778376 140733715909600 18446744073709551615 212051471872 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=22798/tid=22842] ppid=22527 vsize=321440 CPUtime=0 cores=0,2,4,6
/proc/22798/task/22842/stat : 22842 (python) S 22527 22527 21589 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 850218948 329154560 7596 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604443889653568 0 0 -1 4 0 0 0
[pid=22843] ppid=22527 vsize=331696 CPUtime=0.43 cores=0,2,4,6
/proc/22843/stat : 22843 (python) S 22527 22527 21589 0 -1 4202560 1179 0 0 0 23 20 0 0 19 0 2 0 850218951 339656704 7600 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051482059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/22843/statm: 82924 7600 390 364 0 17799 0
[pid=22845] ppid=22843 vsize=16392 CPUtime=92.58 cores=0,2,4,6
/proc/22845/stat : 22845 (clasp-1.3.7-x86) T 22843 22845 22845 0 -1 4202496 4362 0 0 0 9258 0 0 0 25 0 1 0 850218951 16785408 3838 33554432000 134512640 136139019 4287167376 18446744073709551615 134634749 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/22845/statm: 4098 3838 187 398 0 3698 0
[pid=22843/tid=22852] ppid=22527 vsize=331696 CPUtime=0 cores=0,2,4,6
/proc/22843/task/22852/stat : 22852 (python) S 22527 22527 21589 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 850228210 339656704 7600 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554946 18446604452981156544 0 0 -1 6 0 0 0
[pid=22920] ppid=22527 vsize=341952 CPUtime=0 cores=0,2,4,6
/proc/22920/stat : 22920 (python) S 22527 22527 21589 0 -1 4202560 750 0 0 0 0 0 0 0 19 0 1 0 850237462 350158848 7529 33554432000 4194304 5683644 140736564337600 18446744073709551615 212039675462 0 0 16781312 33554946 7775462871164485889 0 0 17 6 0 0 0
/proc/22920/statm: 85488 7529 316 364 0 20360 0
[pid=22922] ppid=22920 vsize=8460204 CPUtime=0.03 cores=0,2,4,6
/proc/22922/stat : 22922 (java) S 22920 22922 22922 0 -1 4202496 3826 0 1 0 3 0 0 0 20 0 13 0 850237463 8663248896 3278 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051458021 0 0 0 16800971 18446744073709551615 0 0 17 6 0 0 0
/proc/22922/statm: 2115051 3279 1685 9 0 2105799 0
[pid=22922/tid=22923] ppid=22920 vsize=8462260 CPUtime=0.03 cores=0,2,4,6
/proc/22922/task/22923/stat : 22923 (java) R 22920 22922 22922 0 -1 4202560 2495 0 1 0 3 0 0 0 19 0 15 0 850237464 8665354240 3361 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212039608631 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=22922/tid=22924] ppid=22920 vsize=8462260 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22924/stat : 22924 (java) S 22920 22922 22922 0 -1 4202560 2 0 0 0 0 0 0 0 22 0 15 0 850237464 8665354240 3361 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 6 0 0 0
[pid=22922/tid=22925] ppid=22920 vsize=8462260 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22925/stat : 22925 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 15 0 850237464 8665354240 3361 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 6 0 0 0
[pid=22922/tid=22926] ppid=22920 vsize=8462260 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22926/stat : 22926 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 15 0 850237464 8665354240 3361 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 6 0 0 0
[pid=22922/tid=22927] ppid=22920 vsize=8462260 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22927/stat : 22927 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 15 0 850237464 8665354240 3362 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22928] ppid=22920 vsize=8462260 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22928/stat : 22928 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 15 0 850237464 8665354240 3363 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22929] ppid=22920 vsize=8463288 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22929/stat : 22929 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 15 0 850237464 8666406912 3365 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22930] ppid=22920 vsize=8463288 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22930/stat : 22930 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 16 0 850237464 8666406912 3366 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22931] ppid=22920 vsize=8463288 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22931/stat : 22931 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 16 0 850237464 8666406912 3368 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22932] ppid=22920 vsize=8464316 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22932/stat : 22932 (java) S 22920 22922 22922 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 17 0 850237466 8667459584 3372 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471872 0 0 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22933] ppid=22920 vsize=8464316 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22933/stat : 22933 (java) S 22920 22922 22922 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 17 0 850237466 8667459584 3373 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22934] ppid=22920 vsize=8464316 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22934/stat : 22934 (java) S 22920 22922 22922 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 17 0 850237466 8667459584 3373 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22935] ppid=22920 vsize=8464316 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22935/stat : 22935 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 17 0 850237469 8667459584 3378 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051478961 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22936] ppid=22920 vsize=8464316 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22936/stat : 22936 (java) S 22920 22922 22922 0 -1 4202560 22 0 0 0 0 0 0 0 20 0 17 0 850237469 8667459584 3383 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22937] ppid=22920 vsize=8465344 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22937/stat : 22937 (java) S 22920 22922 22922 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 850237469 8668512256 3385 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22938] ppid=22920 vsize=8465344 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22938/stat : 22938 (java) S 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 850237469 8668512256 3385 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 212051471257 0 4 0 16800975 18446604451014796352 0 0 -1 0 0 0 0
[pid=22922/tid=22939] ppid=22920 vsize=8465344 CPUtime=0 cores=0,2,4,6
/proc/22922/task/22939/stat : 22939 (java) R 22920 22922 22922 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 850237469 8668512256 3385 33554432000 1073741824 1073778376 140736497458816 18446744073709551615 47913755088023 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22535/stat : 22535 (python) S 22525 22527 21589 0 -1 4202560 32 1450 0 0 0 0 14 2 18 0 7 0 850199783 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22635] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22635/stat : 22635 (python) S 22525 22527 21589 0 -1 4202560 36 1450 0 0 0 0 14 2 18 0 7 0 850204436 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 4 0 0 0
[pid=22527/tid=22662] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22662/stat : 22662 (python) S 22525 22527 21589 0 -1 4202560 29 1450 0 0 0 0 14 2 20 0 7 0 850209135 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22799] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22799/stat : 22799 (python) S 22525 22527 21589 0 -1 4202560 28 1450 0 0 0 0 14 2 20 0 7 0 850214219 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 6 0 0 0
[pid=22527/tid=22844] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22844/stat : 22844 (python) S 22525 22527 21589 0 -1 4202560 28 1450 0 0 0 0 14 2 20 0 7 0 850218951 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 2 0 0 0
[pid=22527/tid=22921] ppid=22525 vsize=352196 CPUtime=0.16 cores=0,2,4,6
/proc/22527/task/22921/stat : 22921 (python) S 22525 22527 21589 0 -1 4202560 31 1450 0 0 0 0 14 2 20 0 7 0 850237462 360648704 9099 33554432000 4194304 5683644 140736564337600 18446744073709551615 212051478961 0 0 16781312 33554434 18446604444491713536 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 382.29
Current children cumulated vsize (KiB) 19802096

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22527 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=273806
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=152976
# CPU time returned by wait4() is 1.42678
# while last known CPU time is 382.29
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 378.393
CPU time (s): 382.29
CPU user time (s): 379.39
CPU system time (s): 2.9
CPU usage (%): 101.03
Max. virtual memory (cumulated for all children) (KiB): 19802096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.27381
system time used= 0.152976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20708
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7477
involuntary context switches= 43

runsolver used 2.91756 second user time and 6.30204 second system time

The end

Launcher Data 

Begin job on node146 at 2011-06-09 02:03:53
IDJOB=3481445
IDBENCH=48112
IDSOLVER=1970
FILE ID=node146/3481445-1307577833
RUNJOBID= node146-1307576353-21610
PBS_JOBID= 13547653
Free space on /tmp= 73788 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_25_1.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481445-1307577833/watcher-3481445-1307577833 -o /tmp/evaluation-result-3481445-1307577833/solver-3481445-1307577833 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481445-1307577833.opb -seed 772710201 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 93a95f0846e71f0984a2317cf811edef
RANDOM SEED=772710201

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30297028 kB
Buffers:        162728 kB
Cached:         609084 kB
SwapCached:      15612 kB
Active:        2065640 kB
Inactive:       267028 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30297028 kB
SwapTotal:    67111528 kB
SwapFree:     39903648 kB
Dirty:          106772 kB
Writeback:           0 kB
AnonPages:     1558000 kB
Mapped:          38748 kB
Slab:           146556 kB
PageTables:     104304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 163265928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73596 MiB
End job on node146 at 2011-06-09 02:10:14