Trace number 3481443

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 337.05 332.897

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_1000_25_1.opb
MD5SUM0c93b84d697c3c1b68cbcf423dabc710
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark57
Best CPU time to get the best result obtained on this benchmark1798.96
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 72
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1000
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1000
Minimum length of a constraint26
Maximum length of a constraint52
Number of terms in the objective function 1000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1000
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)31640
Sum of products size (including duplicates)63280
Number of different products31640
Sum of products size63280

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.31/0.46	c INFO: solving HOME/instance-3481443-1307577833.opb
0.50/0.83	c INFO: wrote linearized instance to HOME/tmpTRY5Fd.opb
1.43/1.43	c INFO: parsing took 0.40 s
1.53/2.09	c INFO: features took 0.83 CPU seconds
1.53/2.11	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.04)
49.64/49.43	c INFO: running wbo1.4a@0 for 45 with 1751 remaining (b = 0.02)
99.94/99.58	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1701 remaining (b = 0.01)
150.33/147.31	c INFO: running clasp-1.3.7@0 for 91 with 1652 remaining (b = 0.01)
243.26/239.81	c INFO: running scip-2.0.1-clp@0 for 45 with 1560 remaining (b = 0.01)
290.78/287.11	c INFO: running scip-2.0.1-spx@46 for 45 with 1513 remaining (b = 0.00)
336.20/332.39	c INFO: running sat4j-pb-v20101225@0 for 91 with 1468 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481443-1307577833/watcher-3481443-1307577833 -o /tmp/evaluation-result-3481443-1307577833/solver-3481443-1307577833 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481443-1307577833.opb -seed 391022151 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2228
/proc/meminfo: memFree=23051844/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=15388 CPUtime=0 cores=1,3,5,7
/proc/2228/stat : 2228 (python) R 2226 2228 1117 0 -1 4202496 818 0 0 0 0 0 0 0 25 0 1 0 869383724 15757312 704 33554432000 4194304 5683644 140737223294528 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/2228/statm: 3846 705 334 364 0 333 0

[startup+0.060505 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2228
/proc/meminfo: memFree=23051844/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=36508 CPUtime=0.04 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 1620 0 0 0 3 1 0 0 25 0 1 0 869383724 37384192 1451 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640857600 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/2228/statm: 9127 1451 452 364 0 944 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36508

[startup+0.117742 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2228
/proc/meminfo: memFree=23051844/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=96128 CPUtime=0.09 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 3245 930 1 0 7 2 0 0 18 0 1 0 869383724 98435072 2484 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640857600 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/2228/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 96128

[startup+0.301435 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2228
/proc/meminfo: memFree=23051844/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=205568 CPUtime=0.22 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 6794 930 1 0 15 7 0 0 17 0 1 0 869383724 210501632 5060 33554432000 4194304 5683644 140737223294528 18446744073709551615 253635935879 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/2228/statm: 52000 5095 1498 364 0 3816 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 205568

[startup+0.700379 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2228
/proc/meminfo: memFree=23051844/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=285464 CPUtime=0.45 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 9939 930 1 0 31 14 0 0 16 0 1 0 869383724 292315136 7671 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879631 0 0 16781312 2 2288271048170274816 0 0 17 7 0 0 0
/proc/2228/statm: 71366 7671 1777 364 0 6259 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 285464

[startup+1.50021 s]
/proc/loadavg: 2.03 2.06 1.62 3/723 2234
/proc/meminfo: memFree=23028904/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=298312 CPUtime=1.53 cores=1,3,5,7
/proc/2228/stat : 2228 (python) R 2226 2228 1117 0 -1 4202496 18502 1553 1 0 98 21 24 10 17 0 1 0 869383724 305471488 10926 33554432000 4194304 5683644 140737223294528 18446744073709551615 47846660608624 0 0 16781312 33554434 0 0 0 17 7 0 0 0
/proc/2228/statm: 74578 10926 1816 364 0 9471 0
Current children cumulated CPU time (s) 1.53
Current children cumulated vsize (KiB) 298312

[startup+3.10096 s]
/proc/loadavg: 2.03 2.06 1.62 3/726 2237
/proc/meminfo: memFree=22889792/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=310084 CPUtime=2.15 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 19541 1553 1 0 160 21 24 10 20 0 2 0 869383724 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2228/statm: 77521 11361 1871 364 0 12408 0
[pid=2235] ppid=2228 vsize=299840 CPUtime=0 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 706 0 0 0 0 0 0 0 17 0 1 0 869383936 307036160 9804 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879631 0 0 16781312 33554946 17998478169522274568 0 0 17 7 0 0 0
/proc/2235/statm: 74960 9804 318 364 0 9847 0
[pid=2237] ppid=2235 vsize=171024 CPUtime=0.96 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) R 2235 2237 2237 0 -1 4202496 40309 0 0 0 89 7 0 0 19 0 1 0 869383936 175128576 39623 33554432000 4194304 13684479 140736245860800 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2237/statm: 42756 39623 586 2317 0 40434 0
[pid=2228/tid=2236] ppid=2226 vsize=310084 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 25 1553 0 0 0 0 24 10 20 0 2 0 869383936 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.11
Current children cumulated vsize (KiB) 780948

[startup+6.30138 s]
/proc/loadavg: 2.03 2.06 1.62 3/726 2237
/proc/meminfo: memFree=22690152/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=310084 CPUtime=2.15 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 19541 1553 1 0 160 21 24 10 20 0 2 0 869383724 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2228/statm: 77521 11361 1871 364 0 12408 0
[pid=2235] ppid=2228 vsize=299840 CPUtime=0.02 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 873 0 0 0 1 1 0 0 15 0 1 0 869383936 307036160 9828 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879631 0 0 16781312 33554946 4294934790 0 0 17 5 0 0 0
/proc/2235/statm: 74960 9828 342 364 0 9847 0
[pid=2237] ppid=2235 vsize=345552 CPUtime=4.16 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) R 2235 2237 2237 0 -1 4202496 87531 0 0 0 384 32 0 0 19 0 1 0 869383936 353845248 83188 33554432000 4194304 13684479 140736245860800 18446744073709551615 4368184 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2237/statm: 86388 83188 762 2317 0 84066 0
[pid=2228/tid=2236] ppid=2226 vsize=310084 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 25 1553 0 0 0 0 24 10 20 0 2 0 869383936 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.33
Current children cumulated vsize (KiB) 955476

[startup+12.7002 s]
/proc/loadavg: 2.03 2.06 1.62 3/726 2237
/proc/meminfo: memFree=22543624/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=310084 CPUtime=2.15 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 19541 1553 1 0 160 21 24 10 20 0 2 0 869383724 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2228/statm: 77521 11361 1871 364 0 12408 0
[pid=2235] ppid=2228 vsize=299840 CPUtime=0.05 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 881 0 0 0 2 3 0 0 15 0 1 0 869383936 307036160 9828 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879631 0 0 16781312 33554946 1442324411125334016 0 0 17 5 0 0 0
/proc/2235/statm: 74960 9828 342 364 0 9847 0
[pid=2237] ppid=2235 vsize=495076 CPUtime=10.57 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) R 2235 2237 2237 0 -1 4202496 124031 0 0 0 1012 45 0 0 19 0 1 0 869383936 506957824 119660 33554432000 4194304 13684479 140736245860800 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2237/statm: 123769 119660 772 2317 0 121447 0
[pid=2228/tid=2236] ppid=2226 vsize=310084 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 25 1553 0 0 0 0 24 10 20 0 2 0 869383936 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.77
Current children cumulated vsize (KiB) 1105000

[startup+25.5009 s]
/proc/loadavg: 2.09 2.07 1.63 3/726 2238
/proc/meminfo: memFree=22680640/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=310084 CPUtime=2.15 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 19541 1553 1 0 160 21 24 10 20 0 2 0 869383724 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2228/statm: 77521 11361 1871 364 0 12408 0
[pid=2235] ppid=2228 vsize=299840 CPUtime=0.12 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 888 0 0 0 6 6 0 0 15 0 1 0 869383936 307036160 9828 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879631 0 0 16781312 33554946 5623606151888251780 0 0 17 5 0 0 0
/proc/2235/statm: 74960 9828 342 364 0 9847 0
[pid=2237] ppid=2235 vsize=358520 CPUtime=23.36 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) R 2235 2237 2237 0 -1 4202496 124365 0 0 0 2275 61 0 0 25 0 1 0 869383936 367124480 86068 33554432000 4194304 13684479 140736245860800 18446744073709551615 7252890 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2237/statm: 89630 86068 792 2317 0 87308 0
[pid=2228/tid=2236] ppid=2226 vsize=310084 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 25 1553 0 0 0 0 24 10 20 0 2 0 869383936 317526016 11361 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.63
Current children cumulated vsize (KiB) 968444

[startup+51.1013 s]
/proc/loadavg: 2.06 2.06 1.64 3/730 2242
/proc/meminfo: memFree=22652012/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=320340 CPUtime=2.17 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 20462 1553 1 0 162 21 24 10 19 0 3 0 869383724 328028160 11368 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2228/statm: 80085 11368 1874 364 0 14969 0
[pid=2235] ppid=2228 vsize=310084 CPUtime=0.24 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 1103 0 0 0 11 13 0 0 17 0 2 0 869383936 317526016 9896 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2235/statm: 77521 9896 405 364 0 12408 0
[pid=2237] ppid=2235 vsize=358520 CPUtime=47.27 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) T 2235 2237 2237 0 -1 4202496 124372 0 0 0 4653 74 0 0 25 0 1 0 869383936 367124480 86075 33554432000 4194304 13684479 140736245860800 18446744073709551615 7267952 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2237/statm: 89630 86075 798 2317 0 87308 0
[pid=2235/tid=2239] ppid=2228 vsize=310084 CPUtime=0 cores=1,3,5,7
/proc/2235/task/2239/stat : 2239 (python) S 2228 2228 1117 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869388665 317526016 9896 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604470899093568 0 0 -1 7 0 0 0
[pid=2240] ppid=2228 vsize=310096 CPUtime=0 cores=1,3,5,7
/proc/2240/stat : 2240 (python) S 2228 2228 1117 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 869388667 317538304 9809 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879686 0 0 16781312 33554946 4294934790 0 0 17 7 0 0 0
/proc/2240/statm: 77524 9809 319 364 0 12408 0
[pid=2242] ppid=2240 vsize=30308 CPUtime=1.65 cores=1,3,5,7
/proc/2242/stat : 2242 (wbo1.4a) R 2240 2242 2242 0 -1 4202496 12555 0 0 0 163 2 0 0 20 0 1 0 869388668 31035392 6917 33554432000 134512640 135751879 4289406720 18446744073709551615 134611292 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/2242/statm: 7577 6917 146 303 0 7272 0
[pid=2228/tid=2236] ppid=2226 vsize=320340 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 25 1553 0 0 0 0 24 10 20 0 3 0 869383936 328028160 11368 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
[pid=2228/tid=2241] ppid=2226 vsize=320340 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2241/stat : 2241 (python) S 2226 2228 1117 0 -1 4202560 28 1553 0 0 0 0 24 10 20 0 3 0 869388668 328028160 11368 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.33
Current children cumulated vsize (KiB) 1329348

[startup+102.302 s]
/proc/loadavg: 2.02 2.05 1.66 4/752 2275
/proc/meminfo: memFree=22402444/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=330596 CPUtime=2.2 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 21385 1553 1 0 165 21 24 10 20 0 4 0 869383724 338530304 11374 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/2228/statm: 82649 11374 1876 364 0 17530 0
[pid=2235] ppid=2228 vsize=310084 CPUtime=0.24 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 1103 0 0 0 11 13 0 0 17 0 2 0 869383936 317526016 9896 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2235/statm: 77521 9896 405 364 0 12408 0
[pid=2237] ppid=2235 vsize=358520 CPUtime=47.27 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) T 2235 2237 2237 0 -1 4202496 124372 0 0 0 4653 74 0 0 25 0 1 0 869383936 367124480 86075 33554432000 4194304 13684479 140736245860800 18446744073709551615 7267952 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2237/statm: 89630 86075 798 2317 0 87308 0
[pid=2235/tid=2239] ppid=2228 vsize=310084 CPUtime=0 cores=1,3,5,7
/proc/2235/task/2239/stat : 2239 (python) S 2228 2228 1117 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869388665 317526016 9896 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604470899093568 0 0 -1 7 0 0 0
[pid=2240] ppid=2228 vsize=310096 CPUtime=0.25 cores=1,3,5,7
/proc/2240/stat : 2240 (python) S 2228 2228 1117 0 -1 4202560 1118 0 0 0 11 14 0 0 16 0 2 0 869388667 317538304 9881 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2240/statm: 77524 9881 390 364 0 12408 0
[pid=2242] ppid=2240 vsize=54588 CPUtime=50.09 cores=1,3,5,7
/proc/2242/stat : 2242 (wbo1.4a) T 2240 2242 2242 0 -1 4202496 18659 0 0 0 4992 17 0 0 25 0 1 0 869388668 55898112 13021 33554432000 134512640 135751879 4289406720 18446744073709551615 134611297 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/2242/statm: 13647 13021 146 303 0 13342 0
[pid=2240/tid=2245] ppid=2228 vsize=310096 CPUtime=0 cores=1,3,5,7
/proc/2240/task/2245/stat : 2245 (python) S 2228 2228 1117 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 869393680 317538304 9881 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604463445162048 0 0 -1 7 0 0 0
[pid=2246] ppid=2228 vsize=320352 CPUtime=0 cores=1,3,5,7
/proc/2246/stat : 2246 (python) S 2228 2228 1117 0 -1 4202560 798 0 0 0 0 0 0 0 15 0 1 0 869393683 328040448 9813 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879686 0 0 16781312 33554946 4294934788 0 0 17 5 0 0 0
/proc/2246/statm: 80088 9813 319 364 0 14969 0
[pid=2248] ppid=2246 vsize=8546828 CPUtime=4.37 cores=1,3,5,7
/proc/2248/stat : 2248 (java) S 2246 2248 2248 0 -1 4202496 93956 0 1 0 424 13 0 0 20 0 19 0 869393683 8751951872 89321 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/2248/statm: 2136707 89321 2244 9 0 2127448 0
[pid=2248/tid=2249] ppid=2246 vsize=8546828 CPUtime=2.49 cores=1,3,5,7
/proc/2248/task/2249/stat : 2249 (java) R 2246 2248 2248 0 -1 4202560 62135 0 1 0 241 8 0 0 18 0 19 0 869393684 8751951872 89321 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 46912506185726 0 4 0 16800975 0 0 0 -1 7 0 0 8
[pid=2248/tid=2250] ppid=2246 vsize=8546828 CPUtime=0.07 cores=1,3,5,7
/proc/2248/task/2250/stat : 2250 (java) S 2246 2248 2248 0 -1 4202560 5073 0 0 0 7 0 0 0 16 0 19 0 869393685 8751951872 89321 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446604463507499840 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=2228/tid=2236] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 31 1553 0 0 0 0 24 10 18 0 7 0 869383936 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
[pid=2228/tid=2241] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2241/stat : 2241 (python) S 2226 2228 1117 0 -1 4202560 28 1553 0 0 0 0 24 10 20 0 7 0 869388668 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
[pid=2228/tid=2247] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2247/stat : 2247 (python) S 2226 2228 1117 0 -1 4202560 32 1553 0 0 0 0 24 10 20 0 7 0 869393683 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 5 0 0 0
[pid=2228/tid=2279] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2279/stat : 2279 (python) S 2226 2228 1117 0 -1 4202560 30 1553 0 0 0 0 24 10 20 0 7 0 869398456 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 5 0 0 0
[pid=2228/tid=2285] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2285/stat : 2285 (python) S 2226 2228 1117 0 -1 4202560 34 1553 0 0 0 0 24 10 20 0 7 0 869407705 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 3 0 0 0
[pid=2228/tid=2292] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2292/stat : 2292 (python) S 2226 2228 1117 0 -1 4202560 26 1553 0 0 0 0 24 10 20 0 7 0 869416964 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 337.05
Current children cumulated vsize (KiB) 20211144

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+332.802 s]
/proc/loadavg: 2.09 2.08 1.75 6/781 2312
/proc/meminfo: memFree=19370796/32951124 swapFree=53733252/67111528
[pid=2228] ppid=2226 vsize=361364 CPUtime=2.3 cores=1,3,5,7
/proc/2228/stat : 2228 (python) S 2226 2228 1117 0 -1 4202496 24311 1553 1 0 174 22 24 10 19 0 7 0 869383724 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2228/statm: 90341 11392 1882 364 0 25213 0
[pid=2235] ppid=2228 vsize=310084 CPUtime=0.48 cores=1,3,5,7
/proc/2235/stat : 2235 (python) S 2228 2228 1117 0 -1 4202560 1128 0 0 0 22 26 0 0 16 0 2 0 869383936 317526016 9897 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2235/statm: 77521 9897 406 364 0 12408 0
[pid=2237] ppid=2235 vsize=363552 CPUtime=92.53 cores=1,3,5,7
/proc/2237/stat : 2237 (scip-2.0.1.linu) T 2235 2237 2237 0 -1 4202496 125643 0 0 0 9160 93 0 0 25 0 1 0 869383936 372277248 87346 33554432000 4194304 13684479 140736245860800 18446744073709551615 7129288 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2237/statm: 90888 87346 798 2317 0 88566 0
[pid=2235/tid=2239] ppid=2228 vsize=310084 CPUtime=0 cores=1,3,5,7
/proc/2235/task/2239/stat : 2239 (python) S 2228 2228 1117 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869388665 317526016 9897 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604470899093568 0 0 -1 7 0 0 0
[pid=2240] ppid=2228 vsize=310096 CPUtime=0.25 cores=1,3,5,7
/proc/2240/stat : 2240 (python) S 2228 2228 1117 0 -1 4202560 1118 0 0 0 11 14 0 0 16 0 2 0 869388667 317538304 9881 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2240/statm: 77524 9881 390 364 0 12408 0
[pid=2242] ppid=2240 vsize=54588 CPUtime=50.09 cores=1,3,5,7
/proc/2242/stat : 2242 (wbo1.4a) T 2240 2242 2242 0 -1 4202496 18659 0 0 0 4992 17 0 0 25 0 1 0 869388668 55898112 13021 33554432000 134512640 135751879 4289406720 18446744073709551615 134611297 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/2242/statm: 13647 13021 146 303 0 13342 0
[pid=2240/tid=2245] ppid=2228 vsize=310096 CPUtime=0 cores=1,3,5,7
/proc/2240/task/2245/stat : 2245 (python) S 2228 2228 1117 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 869393680 317538304 9881 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604463445162048 0 0 -1 7 0 0 0
[pid=2246] ppid=2228 vsize=320352 CPUtime=0.24 cores=1,3,5,7
/proc/2246/stat : 2246 (python) S 2228 2228 1117 0 -1 4202560 1151 0 0 0 10 14 0 0 17 0 2 0 869393683 328040448 9885 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2246/statm: 80088 9885 390 364 0 14969 0
[pid=2248] ppid=2246 vsize=8546828 CPUtime=50.03 cores=1,3,5,7
/proc/2248/stat : 2248 (java) T 2246 2248 2248 0 -1 4202496 711264 0 1 0 4928 75 0 0 18 0 19 0 869393683 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/2248/statm: 2136707 701957 2250 9 0 2127448 0
[pid=2248/tid=2249] ppid=2246 vsize=8546828 CPUtime=47.17 cores=1,3,5,7
/proc/2248/task/2249/stat : 2249 (java) T 2246 2248 2248 0 -1 4202560 632814 0 1 0 4651 66 0 0 25 0 19 0 869393684 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 46912506094540 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 8
[pid=2248/tid=2250] ppid=2246 vsize=8546828 CPUtime=0.13 cores=1,3,5,7
/proc/2248/task/2250/stat : 2250 (java) T 2246 2248 2248 0 -1 4202560 9782 0 0 0 13 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2251] ppid=2246 vsize=8546828 CPUtime=0.13 cores=1,3,5,7
/proc/2248/task/2251/stat : 2251 (java) T 2246 2248 2248 0 -1 4202560 9206 0 0 0 13 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2248/tid=2252] ppid=2246 vsize=8546828 CPUtime=0.09 cores=1,3,5,7
/proc/2248/task/2252/stat : 2252 (java) T 2246 2248 2248 0 -1 4202560 7818 0 0 0 9 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2253] ppid=2246 vsize=8546828 CPUtime=0.15 cores=1,3,5,7
/proc/2248/task/2253/stat : 2253 (java) T 2246 2248 2248 0 -1 4202560 10313 0 0 0 15 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2254] ppid=2246 vsize=8546828 CPUtime=0.13 cores=1,3,5,7
/proc/2248/task/2254/stat : 2254 (java) T 2246 2248 2248 0 -1 4202560 9868 0 0 0 12 1 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2248/tid=2255] ppid=2246 vsize=8546828 CPUtime=0.06 cores=1,3,5,7
/proc/2248/task/2255/stat : 2255 (java) T 2246 2248 2248 0 -1 4202560 4536 0 0 0 6 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2256] ppid=2246 vsize=8546828 CPUtime=0.06 cores=1,3,5,7
/proc/2248/task/2256/stat : 2256 (java) T 2246 2248 2248 0 -1 4202560 4639 0 0 0 6 0 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2248/tid=2257] ppid=2246 vsize=8546828 CPUtime=0.1 cores=1,3,5,7
/proc/2248/task/2257/stat : 2257 (java) T 2246 2248 2248 0 -1 4202560 8706 0 0 0 9 1 0 0 15 0 19 0 869393685 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2258] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2258/stat : 2258 (java) T 2246 2248 2248 0 -1 4202560 1273 0 0 0 0 0 0 0 15 0 19 0 869393686 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652676096 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2248/tid=2259] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2259/stat : 2259 (java) T 2246 2248 2248 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869393686 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2248/tid=2260] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2260/stat : 2260 (java) T 2246 2248 2248 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869393686 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2248/tid=2261] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2261/stat : 2261 (java) T 2246 2248 2248 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869393688 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652683185 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2248/tid=2271] ppid=2246 vsize=8546828 CPUtime=0.87 cores=1,3,5,7
/proc/2248/task/2271/stat : 2271 (java) T 2246 2248 2248 0 -1 4202560 5175 0 0 0 87 0 0 0 15 0 19 0 869393688 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2248/tid=2272] ppid=2246 vsize=8546828 CPUtime=1.01 cores=1,3,5,7
/proc/2248/task/2272/stat : 2272 (java) T 2246 2248 2248 0 -1 4202560 5737 0 0 0 101 0 0 0 15 0 19 0 869393688 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2248/tid=2273] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2273/stat : 2273 (java) T 2246 2248 2248 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869393688 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652675481 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2248/tid=2274] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2274/stat : 2274 (java) T 2246 2248 2248 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869393688 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652676096 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2248/tid=2275] ppid=2246 vsize=8546828 CPUtime=0 cores=1,3,5,7
/proc/2248/task/2275/stat : 2275 (java) T 2246 2248 2248 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869393766 8751951872 701957 33554432000 1073741824 1073778376 140733640247440 18446744073709551615 253652676096 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2246/tid=2277] ppid=2228 vsize=320352 CPUtime=0 cores=1,3,5,7
/proc/2246/task/2277/stat : 2277 (python) S 2228 2228 1117 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869398453 328040448 9885 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604461646873792 0 0 -1 7 0 0 0
[pid=2278] ppid=2228 vsize=330608 CPUtime=0.45 cores=1,3,5,7
/proc/2278/stat : 2278 (python) S 2228 2228 1117 0 -1 4202560 1168 0 0 0 22 23 0 0 17 0 2 0 869398456 338542592 9889 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/2278/statm: 82652 9889 390 364 0 17530 0
[pid=2280] ppid=2278 vsize=27524 CPUtime=92.44 cores=1,3,5,7
/proc/2280/stat : 2280 (clasp-1.3.7-x86) T 2278 2280 2280 0 -1 4202496 7608 0 0 0 9244 0 0 0 25 0 1 0 869398456 28184576 6634 33554432000 134512640 136139019 4289844016 18446744073709551615 134828746 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/2280/statm: 6881 6634 187 398 0 6481 0
[pid=2278/tid=2283] ppid=2228 vsize=330608 CPUtime=0 cores=1,3,5,7
/proc/2278/task/2283/stat : 2283 (python) S 2228 2228 1117 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869407703 338542592 9889 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604454505646976 0 0 -1 1 0 0 0
[pid=2284] ppid=2228 vsize=340864 CPUtime=0.25 cores=1,3,5,7
/proc/2284/stat : 2284 (python) S 2228 2228 1117 0 -1 4202560 1219 0 0 0 11 14 0 0 17 0 2 0 869407705 349044736 9899 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652686283 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2284/statm: 85216 9899 396 364 0 20091 0
[pid=2286] ppid=2284 vsize=357072 CPUtime=47.25 cores=1,3,5,7
/proc/2286/stat : 2286 (scip-2.0.1.linu) T 2284 2286 2286 0 -1 4202496 135310 0 0 0 4669 56 0 0 25 0 1 0 869407706 365641728 85672 33554432000 4194304 15243407 140735237267696 18446744073709551615 4973419 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/2286/statm: 89268 85672 917 2698 0 86563 0
[pid=2284/tid=2289] ppid=2228 vsize=340864 CPUtime=0 cores=1,3,5,7
/proc/2284/task/2289/stat : 2289 (python) S 2228 2228 1117 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869412433 349044736 9899 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554946 18446604455578477824 0 0 -1 7 0 0 0
[pid=2291] ppid=2228 vsize=351120 CPUtime=0 cores=1,3,5,7
/proc/2291/stat : 2291 (python) S 2228 2228 1117 0 -1 4202560 806 0 0 0 0 0 0 0 18 0 1 0 869416964 359546880 9825 33554432000 4194304 5683644 140737223294528 18446744073709551615 253640879686 0 0 16781312 33554946 1475355273727049728 0 0 17 3 0 0 0
/proc/2291/statm: 87780 9825 319 364 0 22652 0
[pid=2293] ppid=2291 vsize=8537092 CPUtime=0.74 cores=1,3,5,7
/proc/2293/stat : 2293 (java) S 2291 2293 2293 0 -1 4202496 14864 0 1 0 71 3 0 0 17 0 18 0 869416964 8741982208 12461 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652662245 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/2293/statm: 2134273 12461 2216 9 0 2125014 0
[pid=2293/tid=2294] ppid=2291 vsize=8540792 CPUtime=0.41 cores=1,3,5,7
/proc/2293/task/2294/stat : 2294 (java) R 2291 2293 2293 0 -1 4202560 6647 0 1 0 40 1 0 0 25 0 18 0 869416965 8745771008 13192 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 46912505219208 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=2293/tid=2295] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2295/stat : 2295 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869416966 8745771008 13192 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2296] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2296/stat : 2296 (java) S 2291 2293 2293 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 869416966 8745771008 13192 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2297] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2297/stat : 2297 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13193 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2298] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2298/stat : 2298 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13193 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2299] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2299/stat : 2299 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13193 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2300] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2300/stat : 2300 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13193 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2301] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2301/stat : 2301 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13194 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2302] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2302/stat : 2302 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416966 8745771008 13194 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2303] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2303/stat : 2303 (java) S 2291 2293 2293 0 -1 4202560 2 0 0 0 0 0 0 0 23 0 18 0 869416967 8745771008 13194 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652676096 0 0 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2305] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2305/stat : 2305 (java) S 2291 2293 2293 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 18 0 869416967 8745771008 13195 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2307] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2307/stat : 2307 (java) S 2291 2293 2293 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 18 0 869416967 8745771008 13195 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2308] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2308/stat : 2308 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416969 8745771008 13195 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652683185 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2309] ppid=2291 vsize=8540792 CPUtime=0.13 cores=1,3,5,7
/proc/2293/task/2309/stat : 2309 (java) R 2291 2293 2293 0 -1 4202560 1450 0 0 0 13 0 0 0 25 0 18 0 869416969 8745771008 13195 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 47876359228024 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=2293/tid=2310] ppid=2291 vsize=8540792 CPUtime=0.21 cores=1,3,5,7
/proc/2293/task/2310/stat : 2310 (java) R 2291 2293 2293 0 -1 4202560 6108 0 0 0 20 1 0 0 25 0 18 0 869416970 8745771008 13196 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 47876356284093 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=2293/tid=2311] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2311/stat : 2311 (java) S 2291 2293 2293 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416970 8745771008 13196 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652675481 0 4 0 16800975 18446604458201462720 0 0 -1 7 0 0 0
[pid=2293/tid=2312] ppid=2291 vsize=8540792 CPUtime=0 cores=1,3,5,7
/proc/2293/task/2312/stat : 2312 (java) S 2291 2293 2293 0 -1 4202560 2 0 0 0 0 0 0 0 22 0 18 0 869416970 8745771008 13196 33554432000 1073741824 1073778376 140735457047760 18446744073709551615 253652676096 0 4 0 16800975 18446604458201462720 0 0 -1 3 0 0 0
[pid=2228/tid=2236] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2236/stat : 2236 (python) S 2226 2228 1117 0 -1 4202560 31 1553 0 0 0 0 24 10 18 0 7 0 869383936 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
[pid=2228/tid=2241] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2241/stat : 2241 (python) S 2226 2228 1117 0 -1 4202560 28 1553 0 0 0 0 24 10 20 0 7 0 869388668 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 1 0 0 0
[pid=2228/tid=2247] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2247/stat : 2247 (python) S 2226 2228 1117 0 -1 4202560 32 1553 0 0 0 0 24 10 20 0 7 0 869393683 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 5 0 0 0
[pid=2228/tid=2279] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2279/stat : 2279 (python) S 2226 2228 1117 0 -1 4202560 30 1553 0 0 0 0 24 10 20 0 7 0 869398456 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 5 0 0 0
[pid=2228/tid=2285] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2285/stat : 2285 (python) S 2226 2228 1117 0 -1 4202560 34 1553 0 0 0 0 24 10 20 0 7 0 869407705 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 3 0 0 0
[pid=2228/tid=2292] ppid=2226 vsize=361364 CPUtime=0.34 cores=1,3,5,7
/proc/2228/task/2292/stat : 2292 (python) S 2226 2228 1117 0 -1 4202560 26 1553 0 0 0 0 24 10 20 0 7 0 869416964 370036736 11392 33554432000 4194304 5683644 140737223294528 18446744073709551615 253652683185 0 0 16781312 33554434 18446604454505645184 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 337.05
Current children cumulated vsize (KiB) 20211144

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2228 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=992697
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=333949
# CPU time returned by wait4() is 2.32665
# while last known CPU time is 337.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 332.897
CPU time (s): 337.05
CPU user time (s): 333.38
CPU system time (s): 3.67
CPU usage (%): 101.248
Max. virtual memory (cumulated for all children) (KiB): 20211144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.9927
system time used= 0.333949
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25867
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24989
involuntary context switches= 31

runsolver used 2.41063 second user time and 5.47117 second system time

The end

Launcher Data 

Begin job on node106 at 2011-06-09 02:03:53
IDJOB=3481443
IDBENCH=48110
IDSOLVER=1970
FILE ID=node106/3481443-1307577833
RUNJOBID= node106-1307576440-1136
PBS_JOBID= 13547699
Free space on /tmp= 73572 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_1000_25_1.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481443-1307577833/watcher-3481443-1307577833 -o /tmp/evaluation-result-3481443-1307577833/solver-3481443-1307577833 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481443-1307577833.opb -seed 391022151 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0c93b84d697c3c1b68cbcf423dabc710
RANDOM SEED=391022151

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23052008 kB
Buffers:        174636 kB
Cached:         725740 kB
SwapCached:      21548 kB
Active:        9359860 kB
Inactive:       206696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23052008 kB
SwapTotal:    67111528 kB
SwapFree:     53733252 kB
Dirty:          104888 kB
Writeback:           0 kB
AnonPages:     8663368 kB
Mapped:          91540 kB
Slab:           166412 kB
PageTables:      91788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 174522312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73472 MiB
End job on node106 at 2011-06-09 02:09:28