Trace number 3481582

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 383.45 379.023

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_1000_25_3.opb
MD5SUMd792065ec5adca4c7f7b540f15bc8ce9
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-124
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -149
Optimality of the best value was proved NO
Number of variables2000
Total number of constraints3001
Number of constraints which are clauses1000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2001
Minimum length of a constraint2
Maximum length of a constraint2000
Number of terms in the objective function 1000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1000
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 2000
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)63244
Sum of products size (including duplicates)126488
Number of different products31622
Sum of products size63244

Solver Data 

0.35/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.35/0.69	c INFO: solving HOME/instance-3481582-1307578343.opb
0.84/1.17	c INFO: wrote linearized instance to HOME/tmpleDM7J.opb
1.23/1.64	c INFO: parsing took 0.46 s
2.22/2.59	c INFO: features took 0.95 CPU seconds
2.32/2.62	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.10)
49.07/49.28	c INFO: running wbo1.4a@0 for 45 with 1751 remaining (b = 0.02)
95.31/95.25	c INFO: running scip-2.0.1-clp@0 for 45 with 1705 remaining (b = 0.01)
143.94/143.89	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1657 remaining (b = 0.01)
192.52/190.10	c INFO: running clasp-1.3.7@0 for 91 with 1609 remaining (b = 0.01)
285.06/282.35	c INFO: running scip-2.0.1-spx@46 for 45 with 1517 remaining (b = 0.01)
334.48/331.60	c INFO: running scip-2.0.1-clp@48 for 45 with 1468 remaining (b = 0.01)
381.02/377.82	c INFO: running sat4j-pb-v20101225@0 for 91 with 1422 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481582-1307578343/watcher-3481582-1307578343 -o /tmp/evaluation-result-3481582-1307578343/solver-3481582-1307578343 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481582-1307578343.opb -seed 1938912779 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.15 2.12 1.81 2/641 23852
/proc/meminfo: memFree=18841572/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/23852/stat : 23852 (python) R 23850 23852 23050 0 -1 4202496 923 0 0 0 0 0 0 0 25 0 1 0 869432264 16154624 802 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550533477 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23852/statm: 3944 807 356 364 0 431 0

[startup+0.07837 s]
/proc/loadavg: 2.15 2.12 1.81 2/641 23852
/proc/meminfo: memFree=18841572/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=45684 CPUtime=0.03 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 1889 0 0 0 3 0 0 0 25 0 1 0 869432264 46780416 1662 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 2 0 0 0
/proc/23852/statm: 11421 1662 470 364 0 1170 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 45684

[startup+0.100377 s]
/proc/loadavg: 2.15 2.12 1.81 2/641 23852
/proc/meminfo: memFree=18841572/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=85620 CPUtime=0.05 cores=0,2,4,6
/proc/23852/stat : 23852 (python) R 23850 23852 23050 0 -1 4202496 2663 0 0 0 4 1 0 0 18 0 1 0 869432264 87674880 2382 33554432000 4194304 5683644 140734237179712 18446744073709551615 4900656 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23852/statm: 21405 2382 715 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.300298 s]
/proc/loadavg: 2.15 2.12 1.81 2/641 23852
/proc/meminfo: memFree=18841572/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=123744 CPUtime=0.15 cores=0,2,4,6
/proc/23852/stat : 23852 (python) R 23850 23852 23050 0 -1 4202496 5361 928 1 0 11 4 0 0 17 0 1 0 869432264 126713856 3746 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550533637 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23852/statm: 30936 3746 987 364 0 2768 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123744

[startup+0.700269 s]
/proc/loadavg: 2.15 2.12 1.81 2/641 23852
/proc/meminfo: memFree=18841572/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=282404 CPUtime=0.42 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 9183 928 1 0 32 10 0 0 17 0 1 0 869432264 289181696 6938 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557711 0 0 16781312 2 4294934786 0 0 17 2 0 0 0
/proc/23852/statm: 70601 6938 1777 364 0 5494 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 282404

[startup+1.50111 s]
/proc/loadavg: 2.14 2.12 1.81 4/643 23858
/proc/meminfo: memFree=18815516/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=299640 CPUtime=1.23 cores=0,2,4,6
/proc/23852/stat : 23852 (python) R 23850 23852 23050 0 -1 4202496 15130 1544 1 0 65 12 46 0 18 0 1 0 869432264 306831360 11125 33554432000 4194304 5683644 140734237179712 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/23852/statm: 74910 11125 1782 364 0 9803 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 299640

[startup+3.10083 s]
/proc/loadavg: 2.14 2.12 1.81 3/645 23861
/proc/meminfo: memFree=18764020/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=312440 CPUtime=2.34 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 20666 1544 1 0 176 12 46 0 22 0 2 0 869432264 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 78110 11950 1871 364 0 12997 0
[pid=23859] ppid=23852 vsize=302196 CPUtime=0 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 690 0 0 0 0 0 0 0 18 0 1 0 869432526 309448704 10393 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557711 0 0 16781312 33554946 4389388514165227779 0 0 17 2 0 0 0
/proc/23859/statm: 75549 10393 318 364 0 10436 0
[pid=23861] ppid=23859 vsize=112496 CPUtime=0.47 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) R 23859 23861 23861 0 -1 4202496 26242 0 0 0 43 4 0 0 25 0 1 0 869432526 115195904 25559 33554432000 4194304 13684479 140737112101792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23861/statm: 28124 25559 591 2317 0 25802 0
[pid=23852/tid=23860] ppid=23850 vsize=312440 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 2 0 869432526 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.81
Current children cumulated vsize (KiB) 727132

[startup+6.30125 s]
/proc/loadavg: 2.13 2.11 1.81 3/645 23861
/proc/meminfo: memFree=18517016/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=312440 CPUtime=2.34 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 20666 1544 1 0 176 12 46 0 22 0 2 0 869432264 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 78110 11950 1871 364 0 12997 0
[pid=23859] ppid=23852 vsize=302196 CPUtime=0.01 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 845 0 0 0 0 1 0 0 15 0 1 0 869432526 309448704 10417 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557711 0 0 16781312 33554946 11391944562688622851 0 0 17 6 0 0 0
/proc/23859/statm: 75549 10417 342 364 0 10436 0
[pid=23861] ppid=23859 vsize=300600 CPUtime=3.66 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) R 23859 23861 23861 0 -1 4202496 73760 0 0 0 350 16 0 0 25 0 1 0 869432526 307814400 69864 33554432000 4194304 13684479 140737112101792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23861/statm: 75150 69864 844 2317 0 72828 0
[pid=23852/tid=23860] ppid=23850 vsize=312440 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 2 0 869432526 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 915236

[startup+12.7191 s]
/proc/loadavg: 2.12 2.11 1.81 3/645 23862
/proc/meminfo: memFree=18506492/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=312440 CPUtime=2.34 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 20666 1544 1 0 176 12 46 0 22 0 2 0 869432264 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 78110 11950 1871 364 0 12997 0
[pid=23859] ppid=23852 vsize=302196 CPUtime=0.04 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 849 0 0 0 2 2 0 0 15 0 1 0 869432526 309448704 10417 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557711 0 0 16781312 33554946 72556772316949184 0 0 17 6 0 0 0
/proc/23859/statm: 75549 10417 342 364 0 10436 0
[pid=23861] ppid=23859 vsize=310800 CPUtime=10.08 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) R 23859 23861 23861 0 -1 4202496 76084 0 0 0 991 17 0 0 25 0 1 0 869432526 318259200 72020 33554432000 4194304 13684479 140737112101792 18446744073709551615 7390778 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23861/statm: 77700 72020 775 2317 0 75378 0
[pid=23852/tid=23860] ppid=23850 vsize=312440 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 2 0 869432526 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 925436

[startup+25.5007 s]
/proc/loadavg: 2.10 2.11 1.82 4/645 23862
/proc/meminfo: memFree=18489116/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=312440 CPUtime=2.34 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 20666 1544 1 0 176 12 46 0 22 0 2 0 869432264 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 78110 11950 1871 364 0 12997 0
[pid=23859] ppid=23852 vsize=302196 CPUtime=0.09 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 857 0 0 0 5 4 0 0 15 0 1 0 869432526 309448704 10417 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557711 0 0 16781312 33554946 72556772316949184 0 0 17 6 0 0 0
/proc/23859/statm: 75549 10417 342 364 0 10436 0
[pid=23861] ppid=23859 vsize=310800 CPUtime=22.86 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) R 23859 23861 23861 0 -1 4202496 76223 0 0 0 2268 18 0 0 25 0 1 0 869432526 318259200 72105 33554432000 4194304 13684479 140737112101792 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23861/statm: 77700 72105 746 2317 0 75378 0
[pid=23852/tid=23860] ppid=23850 vsize=312440 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 2 0 869432526 319938560 11950 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.29
Current children cumulated vsize (KiB) 925436

[startup+51.1011 s]
/proc/loadavg: 2.06 2.10 1.82 3/649 23867
/proc/meminfo: memFree=18436408/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=322696 CPUtime=2.37 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 21545 1544 1 0 178 13 46 0 20 0 3 0 869432264 330440704 11957 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 80674 11957 1874 364 0 15558 0
[pid=23859] ppid=23852 vsize=312440 CPUtime=0.19 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 1061 0 0 0 10 9 0 0 16 0 2 0 869432526 319938560 10485 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23859/statm: 78110 10485 405 364 0 12997 0
[pid=23861] ppid=23859 vsize=324016 CPUtime=46.62 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) T 23859 23861 23861 0 -1 4202496 86696 0 0 0 4641 21 0 0 25 0 1 0 869432526 331792384 76211 33554432000 4194304 13684479 140737112101792 18446744073709551615 7391621 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/23861/statm: 81004 76211 768 2317 0 78682 0
[pid=23859/tid=23863] ppid=23852 vsize=312440 CPUtime=0 cores=0,2,4,6
/proc/23859/task/23863/stat : 23863 (python) S 23852 23852 23050 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869437190 319938560 10485 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604449437037696 0 0 -1 6 0 0 0
[pid=23864] ppid=23852 vsize=312452 CPUtime=0 cores=0,2,4,6
/proc/23864/stat : 23864 (python) S 23852 23852 23050 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 869437192 319950848 10398 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557766 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/23864/statm: 78113 10398 319 364 0 12997 0
[pid=23866] ppid=23864 vsize=24236 CPUtime=1.81 cores=0,2,4,6
/proc/23866/stat : 23866 (wbo1.4a) R 23864 23866 23866 0 -1 4202496 7127 0 0 0 181 0 0 0 25 0 1 0 869437192 24817664 5361 33554432000 134512640 135751879 4294464672 18446744073709551615 134606387 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/23866/statm: 6059 5361 146 303 0 5754 0
[pid=23852/tid=23860] ppid=23850 vsize=322696 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 3 0 869432526 330440704 11957 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23865] ppid=23850 vsize=322696 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23865/stat : 23865 (python) S 23850 23852 23050 0 -1 4202560 29 1544 0 0 0 0 46 0 20 0 3 0 869437192 330440704 11957 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.99
Current children cumulated vsize (KiB) 1295840

[startup+102.301 s]
/proc/loadavg: 2.13 2.11 1.84 3/653 23872
/proc/meminfo: memFree=18064624/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=332952 CPUtime=2.4 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 22436 1544 1 0 181 13 46 0 20 0 4 0 869432264 340942848 11963 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/23852/statm: 83238 11963 1876 364 0 18119 0
[pid=23859] ppid=23852 vsize=312440 CPUtime=0.19 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 1061 0 0 0 10 9 0 0 16 0 2 0 869432526 319938560 10485 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23859/statm: 78110 10485 405 364 0 12997 0
[pid=23861] ppid=23859 vsize=324016 CPUtime=46.62 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) T 23859 23861 23861 0 -1 4202496 86696 0 0 0 4641 21 0 0 25 0 1 0 869432526 331792384 76211 33554432000 4194304 13684479 140737112101792 18446744073709551615 7391621 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/23861/statm: 81004 76211 768 2317 0 78682 0
[pid=23859/tid=23863] ppid=23852 vsize=312440 CPUtime=0 cores=0,2,4,6
/proc/23859/task/23863/stat : 23863 (python) S 23852 23852 23050 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869437190 319938560 10485 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604449437037696 0 0 -1 6 0 0 0
[pid=23864] ppid=23852 vsize=312452 CPUtime=0.19 cores=0,2,4,6
/proc/23864/stat : 23864 (python) S 23852 23852 23050 0 -1 4202560 1114 0 0 0 10 9 0 0 16 0 2 0 869437192 319950848 10470 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/23864/statm: 78113 10470 390 364 0 12997 0
[pid=23866] ppid=23864 vsize=77940 CPUtime=45.94 cores=0,2,4,6
/proc/23866/stat : 23866 (wbo1.4a) T 23864 23866 23866 0 -1 4202496 21101 0 0 0 4587 7 0 0 25 0 1 0 869437192 79810560 18795 33554432000 134512640 135751879 4294464672 18446744073709551615 134606387 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/23866/statm: 19485 18795 146 303 0 19180 0
[pid=23864/tid=23869] ppid=23852 vsize=312452 CPUtime=0 cores=0,2,4,6
/proc/23864/task/23869/stat : 23869 (python) S 23852 23852 23050 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869441787 319950848 10470 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604442474268800 0 0 -1 4 0 0 0
[pid=23870] ppid=23852 vsize=322708 CPUtime=0.01 cores=0,2,4,6
/proc/23870/stat : 23870 (python) S 23852 23852 23050 0 -1 4202560 904 0 0 0 1 0 0 0 15 0 1 0 869441790 330452992 10426 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557766 0 0 16781312 33554946 3151777470026318081 0 0 17 4 0 0 0
/proc/23870/statm: 80677 10426 343 364 0 15558 0
[pid=23872] ppid=23870 vsize=289152 CPUtime=7.01 cores=0,2,4,6
/proc/23872/stat : 23872 (scip-2.0.1.linu) R 23870 23872 23872 0 -1 4202496 76494 0 0 0 686 15 0 0 25 0 1 0 869441790 296091648 62311 33554432000 4194304 15243407 140736911745792 18446744073709551615 6953074 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/23872/statm: 72288 62311 823 2698 0 69583 0
[pid=23852/tid=23860] ppid=23850 vsize=332952 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 25 1544 0 0 0 0 46 0 22 0 4 0 869432526 340942848 11963 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23865] ppid=23850 vsize=332952 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23865/stat : 23865 (python) S 23850 23852 23050 0 -1 4202560 29 1544 0 0 0 0 46 0 20 0 4 0 869437192 340942848 11963 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=23852/tid=23865] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23865/stat : 23865 (python) S 23850 23852 23050 0 -1 4202560 29 1544 0 0 0 0 46 0 20 0 7 0 869437192 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23871] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23871/stat : 23871 (python) S 23850 23852 23050 0 -1 4202560 32 1544 0 0 0 0 46 0 18 0 7 0 869441790 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23876] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23876/stat : 23876 (python) S 23850 23852 23050 0 -1 4202560 28 1544 0 0 0 0 46 0 20 0 7 0 869446653 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23899] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23899/stat : 23899 (python) S 23850 23852 23050 0 -1 4202560 30 1544 0 0 0 0 46 0 20 0 7 0 869451274 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 2 0 0 0
[pid=23852/tid=23908] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23908/stat : 23908 (python) S 23850 23852 23050 0 -1 4202560 26 1544 0 0 0 0 46 0 20 0 7 0 869470047 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 383.45
Current children cumulated vsize (KiB) 20214884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+378.904 s]
/proc/loadavg: 2.00 2.05 1.87 6/701 23927
/proc/meminfo: memFree=16246364/32951124 swapFree=55639044/67111528
[pid=23852] ppid=23850 vsize=363720 CPUtime=2.53 cores=0,2,4,6
/proc/23852/stat : 23852 (python) S 23850 23852 23050 0 -1 4202496 25296 1544 1 0 193 14 46 0 19 0 7 0 869432264 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/23852/statm: 90930 11981 1882 364 0 25802 0
[pid=23859] ppid=23852 vsize=312440 CPUtime=0.41 cores=0,2,4,6
/proc/23859/stat : 23859 (python) S 23852 23852 23050 0 -1 4202560 1086 0 0 0 20 21 0 0 15 0 2 0 869432526 319938560 10486 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23859/statm: 78110 10486 406 364 0 12997 0
[pid=23861] ppid=23859 vsize=331544 CPUtime=95.85 cores=0,2,4,6
/proc/23861/stat : 23861 (scip-2.0.1.linu) T 23859 23861 23861 0 -1 4202496 89124 0 0 0 9561 24 0 0 25 0 1 0 869432526 339501056 78620 33554432000 4194304 13684479 140737112101792 18446744073709551615 7019326 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/23861/statm: 82886 78620 749 2317 0 80564 0
[pid=23859/tid=23863] ppid=23852 vsize=312440 CPUtime=0 cores=0,2,4,6
/proc/23859/task/23863/stat : 23863 (python) S 23852 23852 23050 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 869437190 319938560 10486 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604449437037696 0 0 -1 6 0 0 0
[pid=23864] ppid=23852 vsize=312452 CPUtime=0.19 cores=0,2,4,6
/proc/23864/stat : 23864 (python) S 23852 23852 23050 0 -1 4202560 1114 0 0 0 10 9 0 0 16 0 2 0 869437192 319950848 10470 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/23864/statm: 78113 10470 390 364 0 12997 0
[pid=23866] ppid=23864 vsize=77940 CPUtime=45.94 cores=0,2,4,6
/proc/23866/stat : 23866 (wbo1.4a) T 23864 23866 23866 0 -1 4202496 21101 0 0 0 4587 7 0 0 25 0 1 0 869437192 79810560 18795 33554432000 134512640 135751879 4294464672 18446744073709551615 134606387 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/23866/statm: 19485 18795 146 303 0 19180 0
[pid=23864/tid=23869] ppid=23852 vsize=312452 CPUtime=0 cores=0,2,4,6
/proc/23864/task/23869/stat : 23869 (python) S 23852 23852 23050 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869441787 319950848 10470 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604442474268800 0 0 -1 4 0 0 0
[pid=23870] ppid=23852 vsize=322708 CPUtime=0.4 cores=0,2,4,6
/proc/23870/stat : 23870 (python) S 23852 23852 23050 0 -1 4202560 1140 0 0 0 20 20 0 0 15 0 2 0 869441790 330452992 10474 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/23870/statm: 80677 10474 390 364 0 15558 0
[pid=23872] ppid=23870 vsize=302452 CPUtime=94.68 cores=0,2,4,6
/proc/23872/stat : 23872 (scip-2.0.1.linu) T 23870 23872 23872 0 -1 4202496 254848 0 0 0 9424 44 0 0 25 0 1 0 869441790 309710848 63603 33554432000 4194304 15243407 140736911745792 18446744073709551615 6951780 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/23872/statm: 75613 63603 837 2698 0 72908 0
[pid=23870/tid=23874] ppid=23852 vsize=322708 CPUtime=0 cores=0,2,4,6
/proc/23870/task/23874/stat : 23874 (python) S 23852 23852 23050 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869446651 330452992 10474 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604441388949632 0 0 -1 4 0 0 0
[pid=23875] ppid=23852 vsize=332964 CPUtime=0.21 cores=0,2,4,6
/proc/23875/stat : 23875 (python) S 23852 23852 23050 0 -1 4202560 1152 0 0 0 11 10 0 0 16 0 2 0 869446653 340955136 10478 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/23875/statm: 83241 10478 390 364 0 18119 0
[pid=23877] ppid=23875 vsize=8542672 CPUtime=48.37 cores=0,2,4,6
/proc/23877/stat : 23877 (java) T 23875 23877 23877 0 -1 4202496 291194 0 1 0 4802 35 0 0 18 0 19 0 869446654 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23877/statm: 2135668 288017 2249 9 0 2126409 0
[pid=23877/tid=23878] ppid=23875 vsize=8542672 CPUtime=45.95 cores=0,2,4,6
/proc/23877/task/23878/stat : 23878 (java) T 23875 23877 23877 0 -1 4202560 233827 0 1 0 4568 27 0 0 25 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 46912505216229 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23879] ppid=23875 vsize=8542672 CPUtime=0.09 cores=0,2,4,6
/proc/23877/task/23879/stat : 23879 (java) T 23875 23877 23877 0 -1 4202560 6994 0 0 0 9 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23877/tid=23880] ppid=23875 vsize=8542672 CPUtime=0.08 cores=0,2,4,6
/proc/23877/task/23880/stat : 23880 (java) T 23875 23877 23877 0 -1 4202560 5759 0 0 0 7 1 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23877/tid=23881] ppid=23875 vsize=8542672 CPUtime=0.03 cores=0,2,4,6
/proc/23877/task/23881/stat : 23881 (java) T 23875 23877 23877 0 -1 4202560 3003 0 0 0 3 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23877/tid=23882] ppid=23875 vsize=8542672 CPUtime=0.05 cores=0,2,4,6
/proc/23877/task/23882/stat : 23882 (java) T 23875 23877 23877 0 -1 4202560 4249 0 0 0 5 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23883] ppid=23875 vsize=8542672 CPUtime=0.09 cores=0,2,4,6
/proc/23877/task/23883/stat : 23883 (java) T 23875 23877 23877 0 -1 4202560 7052 0 0 0 9 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23877/tid=23884] ppid=23875 vsize=8542672 CPUtime=0.08 cores=0,2,4,6
/proc/23877/task/23884/stat : 23884 (java) T 23875 23877 23877 0 -1 4202560 6232 0 0 0 8 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23877/tid=23885] ppid=23875 vsize=8542672 CPUtime=0.1 cores=0,2,4,6
/proc/23877/task/23885/stat : 23885 (java) T 23875 23877 23877 0 -1 4202560 6118 0 0 0 10 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23877/tid=23886] ppid=23875 vsize=8542672 CPUtime=0.09 cores=0,2,4,6
/proc/23877/task/23886/stat : 23886 (java) T 23875 23877 23877 0 -1 4202560 6326 0 0 0 9 0 0 0 15 0 19 0 869446655 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23877/tid=23887] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23887/stat : 23887 (java) T 23875 23877 23877 0 -1 4202560 966 0 0 0 0 0 0 0 15 0 19 0 869446656 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562354176 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23888] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23888/stat : 23888 (java) T 23875 23877 23877 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869446657 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23889] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23889/stat : 23889 (java) T 23875 23877 23877 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869446657 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23890] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23890/stat : 23890 (java) T 23875 23877 23877 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869446659 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562361265 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23891] ppid=23875 vsize=8542672 CPUtime=0.89 cores=0,2,4,6
/proc/23877/task/23891/stat : 23891 (java) T 23875 23877 23877 0 -1 4202560 3770 0 0 0 89 0 0 0 15 0 19 0 869446659 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23877/tid=23892] ppid=23875 vsize=8542672 CPUtime=0.81 cores=0,2,4,6
/proc/23877/task/23892/stat : 23892 (java) T 23875 23877 23877 0 -1 4202560 5498 0 0 0 80 1 0 0 15 0 19 0 869446659 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=23877/tid=23893] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23893/stat : 23893 (java) T 23875 23877 23877 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869446659 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562353561 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=23877/tid=23894] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23894/stat : 23894 (java) T 23875 23877 23877 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869446659 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=23877/tid=23895] ppid=23875 vsize=8542672 CPUtime=0 cores=0,2,4,6
/proc/23877/task/23895/stat : 23895 (java) T 23875 23877 23877 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869446735 8747696128 288017 33554432000 1073741824 1073778376 140735146366464 18446744073709551615 271562354176 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=23875/tid=23897] ppid=23852 vsize=332964 CPUtime=0 cores=0,2,4,6
/proc/23875/task/23897/stat : 23897 (python) S 23852 23852 23050 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869451271 340955136 10478 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604446691247360 0 0 -1 0 0 0 0
[pid=23898] ppid=23852 vsize=343220 CPUtime=0.37 cores=0,2,4,6
/proc/23898/stat : 23898 (python) S 23852 23852 23050 0 -1 4202560 1219 0 0 0 19 18 0 0 17 0 2 0 869451274 351457280 10488 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562364363 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/23898/statm: 85805 10488 396 364 0 20680 0
[pid=23900] ppid=23898 vsize=77288 CPUtime=92.09 cores=0,2,4,6
/proc/23900/stat : 23900 (clasp-1.3.7-x86) T 23898 23900 23900 0 -1 4202496 19652 0 0 0 9207 2 0 0 25 0 1 0 869451274 79142912 18647 33554432000 134512640 136139019 4286837920 18446744073709551615 134640605 0 0 16781312 16386 18446744071562691360 0 0 17 2 0 0 0
/proc/23900/statm: 19322 18647 189 398 0 18922 0
[pid=23898/tid=23904] ppid=23852 vsize=343220 CPUtime=0 cores=0,2,4,6
/proc/23898/task/23904/stat : 23904 (python) S 23852 23852 23050 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869460497 351457280 10488 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554946 18446604451701872640 0 0 -1 4 0 0 0
[pid=23907] ppid=23852 vsize=353476 CPUtime=0 cores=0,2,4,6
/proc/23907/stat : 23907 (python) S 23852 23852 23050 0 -1 4202560 788 0 0 0 0 0 0 0 15 0 1 0 869470046 361959424 10414 33554432000 4194304 5683644 140734237179712 18446744073709551615 271550557766 0 0 16781312 33554946 375750097268375552 0 0 17 6 0 0 0
/proc/23907/statm: 88369 10414 319 364 0 23241 0
[pid=23909] ppid=23907 vsize=8542008 CPUtime=2.41 cores=0,2,4,6
/proc/23909/stat : 23909 (java) S 23907 23909 23909 0 -1 4202496 82253 0 1 0 230 11 0 0 20 0 19 0 869470047 8747016192 79151 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562340325 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23909/statm: 2135502 79152 2244 9 0 2126243 0
[pid=23909/tid=23910] ppid=23907 vsize=8542008 CPUtime=1.02 cores=0,2,4,6
/proc/23909/task/23910/stat : 23910 (java) R 23907 23909 23909 0 -1 4202560 60974 0 1 0 95 7 0 0 19 0 19 0 869470048 8747016192 79447 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 46912506014068 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23909/tid=23911] ppid=23907 vsize=8542008 CPUtime=0.04 cores=0,2,4,6
/proc/23909/task/23911/stat : 23911 (java) S 23907 23909 23909 0 -1 4202560 3519 0 0 0 4 0 0 0 16 0 19 0 869470048 8747016192 79449 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 2 0 0 0
[pid=23909/tid=23912] ppid=23907 vsize=8542008 CPUtime=0.04 cores=0,2,4,6
/proc/23909/task/23912/stat : 23912 (java) S 23907 23909 23909 0 -1 4202560 3371 0 0 0 4 0 0 0 16 0 19 0 869470048 8747016192 79450 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 6 0 0 0
[pid=23909/tid=23913] ppid=23907 vsize=8542008 CPUtime=0.04 cores=0,2,4,6
/proc/23909/task/23913/stat : 23913 (java) S 23907 23909 23909 0 -1 4202560 3062 0 0 0 4 0 0 0 17 0 19 0 869470048 8747016192 79452 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 0 0 0 0
[pid=23909/tid=23914] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23914/stat : 23914 (java) S 23907 23909 23909 0 -1 4202560 409 0 0 0 0 0 0 0 18 0 19 0 869470048 8747016192 79454 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 6 0 0 0
[pid=23909/tid=23915] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23915/stat : 23915 (java) S 23907 23909 23909 0 -1 4202560 388 0 0 0 0 0 0 0 18 0 19 0 869470048 8747016192 79456 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 6 0 0 0
[pid=23909/tid=23916] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23916/stat : 23916 (java) S 23907 23909 23909 0 -1 4202560 3 0 0 0 0 0 0 0 18 0 19 0 869470048 8747016192 79458 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 2 0 0 0
[pid=23909/tid=23917] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23917/stat : 23917 (java) S 23907 23909 23909 0 -1 4202560 263 0 0 0 0 0 0 0 18 0 19 0 869470048 8747016192 79459 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 0 0 0 0
[pid=23909/tid=23918] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23918/stat : 23918 (java) S 23907 23909 23909 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869470048 8747016192 79460 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 6 0 0 0
[pid=23909/tid=23919] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23919/stat : 23919 (java) S 23907 23909 23909 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 19 0 869470049 8747016192 79462 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562354176 0 0 0 16800975 18446604442617088896 0 0 -1 0 0 0 0
[pid=23909/tid=23920] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23920/stat : 23920 (java) S 23907 23909 23909 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 19 0 869470050 8747016192 79465 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 0 0 0 0
[pid=23909/tid=23921] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23921/stat : 23921 (java) S 23907 23909 23909 0 -1 4202560 10 0 0 0 0 0 0 0 19 0 19 0 869470050 8747016192 79467 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 0 0 0 0
[pid=23909/tid=23922] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23922/stat : 23922 (java) S 23907 23909 23909 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869470052 8747016192 79470 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562361265 0 4 0 16800975 18446604442617088896 0 0 -1 2 0 0 0
[pid=23909/tid=23923] ppid=23907 vsize=8542008 CPUtime=0.65 cores=0,2,4,6
/proc/23909/task/23923/stat : 23923 (java) R 23907 23909 23909 0 -1 4202560 3621 0 0 0 65 0 0 0 15 0 19 0 869470052 8747016192 79473 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 47611375277314 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23909/tid=23924] ppid=23907 vsize=8542008 CPUtime=0.56 cores=0,2,4,6
/proc/23909/task/23924/stat : 23924 (java) R 23907 23909 23909 0 -1 4202560 5471 0 0 0 56 0 0 0 23 0 19 0 869470052 8747016192 79476 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23909/tid=23925] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23925/stat : 23925 (java) S 23907 23909 23909 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869470052 8747016192 79479 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562353561 0 4 0 16800975 18446604442617088896 0 0 -1 2 0 0 0
[pid=23909/tid=23926] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23926/stat : 23926 (java) R 23907 23909 23909 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869470052 8747016192 79482 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562354176 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23909/tid=23927] ppid=23907 vsize=8542008 CPUtime=0 cores=0,2,4,6
/proc/23909/task/23927/stat : 23927 (java) S 23907 23909 23909 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869470141 8747016192 79482 33554432000 1073741824 1073778376 140734379860080 18446744073709551615 271562354176 0 4 0 16800975 18446604442617088896 0 0 -1 6 0 0 0
[pid=23852/tid=23860] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23860/stat : 23860 (python) S 23850 23852 23050 0 -1 4202560 31 1544 0 0 0 0 46 0 18 0 7 0 869432526 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23865] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23865/stat : 23865 (python) S 23850 23852 23050 0 -1 4202560 29 1544 0 0 0 0 46 0 20 0 7 0 869437192 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23871] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23871/stat : 23871 (python) S 23850 23852 23050 0 -1 4202560 32 1544 0 0 0 0 46 0 18 0 7 0 869441790 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23876] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23876/stat : 23876 (python) S 23850 23852 23050 0 -1 4202560 28 1544 0 0 0 0 46 0 20 0 7 0 869446653 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 4 0 0 0
[pid=23852/tid=23899] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23899/stat : 23899 (python) S 23850 23852 23050 0 -1 4202560 30 1544 0 0 0 0 46 0 20 0 7 0 869451274 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 2 0 0 0
[pid=23852/tid=23908] ppid=23850 vsize=363720 CPUtime=0.46 cores=0,2,4,6
/proc/23852/task/23908/stat : 23908 (python) S 23850 23852 23050 0 -1 4202560 26 1544 0 0 0 0 46 0 20 0 7 0 869470047 372449280 11981 33554432000 4194304 5683644 140734237179712 18446744073709551615 271562361265 0 0 16781312 33554434 18446604453021431104 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 383.45
Current children cumulated vsize (KiB) 20214884

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23852 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=398635
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=149977
# CPU time returned by wait4() is 2.54861
# while last known CPU time is 383.45
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 379.023
CPU time (s): 383.45
CPU user time (s): 381.3
CPU system time (s): 2.15
CPU usage (%): 101.168
Max. virtual memory (cumulated for all children) (KiB): 20214884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.39864
system time used= 0.149977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26843
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26216
involuntary context switches= 25

runsolver used 2.72358 second user time and 5.84411 second system time

The end

Launcher Data 

Begin job on node133 at 2011-06-09 02:12:23
IDJOB=3481582
IDBENCH=48249
IDSOLVER=1970
FILE ID=node133/3481582-1307578343
RUNJOBID= node133-1307576356-23068
PBS_JOBID= 13547666
Free space on /tmp= 73632 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_1000_25_3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481582-1307578343/watcher-3481582-1307578343 -o /tmp/evaluation-result-3481582-1307578343/solver-3481582-1307578343 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481582-1307578343.opb -seed 1938912779 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d792065ec5adca4c7f7b540f15bc8ce9
RANDOM SEED=1938912779

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18841604 kB
Buffers:        154816 kB
Cached:         747220 kB
SwapCached:      10460 kB
Active:       13631352 kB
Inactive:       175792 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18841604 kB
SwapTotal:    67111528 kB
SwapFree:     55639044 kB
Dirty:          102532 kB
Writeback:          20 kB
AnonPages:    12902712 kB
Mapped:          79864 kB
Slab:           145728 kB
PageTables:      85484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 131954308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73532 MiB
End job on node133 at 2011-06-09 02:18:45