Trace number 3482238

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (TO) 1800.1 1789.78

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j120opt/
normalized-j12049_10.std.opb
MD5SUM447a543f878ceafadea8d85be2867299
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark97
Best CPU time to get the best result obtained on this benchmark57.5932
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints256335
Number of constraints which are clauses255135
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint68
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.32/0.47	c INFO: solving HOME/instance-3482238-1307578749.opb
1.61/1.72	c INFO: parsing took 1.23 s
4.02/4.10	c INFO: features took 2.37 CPU seconds
4.70/4.83	c INFO: running wbo1.4a@0 for 45 with 1796 remaining (b = 0.57)
50.85/50.84	c INFO: running scip-2.0.1-spx@0 for 45 with 1749 remaining (b = 0.01)
98.32/98.18	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1703 remaining (b = 0.01)
147.47/144.28	c INFO: running bsolo_pb10-l3@0 for 1655 with 1655 remaining (b = 0.08)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482238-1307578749/watcher-3482238-1307578749 -o /tmp/evaluation-result-3482238-1307578749/solver-3482238-1307578749 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482238-1307578749.opb -seed 57891206 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.28 2.27 2.02 3/682 5353
/proc/meminfo: memFree=9126608/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 935 0 0 0 0 0 0 0 21 0 1 0 850290312 16154624 814 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/5353/statm: 3945 815 356 364 0 432 0

[startup+0.043206 s]
/proc/loadavg: 2.28 2.27 2.02 3/682 5353
/proc/meminfo: memFree=9126608/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=23208 CPUtime=0.03 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 1331 0 0 0 2 1 0 0 22 0 1 0 850290312 23764992 1179 33554432000 4194304 5683644 140737178508992 18446744073709551615 254256692871 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5353/statm: 5802 1179 432 364 0 729 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23208

[startup+0.100172 s]
/proc/loadavg: 2.28 2.27 2.02 3/682 5353
/proc/meminfo: memFree=9126608/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=96128 CPUtime=0.06 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 3169 930 1 0 5 1 0 0 18 0 1 0 850290312 98435072 2484 33554432000 4194304 5683644 140737178508992 18446744073709551615 5177472 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5353/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96128

[startup+0.300212 s]
/proc/loadavg: 2.28 2.27 2.02 3/682 5353
/proc/meminfo: memFree=9126608/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=202996 CPUtime=0.22 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 6687 930 1 0 16 6 0 0 17 0 1 0 850290312 207867904 4971 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261612389 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5353/statm: 50749 4971 1472 364 0 3711 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 202996

[startup+0.701142 s]
/proc/loadavg: 2.28 2.27 2.02 3/682 5353
/proc/meminfo: memFree=9126608/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=298160 CPUtime=0.62 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 12989 930 1 0 52 10 0 0 17 0 1 0 850290312 305315840 10852 33554432000 4194304 5683644 140737178508992 18446744073709551615 4528049 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5353/statm: 74540 10852 1781 364 0 9433 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 298160

[startup+1.501 s]
/proc/loadavg: 2.26 2.27 2.02 3/683 5358
/proc/meminfo: memFree=9076940/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=328476 CPUtime=1.42 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 20240 930 1 0 131 11 0 0 18 0 1 0 850290312 336359424 18103 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261277381 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5353/statm: 82119 18103 1781 364 0 17012 0
Current children cumulated CPU time (s) 1.42
Current children cumulated vsize (KiB) 328476

[startup+3.1007 s]
/proc/loadavg: 2.26 2.27 2.02 3/683 5358
/proc/meminfo: memFree=9051272/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=335416 CPUtime=3.02 cores=0,2,4,6
/proc/5353/stat : 5353 (python) R 5351 5353 2733 0 -1 4202496 31101 930 1 0 290 12 0 0 22 0 1 0 850290312 343465984 20202 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261272549 0 0 16781312 33554434 0 0 0 17 4 0 0 0
/proc/5353/statm: 83854 20202 1816 364 0 18747 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 335416

[startup+6.30113 s]
/proc/loadavg: 2.40 2.29 2.03 3/686 5361
/proc/meminfo: memFree=8991940/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=349688 CPUtime=4.04 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 32382 930 1 0 392 12 0 0 25 0 2 0 850290312 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/5353/statm: 87422 21253 1862 364 0 22309 0
[pid=5359] ppid=5353 vsize=339444 CPUtime=0 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 784 0 0 0 0 0 0 0 16 0 1 0 850290725 347590656 19738 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636623 0 0 16781312 33554946 2553333490259066880 0 0 17 4 0 0 0
/proc/5359/statm: 84861 19738 351 364 0 19748 0
[pid=5361] ppid=5359 vsize=53616 CPUtime=2.16 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) R 5359 5361 5361 0 -1 4202496 23324 0 0 0 213 3 0 0 25 0 1 0 850290725 54902784 12644 33554432000 134512640 135751879 4290492496 18446744073709551615 135220911 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/5361/statm: 13404 12644 146 303 0 13099 0
[pid=5353/tid=5360] ppid=5351 vsize=349688 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 2 0 850290725 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 742748

[startup+12.701 s]
/proc/loadavg: 2.37 2.29 2.03 3/686 5362
/proc/meminfo: memFree=8986892/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=349688 CPUtime=4.04 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 32382 930 1 0 392 12 0 0 25 0 2 0 850290312 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/5353/statm: 87422 21253 1862 364 0 22309 0
[pid=5359] ppid=5353 vsize=339444 CPUtime=0.04 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 923 0 0 0 3 1 0 0 15 0 1 0 850290725 347590656 19762 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636623 0 0 16781312 33554946 4294934785 0 0 17 4 0 0 0
/proc/5359/statm: 84861 19762 375 364 0 19748 0
[pid=5361] ppid=5359 vsize=61284 CPUtime=8.54 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) R 5359 5361 5361 0 -1 4202496 25876 0 0 0 849 5 0 0 25 0 1 0 850290725 62754816 14360 33554432000 134512640 135751879 4290492496 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/5361/statm: 15321 14360 146 303 0 15016 0
[pid=5353/tid=5360] ppid=5351 vsize=349688 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 2 0 850290725 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 750416

[startup+25.5007 s]
/proc/loadavg: 2.29 2.27 2.02 3/686 5362
/proc/meminfo: memFree=8987484/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=349688 CPUtime=4.04 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 32382 930 1 0 392 12 0 0 25 0 2 0 850290312 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/5353/statm: 87422 21253 1862 364 0 22309 0
[pid=5359] ppid=5353 vsize=339444 CPUtime=0.08 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 926 0 0 0 5 3 0 0 15 0 1 0 850290725 347590656 19762 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636623 0 0 16781312 33554946 131394731895685120 0 0 17 4 0 0 0
/proc/5359/statm: 84861 19762 375 364 0 19748 0
[pid=5361] ppid=5359 vsize=61284 CPUtime=21.34 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) R 5359 5361 5361 0 -1 4202496 25901 0 0 0 2125 9 0 0 25 0 1 0 850290725 62754816 14385 33554432000 134512640 135751879 4290492496 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 4 0 0 0
/proc/5361/statm: 15321 14385 146 303 0 15016 0
[pid=5353/tid=5360] ppid=5351 vsize=349688 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 2 0 850290725 358080512 21253 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 750416

[startup+51.1012 s]
/proc/loadavg: 2.25 2.27 2.03 3/686 5363
/proc/meminfo: memFree=8969312/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=359944 CPUtime=4.07 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 33256 930 1 0 395 12 0 0 20 0 3 0 850290312 368582656 21268 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/5353/statm: 89986 21268 1873 364 0 24870 0
[pid=5359] ppid=5353 vsize=349688 CPUtime=0.2 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 1093 0 0 0 11 9 0 0 17 0 2 0 850290725 358080512 19798 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/5359/statm: 87422 19798 406 364 0 22309 0
[pid=5361] ppid=5359 vsize=81576 CPUtime=46.63 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) T 5359 5361 5361 0 -1 4202496 30989 0 0 0 4648 15 0 0 25 0 1 0 850290725 83533824 19473 33554432000 134512640 135751879 4290492496 18446744073709551615 134611204 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/5361/statm: 20394 19473 146 303 0 20089 0
[pid=5353/tid=5360] ppid=5351 vsize=359944 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 3 0 850290725 368582656 21268 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.9
Current children cumulated vsize (KiB) 791208

[startup+102.32 s]
/proc/loadavg: 2.27 2.26 2.03 3/712 5390
/proc/meminfo: memFree=7318932/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=370200 CPUtime=4.09 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 34135 930 1 0 397 12 0 0 20 0 4 0 850290312 379084800 21274 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/5353/statm: 92550 21274 1875 364 0 27431 0
[pid=5359] ppid=5353 vsize=349688 CPUtime=0.2 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 1093 0 0 0 11 9 0 0 17 0 2 0 850290725 358080512 19798 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/5359/statm: 87422 19798 406 364 0 22309 0
[pid=5361] ppid=5359 vsize=81576 CPUtime=46.63 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) T 5359 5361 5361 0 -1 4202496 30989 0 0 0 4648 15 0 0 25 0 1 0 850290725 83533824 19473 33554432000 134512640 135751879 4290492496 18446744073709551615 134611204 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/5361/statm: 20394 19473 146 303 0 20089 0
[pid=5359/tid=5364] ppid=5353 vsize=349688 CPUtime=0 cores=0,2,4,6
/proc/5359/task/5364/stat : 5364 (python) S 5353 5353 2733 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850295394 358080512 19798 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604447844460416 0 0 -1 4 0 0 0
[pid=5365] ppid=5353 vsize=349700 CPUtime=0.21 cores=0,2,4,6
/proc/5365/stat : 5365 (python) S 5353 5353 2733 0 -1 4202560 1097 0 0 0 11 10 0 0 16 0 2 0 850295396 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/5365/statm: 87425 19788 396 364 0 22309 0
[pid=5367] ppid=5365 vsize=1054200 CPUtime=47.3 cores=0,2,4,6
/proc/5367/stat : 5367 (scip-2.0.1.linu) T 5365 5367 5367 0 -1 4202496 263378 0 0 0 4630 100 0 0 25 0 1 0 850295397 1079500800 255444 33554432000 4194304 13684479 140734866345264 18446744073709551615 4880658 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/5367/statm: 263550 255444 660 2317 0 261228 0
[pid=5365/tid=5369] ppid=5353 vsize=349700 CPUtime=0 cores=0,2,4,6
/proc/5365/task/5369/stat : 5369 (python) S 5353 5353 2733 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850300128 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604451908471744 0 0 -1 6 0 0 0
[pid=5370] ppid=5353 vsize=359956 CPUtime=0.02 cores=0,2,4,6
/proc/5370/stat : 5370 (python) S 5353 5353 2733 0 -1 4202560 945 0 0 0 1 1 0 0 15 0 1 0 850300131 368594944 19767 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636678 0 0 16781312 33554946 4294934785 0 0 17 0 0 0 0
/proc/5370/statm: 89989 19767 372 364 0 24870 0
[pid=5372] ppid=5370 vsize=8545412 CPUtime=6.23 cores=0,2,4,6
/proc/5372/stat : 5372 (java) S 5370 5372 5372 0 -1 4202496 159065 0 1 0 605 18 0 0 20 0 19 0 850300132 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5372/statm: 2136353 155073 2244 9 0 2127094 0
[pid=5372/tid=5373] ppid=5370 vsize=8545412 CPUtime=3.97 cores=0,2,4,6
/proc/5372/task/5373/stat : 5373 (java) R 5370 5372 5372 0 -1 4202560 119697 0 1 0 384 13 0 0 20 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 46912506075568 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=5372/tid=5374] ppid=5370 vsize=8545412 CPUtime=0.08 cores=0,2,4,6
/proc/5372/task/5374/stat : 5374 (java) S 5370 5372 5372 0 -1 4202560 6924 0 0 0 8 0 0 0 15 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 0 0 0 0
[pid=5372/tid=5375] ppid=5370 vsize=8545412 CPUtime=0.06 cores=0,2,4,6
/proc/5372/task/5375/stat : 5375 (java) S 5370 5372 5372 0 -1 4202560 3937 0 0 0 6 0 0 0 15 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 0 0 0 0
[pid=5372/tid=5376] ppid=5370 vsize=8545412 CPUtime=0.09 cores=0,2,4,6
/proc/5372/task/5376/stat : 5376 (java) S 5370 5372 5372 0 -1 4202560 7638 0 0 0 9 0 0 0 16 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 2 0 0 0
[pid=5372/tid=5377] ppid=5370 vsize=8545412 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5377/stat : 5377 (java) S 5370 5372 5372 0 -1 4202560 216 0 0 0 0 0 0 0 15 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 2 0 0 0
[pid=5372/tid=5378] ppid=5370 vsize=8545412 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5378/stat : 5378 (java) S 5370 5372 5372 0 -1 4202560 833 0 0 0 0 0 0 0 15 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 6 0 0 0
[pid=5372/tid=5379] ppid=5370 vsize=8545412 CPUtime=0.03 cores=0,2,4,6
/proc/5372/task/5379/stat : 5379 (java) S 5370 5372 5372 0 -1 4202560 2304 0 0 0 3 0 0 0 15 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 2 0 0 0
[pid=5372/tid=5380] ppid=5370 vsize=8545412 CPUtime=0.05 cores=0,2,4,6
/proc/5372/task/5380/stat : 5380 (java) S 5370 5372 5372 0 -1 4202560 3366 0 0 0 5 0 0 0 16 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 6 0 0 0
[pid=5372/tid=5381] ppid=5370 vsize=8545412 CPUtime=0.02 cores=0,2,4,6
/proc/5372/task/5381/stat : 5381 (java) S 5370 5372 5372 0 -1 4202560 2238 0 0 0 2 0 0 0 16 0 19 0 850300133 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 4 0 0 0
[pid=5372/tid=5382] ppid=5370 vsize=8545412 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5382/stat : 5382 (java) S 5370 5372 5372 0 -1 4202560 463 0 0 0 0 0 0 0 15 0 19 0 850300134 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 0 0 16800975 18446604451908469056 0 0 -1 2 0 0 0
[pid=5372/tid=5383] ppid=5370 vsize=8545412 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5383/stat : 5383 (java) S 5370 5372 5372 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850300135 8750501888 155073 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446604451908469056 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=5365] ppid=5353 vsize=349700 CPUtime=0.21 cores=0,2,4,6
/proc/5365/stat : 5365 (python) S 5353 5353 2733 0 -1 4202560 1097 0 0 0 11 10 0 0 16 0 2 0 850295396 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/5365/statm: 87425 19788 396 364 0 22309 0
[pid=5367] ppid=5365 vsize=1054200 CPUtime=47.3 cores=0,2,4,6
/proc/5367/stat : 5367 (scip-2.0.1.linu) T 5365 5367 5367 0 -1 4202496 263378 0 0 0 4630 100 0 0 25 0 1 0 850295397 1079500800 255444 33554432000 4194304 13684479 140734866345264 18446744073709551615 4880658 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/5367/statm: 263550 255444 660 2317 0 261228 0
[pid=5365/tid=5369] ppid=5353 vsize=349700 CPUtime=0 cores=0,2,4,6
/proc/5365/task/5369/stat : 5369 (python) S 5353 5353 2733 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850300128 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604451908471744 0 0 -1 6 0 0 0
[pid=5370] ppid=5353 vsize=359956 CPUtime=0.22 cores=0,2,4,6
/proc/5370/stat : 5370 (python) S 5353 5353 2733 0 -1 4202560 1115 0 0 0 12 10 0 0 17 0 2 0 850300131 368594944 19792 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/5370/statm: 89989 19792 396 364 0 24870 0
[pid=5372] ppid=5370 vsize=8541792 CPUtime=48.89 cores=0,2,4,6
/proc/5372/stat : 5372 (java) T 5370 5372 5372 0 -1 4202496 718233 0 1 0 4808 81 0 0 18 0 19 0 850300132 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5372/statm: 2135448 708310 2249 9 0 2126189 0
[pid=5372/tid=5373] ppid=5370 vsize=8541792 CPUtime=45.69 cores=0,2,4,6
/proc/5372/task/5373/stat : 5373 (java) T 5370 5372 5372 0 -1 4202560 628219 0 1 0 4501 68 0 0 25 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 46912505567838 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5374] ppid=5370 vsize=8541792 CPUtime=0.16 cores=0,2,4,6
/proc/5372/task/5374/stat : 5374 (java) T 5370 5372 5372 0 -1 4202560 11516 0 0 0 15 1 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5375] ppid=5370 vsize=8541792 CPUtime=0.17 cores=0,2,4,6
/proc/5372/task/5375/stat : 5375 (java) T 5370 5372 5372 0 -1 4202560 12633 0 0 0 15 2 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5376] ppid=5370 vsize=8541792 CPUtime=0.21 cores=0,2,4,6
/proc/5372/task/5376/stat : 5376 (java) T 5370 5372 5372 0 -1 4202560 14654 0 0 0 19 2 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5377] ppid=5370 vsize=8541792 CPUtime=0.03 cores=0,2,4,6
/proc/5372/task/5377/stat : 5377 (java) T 5370 5372 5372 0 -1 4202560 2619 0 0 0 3 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5378] ppid=5370 vsize=8541792 CPUtime=0.09 cores=0,2,4,6
/proc/5372/task/5378/stat : 5378 (java) T 5370 5372 5372 0 -1 4202560 7685 0 0 0 9 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5379] ppid=5370 vsize=8541792 CPUtime=0.08 cores=0,2,4,6
/proc/5372/task/5379/stat : 5379 (java) T 5370 5372 5372 0 -1 4202560 5916 0 0 0 8 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5380] ppid=5370 vsize=8541792 CPUtime=0.19 cores=0,2,4,6
/proc/5372/task/5380/stat : 5380 (java) T 5370 5372 5372 0 -1 4202560 13222 0 0 0 18 1 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5381] ppid=5370 vsize=8541792 CPUtime=0.12 cores=0,2,4,6
/proc/5372/task/5381/stat : 5381 (java) T 5370 5372 5372 0 -1 4202560 9037 0 0 0 12 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5382] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5382/stat : 5382 (java) T 5370 5372 5372 0 -1 4202560 1274 0 0 0 0 0 0 0 15 0 19 0 850300134 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 0 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5383] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5383/stat : 5383 (java) T 5370 5372 5372 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850300135 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5384] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5384/stat : 5384 (java) T 5370 5372 5372 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 850300135 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5385] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5385/stat : 5385 (java) T 5370 5372 5372 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273440177 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5386] ppid=5370 vsize=8541792 CPUtime=0.93 cores=0,2,4,6
/proc/5372/task/5386/stat : 5386 (java) T 5370 5372 5372 0 -1 4202560 5580 0 0 0 92 1 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5387] ppid=5370 vsize=8541792 CPUtime=1.1 cores=0,2,4,6
/proc/5372/task/5387/stat : 5387 (java) T 5370 5372 5372 0 -1 4202560 4487 0 0 0 110 0 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5388] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5388/stat : 5388 (java) T 5370 5372 5372 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5389] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5389/stat : 5389 (java) T 5370 5372 5372 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5390] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5390/stat : 5390 (java) T 5370 5372 5372 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850300291 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5370/tid=5392] ppid=5353 vsize=359956 CPUtime=0 cores=0,2,4,6
/proc/5370/task/5392/stat : 5392 (python) S 5353 5353 2733 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850304737 368594944 19792 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604451409692544 0 0 -1 6 0 0 0
[pid=5393] ppid=5353 vsize=370212 CPUtime=7.05 cores=0,2,4,6
/proc/5393/stat : 5393 (python) S 5353 5353 2733 0 -1 4202560 1041 0 0 0 353 352 0 0 15 0 1 0 850304740 379097088 19772 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636678 0 0 16781312 33554946 72556772316949314 0 0 17 6 0 0 0
/proc/5393/statm: 92553 19772 373 364 0 27431 0
[pid=5395] ppid=5393 vsize=810164 CPUtime=1645.47 cores=0,2,4,6
/proc/5395/stat : 5395 (bsolo_pb10) R 5393 5395 5395 0 -1 4202496 16059943 0 0 0 162745 1802 0 0 25 0 1 0 850304741 829607936 199929 33554432000 134512640 137138936 4288281872 18446744073709551615 134572768 0 0 16781312 16384 0 0 0 17 2 0 0 0
/proc/5395/statm: 202541 199929 192 642 0 201897 0
[pid=5353/tid=5360] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 5 0 850290725 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
[pid=5353/tid=5366] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5366/stat : 5366 (python) S 5351 5353 2733 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 850295397 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
[pid=5353/tid=5371] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5371/stat : 5371 (python) S 5351 5353 2733 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 850300131 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
[pid=5353/tid=5394] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5394/stat : 5394 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 20 0 5 0 850304741 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 12297744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1789.72 s]
/proc/loadavg: 1.00 1.01 1.22 2/699 5486
/proc/meminfo: memFree=4353200/32951124 swapFree=67057920/67111528
[pid=5353] ppid=5351 vsize=380456 CPUtime=4.13 cores=0,2,4,6
/proc/5353/stat : 5353 (python) S 5351 5353 2733 0 -1 4202496 35044 930 1 0 400 13 0 0 20 0 5 0 850290312 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/5353/statm: 95114 21280 1877 364 0 29992 0
[pid=5359] ppid=5353 vsize=349688 CPUtime=0.2 cores=0,2,4,6
/proc/5359/stat : 5359 (python) S 5353 5353 2733 0 -1 4202560 1093 0 0 0 11 9 0 0 17 0 2 0 850290725 358080512 19798 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/5359/statm: 87422 19798 406 364 0 22309 0
[pid=5361] ppid=5359 vsize=81576 CPUtime=46.63 cores=0,2,4,6
/proc/5361/stat : 5361 (wbo1.4a) T 5359 5361 5361 0 -1 4202496 30989 0 0 0 4648 15 0 0 25 0 1 0 850290725 83533824 19473 33554432000 134512640 135751879 4290492496 18446744073709551615 134611204 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/5361/statm: 20394 19473 146 303 0 20089 0
[pid=5359/tid=5364] ppid=5353 vsize=349688 CPUtime=0 cores=0,2,4,6
/proc/5359/task/5364/stat : 5364 (python) S 5353 5353 2733 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850295394 358080512 19798 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604447844460416 0 0 -1 4 0 0 0
[pid=5365] ppid=5353 vsize=349700 CPUtime=0.21 cores=0,2,4,6
/proc/5365/stat : 5365 (python) S 5353 5353 2733 0 -1 4202560 1097 0 0 0 11 10 0 0 16 0 2 0 850295396 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/5365/statm: 87425 19788 396 364 0 22309 0
[pid=5367] ppid=5365 vsize=1054200 CPUtime=47.3 cores=0,2,4,6
/proc/5367/stat : 5367 (scip-2.0.1.linu) T 5365 5367 5367 0 -1 4202496 263378 0 0 0 4630 100 0 0 25 0 1 0 850295397 1079500800 255444 33554432000 4194304 13684479 140734866345264 18446744073709551615 4880658 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/5367/statm: 263550 255444 660 2317 0 261228 0
[pid=5365/tid=5369] ppid=5353 vsize=349700 CPUtime=0 cores=0,2,4,6
/proc/5365/task/5369/stat : 5369 (python) S 5353 5353 2733 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850300128 358092800 19788 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604451908471744 0 0 -1 6 0 0 0
[pid=5370] ppid=5353 vsize=359956 CPUtime=0.22 cores=0,2,4,6
/proc/5370/stat : 5370 (python) S 5353 5353 2733 0 -1 4202560 1115 0 0 0 12 10 0 0 17 0 2 0 850300131 368594944 19792 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273443275 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/5370/statm: 89989 19792 396 364 0 24870 0
[pid=5372] ppid=5370 vsize=8541792 CPUtime=48.89 cores=0,2,4,6
/proc/5372/stat : 5372 (java) T 5370 5372 5372 0 -1 4202496 718233 0 1 0 4808 81 0 0 18 0 19 0 850300132 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/5372/statm: 2135448 708310 2249 9 0 2126189 0
[pid=5372/tid=5373] ppid=5370 vsize=8541792 CPUtime=45.69 cores=0,2,4,6
/proc/5372/task/5373/stat : 5373 (java) T 5370 5372 5372 0 -1 4202560 628219 0 1 0 4501 68 0 0 25 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 46912505567838 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5374] ppid=5370 vsize=8541792 CPUtime=0.16 cores=0,2,4,6
/proc/5372/task/5374/stat : 5374 (java) T 5370 5372 5372 0 -1 4202560 11516 0 0 0 15 1 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5375] ppid=5370 vsize=8541792 CPUtime=0.17 cores=0,2,4,6
/proc/5372/task/5375/stat : 5375 (java) T 5370 5372 5372 0 -1 4202560 12633 0 0 0 15 2 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5376] ppid=5370 vsize=8541792 CPUtime=0.21 cores=0,2,4,6
/proc/5372/task/5376/stat : 5376 (java) T 5370 5372 5372 0 -1 4202560 14654 0 0 0 19 2 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5377] ppid=5370 vsize=8541792 CPUtime=0.03 cores=0,2,4,6
/proc/5372/task/5377/stat : 5377 (java) T 5370 5372 5372 0 -1 4202560 2619 0 0 0 3 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5378] ppid=5370 vsize=8541792 CPUtime=0.09 cores=0,2,4,6
/proc/5372/task/5378/stat : 5378 (java) T 5370 5372 5372 0 -1 4202560 7685 0 0 0 9 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5379] ppid=5370 vsize=8541792 CPUtime=0.08 cores=0,2,4,6
/proc/5372/task/5379/stat : 5379 (java) T 5370 5372 5372 0 -1 4202560 5916 0 0 0 8 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5380] ppid=5370 vsize=8541792 CPUtime=0.19 cores=0,2,4,6
/proc/5372/task/5380/stat : 5380 (java) T 5370 5372 5372 0 -1 4202560 13222 0 0 0 18 1 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5372/tid=5381] ppid=5370 vsize=8541792 CPUtime=0.12 cores=0,2,4,6
/proc/5372/task/5381/stat : 5381 (java) T 5370 5372 5372 0 -1 4202560 9037 0 0 0 12 0 0 0 15 0 19 0 850300133 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5382] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5382/stat : 5382 (java) T 5370 5372 5372 0 -1 4202560 1274 0 0 0 0 0 0 0 15 0 19 0 850300134 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 0 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5383] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5383/stat : 5383 (java) T 5370 5372 5372 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850300135 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5384] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5384/stat : 5384 (java) T 5370 5372 5372 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 850300135 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5385] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5385/stat : 5385 (java) T 5370 5372 5372 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273440177 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5386] ppid=5370 vsize=8541792 CPUtime=0.93 cores=0,2,4,6
/proc/5372/task/5386/stat : 5386 (java) T 5370 5372 5372 0 -1 4202560 5580 0 0 0 92 1 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=5372/tid=5387] ppid=5370 vsize=8541792 CPUtime=1.1 cores=0,2,4,6
/proc/5372/task/5387/stat : 5387 (java) T 5370 5372 5372 0 -1 4202560 4487 0 0 0 110 0 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5388] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5388/stat : 5388 (java) T 5370 5372 5372 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273432473 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=5372/tid=5389] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5389/stat : 5389 (java) T 5370 5372 5372 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 850300137 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=5372/tid=5390] ppid=5370 vsize=8541792 CPUtime=0 cores=0,2,4,6
/proc/5372/task/5390/stat : 5390 (java) T 5370 5372 5372 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850300291 8746795008 708310 33554432000 1073741824 1073778376 140733344447456 18446744073709551615 254273433088 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=5370/tid=5392] ppid=5353 vsize=359956 CPUtime=0 cores=0,2,4,6
/proc/5370/task/5392/stat : 5392 (python) S 5353 5353 2733 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850304737 368594944 19792 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554946 18446604451409692544 0 0 -1 6 0 0 0
[pid=5393] ppid=5353 vsize=370212 CPUtime=7.05 cores=0,2,4,6
/proc/5393/stat : 5393 (python) S 5353 5353 2733 0 -1 4202560 1041 0 0 0 353 352 0 0 15 0 1 0 850304740 379097088 19772 33554432000 4194304 5683644 140737178508992 18446744073709551615 254261636678 0 0 16781312 33554946 72556772316949314 0 0 17 6 0 0 0
/proc/5393/statm: 92553 19772 373 364 0 27431 0
[pid=5395] ppid=5393 vsize=810164 CPUtime=1645.47 cores=0,2,4,6
/proc/5395/stat : 5395 (bsolo_pb10) R 5393 5395 5395 0 -1 4202496 16059943 0 0 0 162745 1802 0 0 25 0 1 0 850304741 829607936 199929 33554432000 134512640 137138936 4288281872 18446744073709551615 134572768 0 0 16781312 16384 0 0 0 17 2 0 0 0
/proc/5395/statm: 202541 199929 192 642 0 201897 0
[pid=5353/tid=5360] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5360/stat : 5360 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 5 0 850290725 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 4 0 0 0
[pid=5353/tid=5366] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5366/stat : 5366 (python) S 5351 5353 2733 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 850295397 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
[pid=5353/tid=5371] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5371/stat : 5371 (python) S 5351 5353 2733 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 5 0 850300131 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
[pid=5353/tid=5394] ppid=5351 vsize=380456 CPUtime=0 cores=0,2,4,6
/proc/5353/task/5394/stat : 5394 (python) S 5351 5353 2733 0 -1 4202560 27 930 0 0 0 0 0 0 20 0 5 0 850304741 389586944 21280 33554432000 4194304 5683644 140737178508992 18446744073709551615 254273440177 0 0 16781312 33554434 18446604444074321920 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 12297744

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5353 and gives
#  childrusage.ru_utime.tv_sec=4
#  childrusage.ru_utime.tv_usec=5391
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=137979
# CPU time returned by wait4() is 4.14337
# while last known CPU time is 1800.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1789.78
CPU time (s): 1800.1
CPU user time (s): 1776.18
CPU system time (s): 23.92
CPU usage (%): 100.577
Max. virtual memory (cumulated for all children) (KiB): 12297744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4.00539
system time used= 0.137979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35976
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1009
involuntary context switches= 58

runsolver used 15.2777 second user time and 30.9513 second system time

The end

Launcher Data 

Begin job on node140 at 2011-06-09 02:19:09
IDJOB=3482238
IDBENCH=77343
IDSOLVER=1970
FILE ID=node140/3482238-1307578749
RUNJOBID= node140-1307576354-2755
PBS_JOBID= 13547659
Free space on /tmp= 73304 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j120opt/normalized-j12049_10.std.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482238-1307578749/watcher-3482238-1307578749 -o /tmp/evaluation-result-3482238-1307578749/solver-3482238-1307578749 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482238-1307578749.opb -seed 57891206 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 447a543f878ceafadea8d85be2867299
RANDOM SEED=57891206

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       9126764 kB
Buffers:        191288 kB
Cached:         825224 kB
SwapCached:       7060 kB
Active:       23347640 kB
Inactive:       169216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       9126764 kB
SwapTotal:    67111528 kB
SwapFree:     67057920 kB
Dirty:          109508 kB
Writeback:           0 kB
AnonPages:    22498540 kB
Mapped:         104032 kB
Slab:           147884 kB
PageTables:      88844 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 161627320 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73264 MiB
End job on node140 at 2011-06-09 02:49:02