Trace number 3481819

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 668.24 687.598

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/
MIPLIB/miplib2003/normalized-mps-v2-20-10-protfold.opb
MD5SUM7f40f8d513f22fc9adca96d8fdf626e2
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-26
Best CPU time to get the best result obtained on this benchmark1800.08
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -24
Optimality of the best value was proved NO
Number of variables1835
Total number of constraints2112
Number of constraints which are clauses1906
Number of constraints which are cardinality constraints (but not clauses)86
Number of constraints which are nor clauses,nor cardinality constraints120
Minimum length of a constraint3
Maximum length of a constraint882
Number of terms in the objective function 120
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 120
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 18
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 900
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.53/25.23	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.53/25.23	c INFO: solving HOME/instance-3481819-1307576356.opb
0.53/25.27	c INFO: parsing took 0.04 s
0.61/25.35	c INFO: features took 0.08 CPU seconds
0.66/25.45	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.70)
52.28/76.95	c INFO: running scip-2.0.1-clp@0 for 45 with 1749 remaining (b = 0.27)
100.84/125.34	c INFO: running wbo1.4a@0 for 45 with 1701 remaining (b = 0.05)
150.63/174.96	c INFO: running scip-2.0.1-spx@50 for 45 with 1652 remaining (b = 0.03)
197.00/221.14	c INFO: running scip-2.0.1-clp@47 for 45 with 1606 remaining (b = 0.06)
243.38/267.35	c INFO: running bsolo_pb10-l1@0 for 45 with 1560 remaining (b = 0.14)
291.41/315.29	c INFO: running bsolo_pb10-l3@0 for 45 with 1512 remaining (b = 0.04)
338.49/362.11	c INFO: running scip-2.0.1-spx@96 for 45 with 1466 remaining (b = 0.03)
384.87/408.30	c INFO: running scip-2.0.1-clp@93 for 91 with 1420 remaining (b = 0.06)
476.51/499.63	c INFO: running clasp-1.3.7@0 for 45 with 1329 remaining (b = 0.03)
524.63/547.69	c INFO: running scip-2.0.1-spx@141 for 45 with 1281 remaining (b = 0.03)
570.44/593.20	c INFO: running clasp-1.3.7@48 for 45 with 1236 remaining (b = 0.02)
616.70/639.39	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1190 remaining (b = 0.02)
666.68/686.68	c INFO: running sat4j-pb-v20101225@0 for 45 with 1140 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481819-1307576356/watcher-3481819-1307576356 -o /tmp/evaluation-result-3481819-1307576356/solver-3481819-1307576356 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481819-1307576356.opb -seed 611056974 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.36 0.09 0.02 4/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (runsolver) S 1438 1442 1406 0 -1 4202560 43 0 0 0 0 0 0 0 18 0 1 0 869235571 12079104 50 33554432000 4194304 5432328 140733691346112 18446744073709551615 4881591 0 2147483391 4096 24578 18446744071700214583 0 0 17 1 0 0 0
/proc/1442/statm: 2949 50 31 303 0 2643 0

[startup+0.117797 s]
/proc/loadavg: 0.36 0.09 0.02 4/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=1840 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (python) D 1438 1442 1406 0 -1 4194304 47 0 0 0 0 0 0 0 17 0 1 0 869235571 1884160 1 33554432000 0 0 140735796741800 18446744073709551615 5055479 0 0 4096 0 18446744071562234166 0 0 17 1 0 0 0
/proc/1442/statm: 460 1 0 0 0 36 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1840

[startup+0.20084 s]
/proc/loadavg: 0.36 0.09 0.02 4/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=14252 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (python) D 1438 1442 1406 0 -1 4194304 193 0 2 0 0 0 0 0 17 0 1 0 869235571 14594048 130 33554432000 4194304 5683644 140735796739040 18446744073709551615 5398816 0 0 4096 0 18446744071562234166 0 0 17 1 0 0 4
/proc/1442/statm: 3563 130 102 364 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14252

[startup+0.300834 s]
/proc/loadavg: 0.36 0.09 0.02 4/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=14820 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 505 0 7 0 0 0 0 0 17 0 1 0 869235571 15175680 419 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516830053 0 2147483391 4096 0 18446744071699453118 0 0 17 7 0 0 9
/proc/1442/statm: 3705 419 259 364 0 192 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14820

[startup+0.700737 s]
/proc/loadavg: 0.36 0.09 0.02 4/423 1444
/proc/meminfo: memFree=26945412/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 717 0 7 0 0 0 0 0 15 0 1 0 869235571 15548416 614 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 7 0 0 14
/proc/1442/statm: 3796 614 321 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+1.5006 s]
/proc/loadavg: 0.36 0.09 0.02 1/425 1446
/proc/meminfo: memFree=26939272/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=15752 CPUtime=0 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 833 0 7 0 0 0 0 0 15 0 1 0 869235571 16130048 723 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 7 0 0 24
/proc/1442/statm: 3938 723 334 364 0 425 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15752

[startup+3.10029 s]
/proc/loadavg: 0.49 0.12 0.03 1/425 1446
/proc/meminfo: memFree=26934192/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=16392 CPUtime=0.01 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 1110 0 7 0 1 0 0 0 15 0 1 0 869235571 16785408 984 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 7 0 0 47
/proc/1442/statm: 4098 984 409 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392
heavy processes:

[startup+6.30074 s]
/proc/loadavg: 0.49 0.12 0.03 2/425 1446
/proc/meminfo: memFree=26935772/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=18884 CPUtime=0.02 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 1242 0 8 0 1 1 0 0 16 0 1 0 869235571 19337216 1104 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516832256 0 2147483391 16781312 2 18446744071699453118 0 0 17 7 0 0 60
/proc/1442/statm: 4721 1104 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884
heavy processes:

[startup+12.7006 s]
/proc/loadavg: 0.45 0.12 0.03 1/425 1446
/proc/meminfo: memFree=26930388/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=36508 CPUtime=0.07 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 1601 0 14 0 5 2 0 0 15 0 1 0 869235571 37384192 1446 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516830053 0 2147483391 16781312 2 18446744071699453118 0 0 17 7 0 0 108
/proc/1442/statm: 9127 1446 452 364 0 944 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 36508
heavy processes:

[startup+25.5012 s]
/proc/loadavg: 0.64 0.18 0.05 4/425 1454
/proc/meminfo: memFree=26859020/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=294652 CPUtime=0.69 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 9833 920 112 9 50 19 0 0 16 0 2 0 869235571 301723648 7502 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 325
/proc/1442/statm: 73663 7502 1870 364 0 8550 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 294652
heavy processes:

[startup+51.1006 s]
/proc/loadavg: 1.24 0.35 0.12 3/431 1461
/proc/meminfo: memFree=26614952/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=294652 CPUtime=0.69 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 9833 920 112 9 50 19 0 0 16 0 2 0 869235571 301723648 7502 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 325
/proc/1442/statm: 73663 7502 1870 364 0 8550 0
[pid=1455] ppid=1442 vsize=284408 CPUtime=0.08 cores=1,3,5,7
/proc/1455/stat : 1455 (python) S 1442 1442 1406 0 -1 4202560 996 0 0 0 3 5 0 0 15 0 1 0 869238116 291233792 6009 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516854287 0 0 16781312 33554946 557608736386973696 0 0 17 7 0 0 0
/proc/1455/statm: 71102 6009 381 364 0 5989 0
[pid=1457] ppid=1455 vsize=86312 CPUtime=25.62 cores=1,3,5,7
/proc/1457/stat : 1457 (scip-2.0.1.linu) R 1455 1457 1457 0 -1 4202496 21096 0 0 0 2487 75 0 0 25 0 1 0 869238117 88383488 19126 33554432000 4194304 13684479 140735263807248 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/1457/statm: 21578 19126 824 2317 0 19256 0
[pid=1442/tid=1456] ppid=1438 vsize=294652 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1456/stat : 1456 (python) S 1438 1442 1406 0 -1 4202560 25 920 0 9 0 0 0 0 17 0 2 0 869238116 301723648 7502 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 26.39
Current children cumulated vsize (KiB) 665372
heavy processes:

[startup+102.301 s]
/proc/loadavg: 1.78 0.65 0.23 5/439 1470
/proc/meminfo: memFree=26387660/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=304908 CPUtime=0.71 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 10643 920 112 9 52 19 0 0 19 0 3 0 869235571 312225792 7524 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 325
/proc/1442/statm: 76227 7524 1873 364 0 11111 0
[pid=1455] ppid=1442 vsize=294652 CPUtime=0.18 cores=1,3,5,7
/proc/1455/stat : 1455 (python) S 1442 1442 1406 0 -1 4202560 1176 0 0 0 7 11 0 0 16 0 2 0 869238116 301723648 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1455/statm: 73663 6045 412 364 0 8550 0
[pid=1457] ppid=1455 vsize=86312 CPUtime=51.45 cores=1,3,5,7
/proc/1457/stat : 1457 (scip-2.0.1.linu) T 1455 1457 1457 0 -1 4202496 21096 0 0 0 5044 101 0 0 25 0 1 0 869238117 88383488 19126 33554432000 4194304 13684479 140735263807248 18446744073709551615 7361376 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/1457/statm: 21578 19126 824 2317 0 19256 0
[pid=1455/tid=1467] ppid=1442 vsize=294652 CPUtime=0 cores=1,3,5,7
/proc/1455/task/1467/stat : 1467 (python) S 1442 1442 1406 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869243264 301723648 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458073869184 0 0 -1 7 0 0 0
[pid=1468] ppid=1442 vsize=294664 CPUtime=0.08 cores=1,3,5,7
/proc/1468/stat : 1468 (python) S 1442 1442 1406 0 -1 4202560 929 0 0 0 4 4 0 0 15 0 1 0 869243266 301735936 6020 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516854342 0 0 16781312 33554946 2698402328578359296 0 0 17 7 0 0 0
/proc/1468/statm: 73666 6020 373 364 0 8550 0
[pid=1470] ppid=1468 vsize=90516 CPUtime=25.34 cores=1,3,5,7
/proc/1470/stat : 1470 (scip-2.0.1.linu) R 1468 1470 1470 0 -1 4202496 43693 0 0 0 2503 31 0 0 21 0 1 0 869243266 92688384 19716 33554432000 4194304 15243407 140735630129328 18446744073709551615 8112832 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1470/statm: 22629 19716 913 2698 0 19924 0
[pid=1442/tid=1456] ppid=1438 vsize=304908 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1456/stat : 1456 (python) S 1438 1442 1406 0 -1 4202560 25 920 0 9 0 0 0 0 17 0 3 0 869238116 312225792 7524 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
[pid=1442/tid=1469] ppid=1438 vsize=304908 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1469/stat : 1469 (python) S 1438 1442 1406 0 -1 4202560 28 920 0 9 0 0 0 0 19 0 3 0 869243266 312225792 7524 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 77.76
Current children cumulated vsize (KiB) 1071052
heavy processes:

[startup+162.301 s]
/proc/loadavg: 1.91 0.87 0.33 3/447 1480
/proc/meminfo: memFree=26081504/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=315164 CPUtime=0.74 cores=1,3,5,7
/proc/1442/stat : 1442 (python) S 1438 1442 1406 0 -1 4202496 11560 920 112 9 54 20 0 0 20 0 4 0 869235571 322727936 7530 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 325
/proc/1442/statm: 78791 7530 1875 364 0 13672 0
[pid=1455] ppid=1442 vsize=294652 CPUtime=0.18 cores=1,3,5,7
/proc/1455/stat : 1455 (python) S 1442 1442 1406 0 -1 4202560 1176 0 0 0 7 11 0 0 16 0 2 0 869238116 301723648 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1455/statm: 73663 6045 412 364 0 8550 0
[pid=1457] ppid=1455 vsize=86312 CPUtime=51.45 cores=1,3,5,7
/proc/1457/stat : 1457 (scip-2.0.1.linu) T 1455 1457 1457 0 -1 4202496 21096 0 0 0 5044 101 0 0 25 0 1 0 869238117 88383488 19126 33554432000 4194304 13684479 140735263807248 18446744073709551615 7361376 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/1457/statm: 21578 19126 824 2317 0 19256 0
[pid=1455/tid=1467] ppid=1442 vsize=294652 CPUtime=0 cores=1,3,5,7
/proc/1455/task/1467/stat : 1467 (python) S 1442 1442 1406 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869243264 301723648 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458073869184 0 0 -1 7 0 0 0
[pid=1468] ppid=1442 vsize=294664 CPUtime=0.18 cores=1,3,5,7
/proc/1468/stat : 1468 (python) S 1442 1442 1406 0 -1 4202560 1105 0 0 0 8 10 0 0 16 0 2 0 869243266 301735936 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1468/statm: 73666 6045 397 364 0 8550 0
[pid=1470] ppid=1468 vsize=90784 CPUtime=48.36 cores=1,3,5,7
/proc/1470/stat : 1470 (scip-2.0.1.linu) T 1468 1470 1470 0 -1 4202496 74562 0 0 0 4792 44 0 0 25 0 1 0 869243266 92962816 19532 33554432000 4194304 15243407 140735630129328 18446744073709551615 8112976 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/1470/statm: 22696 19532 950 2698 0 19991 0
[pid=1468/tid=1476] ppid=1442 vsize=294664 CPUtime=0 cores=1,3,5,7
/proc/1468/task/1476/stat : 1476 (python) S 1442 1442 1406 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869248103 301735936 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458424988992 0 0 -1 7 0 0 0
[pid=1477] ppid=1442 vsize=304920 CPUtime=0.13 cores=1,3,5,7
/proc/1477/stat : 1477 (python) S 1442 1442 1406 0 -1 4202560 974 0 0 0 6 7 0 0 15 0 1 0 869248105 312238080 6024 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516854342 0 0 16781312 33554946 5623753486446373739 0 0 17 7 0 0 0
/proc/1477/statm: 76230 6024 373 364 0 11111 0
[pid=1479] ppid=1477 vsize=87352 CPUtime=36.94 cores=1,3,5,7
/proc/1479/stat : 1479 (wbo1.4a) R 1477 1479 1479 0 -1 4202496 21727 0 0 0 3644 50 0 0 25 0 1 0 869248106 89448448 21409 33554432000 134512640 135751879 4291896448 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/1479/statm: 21838 21409 146 303 0 21533 0
[pid=1442/tid=1456] ppid=1438 vsize=315164 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1456/stat : 1456 (python) S 1438 1442 1406 0 -1 4202560 25 920 0 9 0 0 0 0 17 0 4 0 869238116 322727936 7530 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
[pid=1442/tid=1469] ppid=1438 vsize=315164 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1469/stat : 1469 (python) S 1438 1442 1406 0 -1 4202560 28 920 0 9 0 0 0 0 19 0 4 0 869243266 322727936 7530 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
[pid=1442/tid=1478] ppid=1438 vsize=315164 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1478/stat : 1478 (python) S 1438 1442 1406 0 -1 4202560 30 920 0 9 0 0 0 0 20 0 4 0 869248106 322727936 7530 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 137.98
Current children cumulated vsize (KiB) 1473848

[startup+222.317 s]
/proc/loadavg: 2.08 1.12 0.45 3/470 1505
/proc/meminfo: memFree=24431180/32951124 swapFree=43359760/67111528
[pid=1442] ppid=1438 vsize=315668 CPUtime=0.79 cores=1,3,5,7

################
# More data... #
################

/proc/1455/stat : 1455 (python) S 1442 1442 1406 0 -1 4202560 1231 0 0 0 33 38 0 0 15 0 2 0 869238116 301723648 6046 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1455/statm: 73663 6046 413 364 0 8550 0
[pid=1457] ppid=1455 vsize=86312 CPUtime=189.28 cores=1,3,5,7
/proc/1457/stat : 1457 (scip-2.0.1.linu) T 1455 1457 1457 0 -1 4202496 21097 0 0 0 18645 283 0 0 25 0 1 0 869238117 88383488 19127 33554432000 4194304 13684479 140735263807248 18446744073709551615 7390244 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/1457/statm: 21578 19127 825 2317 0 19256 0
[pid=1455/tid=1467] ppid=1442 vsize=294652 CPUtime=0 cores=1,3,5,7
/proc/1455/task/1467/stat : 1467 (python) S 1442 1442 1406 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 869243264 301723648 6046 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458073869184 0 0 -1 7 0 0 0
[pid=1468] ppid=1442 vsize=294664 CPUtime=0.68 cores=1,3,5,7
/proc/1468/stat : 1468 (python) S 1442 1442 1406 0 -1 4202560 1170 0 0 0 33 35 0 0 15 0 2 0 869243266 301735936 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1468/statm: 73666 6045 397 364 0 8550 0
[pid=1470] ppid=1468 vsize=89784 CPUtime=185.84 cores=1,3,5,7
/proc/1470/stat : 1470 (scip-2.0.1.linu) T 1468 1470 1470 0 -1 4202496 144591 0 0 0 18494 90 0 0 25 0 1 0 869243266 91938816 19469 33554432000 4194304 15243407 140735630129328 18446744073709551615 8078686 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/1470/statm: 22446 19469 963 2698 0 19741 0
[pid=1468/tid=1476] ppid=1442 vsize=294664 CPUtime=0 cores=1,3,5,7
/proc/1468/task/1476/stat : 1476 (python) S 1442 1442 1406 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869248103 301735936 6045 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458424988992 0 0 -1 1 0 0 0
[pid=1477] ppid=1442 vsize=304920 CPUtime=0.19 cores=1,3,5,7
/proc/1477/stat : 1477 (python) S 1442 1442 1406 0 -1 4202560 1142 0 0 0 9 10 0 0 17 0 2 0 869248105 312238080 6049 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1477/statm: 76230 6049 397 364 0 11111 0
[pid=1479] ppid=1477 vsize=104036 CPUtime=49.58 cores=1,3,5,7
/proc/1479/stat : 1479 (wbo1.4a) T 1477 1479 1479 0 -1 4202496 25880 0 0 0 4892 66 0 0 25 0 1 0 869248106 106532864 25562 33554432000 134512640 135751879 4291896448 18446744073709551615 134516982 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/1479/statm: 26009 25562 146 303 0 25704 0
[pid=1477/tid=1481] ppid=1442 vsize=304920 CPUtime=0 cores=1,3,5,7
/proc/1477/task/1481/stat : 1481 (python) S 1442 1442 1406 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869253064 312238080 6049 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604470238353600 0 0 -1 7 0 0 0
[pid=1511] ppid=1442 vsize=315680 CPUtime=0.17 cores=1,3,5,7
/proc/1511/stat : 1511 (python) S 1442 1442 1406 0 -1 4202560 1144 0 0 0 7 10 0 0 16 0 2 0 869262306 323256320 6164 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1511/statm: 78920 6164 397 364 0 13798 0
[pid=1513] ppid=1511 vsize=129736 CPUtime=47.91 cores=1,3,5,7
/proc/1513/stat : 1513 (bsolo_pb10) T 1511 1513 1513 0 -1 4202496 30324 0 0 0 4764 27 0 0 25 0 1 0 869262306 132849664 30003 33554432000 134512640 137138936 4286597520 18446744073709551615 134542516 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/1513/statm: 32434 30003 191 642 0 31790 0
[pid=1511/tid=1515] ppid=1442 vsize=315680 CPUtime=0 cores=1,3,5,7
/proc/1511/task/1515/stat : 1515 (python) S 1442 1442 1406 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869267098 323256320 6164 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458424989888 0 0 -1 7 0 0 0
[pid=1516] ppid=1442 vsize=325936 CPUtime=0.17 cores=1,3,5,7
/proc/1516/stat : 1516 (python) S 1442 1442 1406 0 -1 4202560 1138 0 0 0 8 9 0 0 16 0 2 0 869267101 333758464 6168 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1516/statm: 81484 6168 397 364 0 16359 0
[pid=1518] ppid=1516 vsize=102896 CPUtime=46.78 cores=1,3,5,7
/proc/1518/stat : 1518 (bsolo_pb10) T 1516 1518 1518 0 -1 4202496 23608 0 0 0 4670 8 0 0 25 0 1 0 869267101 105365504 23284 33554432000 134512640 137138936 4287059632 18446744073709551615 134606670 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/1518/statm: 25724 23284 192 642 0 25080 0
[pid=1516/tid=1520] ppid=1442 vsize=325936 CPUtime=0 cores=1,3,5,7
/proc/1516/task/1520/stat : 1520 (python) S 1442 1442 1406 0 -1 4202560 53 0 0 0 0 0 0 0 16 0 2 0 869271780 333758464 6168 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604469446037824 0 0 -1 7 0 0 0
[pid=1642] ppid=1442 vsize=336192 CPUtime=0.34 cores=1,3,5,7
/proc/1642/stat : 1642 (python) S 1442 1442 1406 0 -1 4202560 1215 0 0 0 16 18 0 0 15 0 2 0 869285534 344260608 6178 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1642/statm: 84048 6178 403 364 0 18920 0
[pid=1644] ppid=1642 vsize=3444 CPUtime=94.2 cores=1,3,5,7
/proc/1644/stat : 1644 (clasp-1.3.7-x86) T 1642 1644 1644 0 -1 4202496 907 0 0 0 9420 0 0 0 25 0 1 0 869285534 3526656 629 33554432000 134512640 136139019 4291340720 18446744073709551615 134830029 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/1644/statm: 861 629 189 398 0 461 0
[pid=1642/tid=1668] ppid=1442 vsize=336192 CPUtime=0 cores=1,3,5,7
/proc/1642/task/1668/stat : 1668 (python) S 1442 1442 1406 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 869290338 344260608 6178 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604467442163968 0 0 -1 7 0 0 0
[pid=1680] ppid=1442 vsize=346448 CPUtime=0.17 cores=1,3,5,7
/proc/1680/stat : 1680 (python) S 1442 1442 1406 0 -1 4202560 1224 0 0 0 7 10 0 0 16 0 2 0 869299510 354762752 6182 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/1680/statm: 86612 6182 403 364 0 21481 0
[pid=1682] ppid=1680 vsize=8552372 CPUtime=49.77 cores=1,3,5,7
/proc/1682/stat : 1682 (java) T 1680 1682 1682 0 -1 4202496 142288 0 1 0 4958 19 0 0 18 0 19 0 869299510 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/1682/statm: 2138093 102942 2244 9 0 2128834 0
[pid=1682/tid=1683] ppid=1680 vsize=8552372 CPUtime=46.88 cores=1,3,5,7
/proc/1682/task/1683/stat : 1683 (java) T 1680 1682 1682 0 -1 4202560 95004 0 1 0 4677 11 0 0 25 0 19 0 869299511 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 46912505844108 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1684] ppid=1680 vsize=8552372 CPUtime=0.12 cores=1,3,5,7
/proc/1682/task/1684/stat : 1684 (java) T 1680 1682 1682 0 -1 4202560 3708 0 0 0 12 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1685] ppid=1680 vsize=8552372 CPUtime=0.13 cores=1,3,5,7
/proc/1682/task/1685/stat : 1685 (java) T 1680 1682 1682 0 -1 4202560 3139 0 0 0 13 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1682/tid=1686] ppid=1680 vsize=8552372 CPUtime=0.12 cores=1,3,5,7
/proc/1682/task/1686/stat : 1686 (java) T 1680 1682 1682 0 -1 4202560 3593 0 0 0 12 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1682/tid=1687] ppid=1680 vsize=8552372 CPUtime=0.09 cores=1,3,5,7
/proc/1682/task/1687/stat : 1687 (java) T 1680 1682 1682 0 -1 4202560 3667 0 0 0 9 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1688] ppid=1680 vsize=8552372 CPUtime=0.13 cores=1,3,5,7
/proc/1682/task/1688/stat : 1688 (java) T 1680 1682 1682 0 -1 4202560 4281 0 0 0 13 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1689] ppid=1680 vsize=8552372 CPUtime=0.11 cores=1,3,5,7
/proc/1682/task/1689/stat : 1689 (java) T 1680 1682 1682 0 -1 4202560 3651 0 0 0 11 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1690] ppid=1680 vsize=8552372 CPUtime=0.11 cores=1,3,5,7
/proc/1682/task/1690/stat : 1690 (java) T 1680 1682 1682 0 -1 4202560 3225 0 0 0 11 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1691] ppid=1680 vsize=8552372 CPUtime=0.13 cores=1,3,5,7
/proc/1682/task/1691/stat : 1691 (java) T 1680 1682 1682 0 -1 4202560 3605 0 0 0 13 0 0 0 15 0 19 0 869299512 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1692] ppid=1680 vsize=8552372 CPUtime=0.01 cores=1,3,5,7
/proc/1682/task/1692/stat : 1692 (java) T 1680 1682 1682 0 -1 4202560 137 0 0 0 0 1 0 0 15 0 19 0 869299513 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650752 0 0 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1682/tid=1693] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1693/stat : 1693 (java) T 1680 1682 1682 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869299513 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1694] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1694/stat : 1694 (java) T 1680 1682 1682 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869299513 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1695] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1695/stat : 1695 (java) T 1680 1682 1682 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869299516 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528657841 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1696] ppid=1680 vsize=8552372 CPUtime=1.05 cores=1,3,5,7
/proc/1682/task/1696/stat : 1696 (java) T 1680 1682 1682 0 -1 4202560 8648 0 0 0 105 0 0 0 15 0 19 0 869299516 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1697] ppid=1680 vsize=8552372 CPUtime=0.8 cores=1,3,5,7
/proc/1682/task/1697/stat : 1697 (java) T 1680 1682 1682 0 -1 4202560 8232 0 0 0 78 2 0 0 15 0 19 0 869299516 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1682/tid=1698] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1698/stat : 1698 (java) T 1680 1682 1682 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869299516 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1682/tid=1699] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1699/stat : 1699 (java) T 1680 1682 1682 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869299516 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1682/tid=1700] ppid=1680 vsize=8552372 CPUtime=0 cores=1,3,5,7
/proc/1682/task/1700/stat : 1700 (java) T 1680 1682 1682 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869299545 8757628928 102942 33554432000 1073741824 1073778376 140735902888176 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1680/tid=1785] ppid=1442 vsize=346448 CPUtime=0 cores=1,3,5,7
/proc/1680/task/1785/stat : 1785 (python) S 1442 1442 1406 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869304238 354762752 6182 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554946 18446604471161719488 0 0 -1 1 0 0 0
[pid=1786] ppid=1442 vsize=356704 CPUtime=0 cores=1,3,5,7
/proc/1786/stat : 1786 (python) S 1442 1442 1406 0 -1 4202560 889 0 0 0 0 0 0 0 15 0 1 0 869304240 365264896 6138 33554432000 4194304 5683644 140735796739040 18446744073709551615 246516854342 0 0 16781312 33554946 3106931581890068480 0 0 17 5 0 0 0
/proc/1786/statm: 89176 6138 356 364 0 24042 0
[pid=1788] ppid=1786 vsize=8537004 CPUtime=1.46 cores=1,3,5,7
/proc/1788/stat : 1788 (java) S 1786 1788 1788 0 -1 4202496 13847 0 1 0 144 2 0 0 20 0 19 0 869304240 8741892096 11974 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/1788/statm: 2134251 11974 2223 9 0 2124992 0
[pid=1788/tid=1789] ppid=1786 vsize=8537004 CPUtime=0.82 cores=1,3,5,7
/proc/1788/task/1789/stat : 1789 (java) R 1786 1788 1788 0 -1 4202560 8583 0 1 0 81 1 0 0 25 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 47831385443155 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=1788/tid=1790] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1790/stat : 1790 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1791] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1791/stat : 1791 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1792] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1792/stat : 1792 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1794] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1794/stat : 1794 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1795] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1795/stat : 1795 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1796] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1796/stat : 1796 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1797] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1797/stat : 1797 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1798] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1798/stat : 1798 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304241 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1799] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1799/stat : 1799 (java) S 1786 1788 1788 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 869304242 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650752 0 0 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1800] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1800/stat : 1800 (java) S 1786 1788 1788 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869304243 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1801] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1801/stat : 1801 (java) S 1786 1788 1788 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869304243 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1802] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1802/stat : 1802 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304245 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528657841 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1803] ppid=1786 vsize=8537004 CPUtime=0.35 cores=1,3,5,7
/proc/1788/task/1803/stat : 1803 (java) S 1786 1788 1788 0 -1 4202560 2048 0 0 0 35 0 0 0 15 0 19 0 869304245 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 3 0 0 0
[pid=1788/tid=1804] ppid=1786 vsize=8537004 CPUtime=0.28 cores=1,3,5,7
/proc/1788/task/1804/stat : 1804 (java) S 1786 1788 1788 0 -1 4202560 1826 0 0 0 28 0 0 0 15 0 19 0 869304245 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 1 0 0 0
[pid=1788/tid=1805] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1805/stat : 1805 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869304245 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650137 0 4 0 16800975 18446604466350238720 0 0 -1 5 0 0 0
[pid=1788/tid=1806] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1806/stat : 1806 (java) S 1786 1788 1788 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869304245 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650752 0 4 0 16800975 18446604466350238720 0 0 -1 3 0 0 0
[pid=1788/tid=1808] ppid=1786 vsize=8537004 CPUtime=0 cores=1,3,5,7
/proc/1788/task/1808/stat : 1808 (java) S 1786 1788 1788 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869304273 8741892096 11985 33554432000 1073741824 1073778376 140733215112064 18446744073709551615 246528650752 0 4 0 16800975 18446604466350238720 0 0 -1 1 0 0 0
[pid=1442/tid=1456] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1456/stat : 1456 (python) S 1438 1442 1406 0 -1 4202560 40 920 0 9 0 0 0 0 15 0 9 0 869238116 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
[pid=1442/tid=1469] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1469/stat : 1469 (python) S 1438 1442 1406 0 -1 4202560 35 920 0 9 0 0 0 0 18 0 9 0 869243266 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
[pid=1442/tid=1478] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1478/stat : 1478 (python) S 1438 1442 1406 0 -1 4202560 30 920 0 9 0 0 0 0 20 0 9 0 869248106 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 1 0 0 0
[pid=1442/tid=1512] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1512/stat : 1512 (python) S 1438 1442 1406 0 -1 4202560 32 920 0 9 0 0 0 0 20 0 9 0 869262306 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 1 0 0 0
[pid=1442/tid=1517] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1517/stat : 1517 (python) S 1438 1442 1406 0 -1 4202560 33 920 0 9 0 0 0 0 20 0 9 0 869267101 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 3 0 0 0
[pid=1442/tid=1643] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1643/stat : 1643 (python) S 1438 1442 1406 0 -1 4202560 26 920 0 9 0 0 0 0 18 0 9 0 869285534 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 1 0 0 0
[pid=1442/tid=1681] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1681/stat : 1681 (python) S 1438 1442 1406 0 -1 4202560 29 920 0 9 0 0 0 0 20 0 9 0 869299510 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 1 0 0 0
[pid=1442/tid=1787] ppid=1438 vsize=366948 CPUtime=0 cores=1,3,5,7
/proc/1442/task/1787/stat : 1787 (python) S 1438 1442 1406 0 -1 4202560 27 920 0 9 0 0 0 0 20 0 9 0 869304240 375754752 7671 33554432000 4194304 5683644 140735796739040 18446744073709551615 246528657841 0 0 16781312 33554434 18446604470238352704 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 668.24
Current children cumulated vsize (KiB) 20547728

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1442 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=790879
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=219966
# CPU time returned by wait4() is 1.01084
# while last known CPU time is 668.24
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 687.598
CPU time (s): 668.24
CPU user time (s): 661.78
CPU system time (s): 6.46
CPU usage (%): 97.1847
Max. virtual memory (cumulated for all children) (KiB): 20547728

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.790879
system time used= 0.219966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17354
page faults= 121
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16529
involuntary context switches= 82

runsolver used 3.13152 second user time and 7.48186 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-09 01:39:17
IDJOB=3481819
IDBENCH=1870
IDSOLVER=1970
FILE ID=node134/3481819-1307576356
RUNJOBID= node134-1307576356-1425
PBS_JOBID= 13547665
Free space on /tmp= 74072 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-protfold.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481819-1307576356/watcher-3481819-1307576356 -o /tmp/evaluation-result-3481819-1307576356/solver-3481819-1307576356 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481819-1307576356.opb -seed 611056974 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7f40f8d513f22fc9adca96d8fdf626e2
RANDOM SEED=611056974

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26948128 kB
Buffers:        141208 kB
Cached:         425132 kB
SwapCached:      10388 kB
Active:        5543444 kB
Inactive:       162160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26948128 kB
SwapTotal:    67111528 kB
SwapFree:     43359760 kB
Dirty:          206764 kB
Writeback:           0 kB
AnonPages:     5137104 kB
Mapped:          20640 kB
Slab:           140688 kB
PageTables:      89128 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 110746080 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73780 MiB
End job on node134 at 2011-06-09 01:51:03