Trace number 3481654

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 192.84 190.294

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-LIN/submittedPB07/
aksoy/area_delay/normalized-fir09_area_delay.opb
MD5SUM5a18fe98bad06341d01eaf33ecb4f046
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark17
Best CPU time to get the best result obtained on this benchmark55.4896
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 17
Optimality of the best value was proved NO
Number of variables13487
Total number of constraints57800
Number of constraints which are clauses57800
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint254
Number of terms in the objective function 6486
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 6486
Number of bits of the sum of numbers in the objective function 13
Biggest number in a constraint 2
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 6486
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.35/0.67	c INFO: solving HOME/instance-3481654-1307577668.opb
0.64/0.99	c INFO: parsing took 0.31 s
1.24/1.53	c INFO: features took 0.54 CPU seconds
1.24/1.56	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.19)
47.60/47.78	c INFO: running sat4j-pb-v20101225@0 for 45 with 1753 remaining (b = 0.06)
95.92/93.76	c INFO: running scip-2.0.1-clp@0 for 45 with 1705 remaining (b = 0.03)
144.22/141.87	c INFO: running wbo1.4a@0 for 45 with 1657 remaining (b = 0.02)
192.73/190.13	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1609 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481654-1307577668/watcher-3481654-1307577668 -o /tmp/evaluation-result-3481654-1307577668/solver-3481654-1307577668 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481654-1307577668.opb -seed 1269312529 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.26 2.13 1.59 3/685 3586
/proc/meminfo: memFree=21631528/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=15388 CPUtime=0 cores=0,2,4,6
/proc/3586/stat : 3586 (python) R 3581 3586 2236 0 -1 4202496 812 0 0 0 0 0 0 0 22 0 1 0 869365667 15757312 698 33554432000 4194304 5683644 140737313933952 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3586/statm: 3847 698 334 364 0 334 0

[startup+0.095396 s]
/proc/loadavg: 2.26 2.13 1.59 3/685 3586
/proc/meminfo: memFree=21631528/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=85364 CPUtime=0.06 cores=0,2,4,6
/proc/3586/stat : 3586 (python) R 3581 3586 2236 0 -1 4202496 2585 0 0 0 4 2 0 0 22 0 1 0 869365667 87412736 2310 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606695794 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3586/statm: 21342 2312 710 364 0 1559 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85364

[startup+0.100443 s]
/proc/loadavg: 2.26 2.13 1.59 3/685 3586
/proc/meminfo: memFree=21631528/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=85624 CPUtime=0.06 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 2665 0 0 0 4 2 0 0 22 0 1 0 869365667 87678976 2382 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/3586/statm: 21406 2382 715 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85624

[startup+0.300413 s]
/proc/loadavg: 2.26 2.13 1.59 3/685 3586
/proc/meminfo: memFree=21631528/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=123744 CPUtime=0.17 cores=0,2,4,6
/proc/3586/stat : 3586 (python) R 3581 3586 2236 0 -1 4202496 5357 931 1 0 11 6 0 0 22 0 1 0 869365667 126713856 3744 33554432000 4194304 5683644 140737313933952 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3586/statm: 30936 3744 987 364 0 2768 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123744

[startup+0.700402 s]
/proc/loadavg: 2.26 2.13 1.59 3/685 3586
/proc/meminfo: memFree=21631528/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=285112 CPUtime=0.45 cores=0,2,4,6
/proc/3586/stat : 3586 (python) R 3581 3586 2236 0 -1 4202496 9709 931 1 0 33 12 0 0 21 0 1 0 869365667 291954688 7571 33554432000 4194304 5683644 140737313933952 18446744073709551615 4540638 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3586/statm: 71278 7571 1781 364 0 6171 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 285112

[startup+1.50026 s]
/proc/loadavg: 2.26 2.13 1.59 3/686 3591
/proc/meminfo: memFree=21596676/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=295280 CPUtime=1.24 cores=0,2,4,6
/proc/3586/stat : 3586 (python) R 3581 3586 2236 0 -1 4202496 14408 931 1 0 112 12 0 0 25 0 1 0 869365667 302366720 10140 33554432000 4194304 5683644 140737313933952 18446744073709551615 4940544 0 0 16781312 33554434 0 0 0 17 4 0 0 0
/proc/3586/statm: 73820 10140 1816 364 0 8713 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 295280

[startup+3.10098 s]
/proc/loadavg: 2.23 2.12 1.59 3/689 3594
/proc/meminfo: memFree=21503776/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=306452 CPUtime=1.3 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 14947 931 1 0 118 12 0 0 25 0 2 0 869365667 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/3586/statm: 76613 10451 1870 364 0 11500 0
[pid=3592] ppid=3586 vsize=296208 CPUtime=0 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 737 0 0 0 0 0 0 0 16 0 1 0 869365823 303316992 8928 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886671 0 0 16781312 33554946 17224736169015607554 0 0 17 2 0 0 0
/proc/3592/statm: 74052 8928 351 364 0 8939 0
[pid=3594] ppid=3592 vsize=122440 CPUtime=1.53 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) R 3592 3594 3594 0 -1 4202496 30160 0 0 0 144 9 0 0 25 0 1 0 869365823 125378560 27932 33554432000 4194304 13684479 140735338982832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3594/statm: 30610 27932 643 2317 0 28288 0
[pid=3586/tid=3593] ppid=3581 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 2 0 869365823 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 725100

[startup+6.30035 s]
/proc/loadavg: 2.23 2.12 1.59 3/689 3594
/proc/meminfo: memFree=21417088/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=306452 CPUtime=1.3 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 14947 931 1 0 118 12 0 0 25 0 2 0 869365667 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/3586/statm: 76613 10451 1870 364 0 11500 0
[pid=3592] ppid=3586 vsize=296208 CPUtime=0.01 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 904 0 0 0 0 1 0 0 15 0 1 0 869365823 303316992 8952 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886671 0 0 16781312 33554946 2804641630294900736 0 0 17 6 0 0 0
/proc/3592/statm: 74052 8952 375 364 0 8939 0
[pid=3594] ppid=3592 vsize=201868 CPUtime=4.72 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) R 3592 3594 3594 0 -1 4202496 49901 0 0 0 454 18 0 0 25 0 1 0 869365823 206712832 47243 33554432000 4194304 13684479 140735338982832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3594/statm: 50467 47243 813 2317 0 48145 0
[pid=3586/tid=3593] ppid=3581 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 2 0 869365823 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 804528

[startup+12.7012 s]
/proc/loadavg: 2.20 2.12 1.59 3/689 3594
/proc/meminfo: memFree=21356876/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=306452 CPUtime=1.3 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 14947 931 1 0 118 12 0 0 25 0 2 0 869365667 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/3586/statm: 76613 10451 1870 364 0 11500 0
[pid=3592] ppid=3586 vsize=296208 CPUtime=0.03 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 911 0 0 0 1 2 0 0 15 0 1 0 869365823 303316992 8952 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886671 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/3592/statm: 74052 8952 375 364 0 8939 0
[pid=3594] ppid=3592 vsize=253464 CPUtime=11.13 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) R 3592 3594 3594 0 -1 4202496 62283 0 0 0 1089 24 0 0 25 0 1 0 869365823 259547136 59591 33554432000 4194304 13684479 140735338982832 18446744073709551615 7095800 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3594/statm: 63366 59591 803 2317 0 61044 0
[pid=3586/tid=3593] ppid=3581 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 2 0 869365823 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 856124

[startup+25.5009 s]
/proc/loadavg: 2.17 2.11 1.60 3/689 3595
/proc/meminfo: memFree=21352724/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=306452 CPUtime=1.3 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 14947 931 1 0 118 12 0 0 25 0 2 0 869365667 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/3586/statm: 76613 10451 1870 364 0 11500 0
[pid=3592] ppid=3586 vsize=296208 CPUtime=0.1 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 916 0 0 0 4 6 0 0 15 0 1 0 869365823 303316992 8952 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886671 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/3592/statm: 74052 8952 375 364 0 8939 0
[pid=3594] ppid=3592 vsize=257404 CPUtime=23.92 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) R 3592 3594 3594 0 -1 4202496 63344 0 0 0 2363 29 0 0 25 0 1 0 869365823 263581696 60650 33554432000 4194304 13684479 140735338982832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/3594/statm: 64351 60650 808 2317 0 62029 0
[pid=3586/tid=3593] ppid=3581 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 2 0 869365823 313806848 10451 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.32
Current children cumulated vsize (KiB) 860064

[startup+51.1015 s]
/proc/loadavg: 2.11 2.10 1.61 3/711 3617
/proc/meminfo: memFree=21133444/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=316708 CPUtime=1.33 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 15803 931 1 0 120 13 0 0 20 0 3 0 869365667 324308992 10458 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/3586/statm: 79177 10458 1873 364 0 14061 0
[pid=3592] ppid=3586 vsize=306452 CPUtime=0.19 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 1089 0 0 0 9 10 0 0 16 0 2 0 869365823 313806848 8988 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/3592/statm: 76613 8988 406 364 0 11500 0
[pid=3594] ppid=3592 vsize=314092 CPUtime=46.18 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) T 3592 3594 3594 0 -1 4202496 77471 0 0 0 4575 43 0 0 25 0 1 0 869365823 321630208 74770 33554432000 4194304 13684479 140735338982832 18446744073709551615 7098848 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/3594/statm: 78523 74770 839 2317 0 76201 0
[pid=3592/tid=3596] ppid=3586 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3592/task/3596/stat : 3596 (python) S 3586 3586 2236 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869370443 313806848 8988 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604445224774528 0 0 -1 6 0 0 0
[pid=3597] ppid=3586 vsize=306464 CPUtime=0.02 cores=0,2,4,6
/proc/3597/stat : 3597 (python) S 3586 3586 2236 0 -1 4202560 926 0 0 0 1 1 0 0 15 0 1 0 869370445 313819136 8953 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886726 0 0 16781312 33554946 2382751893366472962 0 0 17 0 0 0 0
/proc/3597/statm: 76616 8953 372 364 0 11500 0
[pid=3599] ppid=3597 vsize=8539352 CPUtime=4.5 cores=0,2,4,6
/proc/3599/stat : 3599 (java) S 3597 3599 3599 0 -1 4202496 46282 0 1 0 444 6 0 0 21 0 19 0 869370446 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/3599/statm: 2134838 41542 2247 9 0 2125579 0
[pid=3599/tid=3600] ppid=3597 vsize=8539352 CPUtime=3.28 cores=0,2,4,6
/proc/3599/task/3600/stat : 3600 (java) R 3597 3599 3599 0 -1 4202560 35258 0 1 0 324 4 0 0 25 0 19 0 869370446 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 46912506021783 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=3599/tid=3601] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3601/stat : 3601 (java) S 3597 3599 3599 0 -1 4202560 734 0 0 0 0 0 0 0 17 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 4 0 0 0
[pid=3599/tid=3602] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3602/stat : 3602 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3603] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3603/stat : 3603 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 2 0 0 0
[pid=3599/tid=3604] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3604/stat : 3604 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 4 0 0 0
[pid=3599/tid=3605] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3605/stat : 3605 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3606] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3606/stat : 3606 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3607] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3607/stat : 3607 (java) S 3597 3599 3599 0 -1 4202560 360 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 2 0 0 0
[pid=3599/tid=3608] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3608/stat : 3608 (java) S 3597 3599 3599 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 19 0 869370447 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3609] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3609/stat : 3609 (java) S 3597 3599 3599 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 19 0 869370448 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 0 0 16800975 18446604443259992192 0 0 -1 4 0 0 0
[pid=3599/tid=3610] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3610/stat : 3610 (java) S 3597 3599 3599 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869370448 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3611] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3611/stat : 3611 (java) S 3597 3599 3599 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869370448 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3612] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3612/stat : 3612 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869370450 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606690225 0 4 0 16800975 18446604443259992192 0 0 -1 4 0 0 0
[pid=3599/tid=3613] ppid=3597 vsize=8539352 CPUtime=0.61 cores=0,2,4,6
/proc/3599/task/3613/stat : 3613 (java) S 3597 3599 3599 0 -1 4202560 5144 0 0 0 61 0 0 0 18 0 19 0 869370450 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 0 0 0 0
[pid=3599/tid=3614] ppid=3597 vsize=8539352 CPUtime=0.55 cores=0,2,4,6
/proc/3599/task/3614/stat : 3614 (java) S 3597 3599 3599 0 -1 4202560 2516 0 0 0 55 0 0 0 16 0 19 0 869370450 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 2 0 0 0
[pid=3599/tid=3615] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3615/stat : 3615 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869370450 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446604443259992192 0 0 -1 4 0 0 0
[pid=3599/tid=3616] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3616/stat : 3616 (java) S 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869370450 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3599/tid=3617] ppid=3597 vsize=8539352 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3617/stat : 3617 (java) S 3597 3599 3599 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869370524 8744296448 41542 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 4 0 16800975 18446604443259992192 0 0 -1 6 0 0 0
[pid=3586/tid=3593] ppid=3581 vsize=316708 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 3 0 869365823 324308992 10458 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3598] ppid=3581 vsize=316708 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/3623/stat : 3623 (scip-2.0.1.linu) T 3621 3623 3623 0 -1 4202496 65932 0 0 0 4774 32 0 0 25 0 1 0 869375044 284815360 63522 33554432000 4194304 15243407 140733889351472 18446744073709551615 7323016 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/3623/statm: 69535 63522 885 2698 0 66830 0
[pid=3621/tid=3626] ppid=3586 vsize=316720 CPUtime=0 cores=0,2,4,6
/proc/3621/task/3626/stat : 3626 (python) S 3586 3586 2236 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869379852 324321280 8982 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604449437560896 0 0 -1 6 0 0 0
[pid=3627] ppid=3586 vsize=326976 CPUtime=0.07 cores=0,2,4,6
/proc/3627/stat : 3627 (python) S 3586 3586 2236 0 -1 4202560 959 0 0 0 3 4 0 0 15 0 1 0 869379854 334823424 8961 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886726 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/3627/statm: 81744 8961 372 364 0 16622 0
[pid=3629] ppid=3627 vsize=33336 CPUtime=20.41 cores=0,2,4,6
/proc/3629/stat : 3629 (wbo1.4a) R 3627 3629 3629 0 -1 4202496 9449 0 0 0 2034 7 0 0 25 0 1 0 869379855 34136064 7860 33554432000 134512640 135751879 4290095904 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 2 0 0 0
/proc/3629/statm: 8334 7860 146 303 0 8029 0
[pid=3586/tid=3593] ppid=3581 vsize=337220 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 5 0 869365823 345313280 10470 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3598] ppid=3581 vsize=337220 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3598/stat : 3598 (python) S 3581 3586 2236 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 5 0 869370446 345313280 10470 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3622] ppid=3581 vsize=337220 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3622/stat : 3622 (python) S 3581 3586 2236 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 5 0 869375044 345313280 10470 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3628] ppid=3581 vsize=337220 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3628/stat : 3628 (python) S 3581 3586 2236 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 5 0 869379855 345313280 10470 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 164.79
Current children cumulated vsize (KiB) 10772808



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+190.202 s]
/proc/loadavg: 2.26 2.13 1.68 5/726 3712
/proc/meminfo: memFree=20309768/32950928 swapFree=34366004/67111528
[pid=3586] ppid=3581 vsize=347476 CPUtime=1.41 cores=0,2,4,6
/proc/3586/stat : 3586 (python) S 3581 3586 2236 0 -1 4202496 18420 931 1 0 128 13 0 0 20 0 6 0 869365667 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/3586/statm: 86869 10476 1879 364 0 21744 0
[pid=3592] ppid=3586 vsize=306452 CPUtime=0.19 cores=0,2,4,6
/proc/3592/stat : 3592 (python) S 3586 3586 2236 0 -1 4202560 1089 0 0 0 9 10 0 0 16 0 2 0 869365823 313806848 8988 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/3592/statm: 76613 8988 406 364 0 11500 0
[pid=3594] ppid=3592 vsize=314092 CPUtime=46.18 cores=0,2,4,6
/proc/3594/stat : 3594 (scip-2.0.1.linu) T 3592 3594 3594 0 -1 4202496 77471 0 0 0 4575 43 0 0 25 0 1 0 869365823 321630208 74770 33554432000 4194304 13684479 140735338982832 18446744073709551615 7098848 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/3594/statm: 78523 74770 839 2317 0 76201 0
[pid=3592/tid=3596] ppid=3586 vsize=306452 CPUtime=0 cores=0,2,4,6
/proc/3592/task/3596/stat : 3596 (python) S 3586 3586 2236 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869370443 313806848 8988 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604445224774528 0 0 -1 6 0 0 0
[pid=3597] ppid=3586 vsize=306464 CPUtime=0.2 cores=0,2,4,6
/proc/3597/stat : 3597 (python) S 3586 3586 2236 0 -1 4202560 1112 0 0 0 10 10 0 0 16 0 2 0 869370445 313819136 8978 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0
/proc/3597/statm: 76616 8978 396 364 0 11500 0
[pid=3599] ppid=3597 vsize=8553408 CPUtime=48.07 cores=0,2,4,6
/proc/3599/stat : 3599 (java) T 3597 3599 3599 0 -1 4202496 58951 0 1 0 4800 7 0 0 18 0 19 0 869370446 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/3599/statm: 2138352 49962 2259 9 0 2129093 0
[pid=3599/tid=3600] ppid=3597 vsize=8553408 CPUtime=45.77 cores=0,2,4,6
/proc/3599/task/3600/stat : 3600 (java) T 3597 3599 3599 0 -1 4202560 35269 0 1 0 4573 4 0 0 25 0 19 0 869370446 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 46912506013212 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=3599/tid=3601] ppid=3597 vsize=8553408 CPUtime=0.01 cores=0,2,4,6
/proc/3599/task/3601/stat : 3601 (java) T 3597 3599 3599 0 -1 4202560 1392 0 0 0 1 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3602] ppid=3597 vsize=8553408 CPUtime=0.01 cores=0,2,4,6
/proc/3599/task/3602/stat : 3602 (java) T 3597 3599 3599 0 -1 4202560 772 0 0 0 1 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3603] ppid=3597 vsize=8553408 CPUtime=0.01 cores=0,2,4,6
/proc/3599/task/3603/stat : 3603 (java) T 3597 3599 3599 0 -1 4202560 782 0 0 0 1 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=3599/tid=3604] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3604/stat : 3604 (java) T 3597 3599 3599 0 -1 4202560 107 0 0 0 0 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3605] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3605/stat : 3605 (java) T 3597 3599 3599 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3606] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3606/stat : 3606 (java) T 3597 3599 3599 0 -1 4202560 4 0 0 0 0 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3607] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3607/stat : 3607 (java) T 3597 3599 3599 0 -1 4202560 393 0 0 0 0 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3608] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3608/stat : 3608 (java) T 3597 3599 3599 0 -1 4202560 801 0 0 0 0 0 0 0 15 0 19 0 869370447 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=3599/tid=3609] ppid=3597 vsize=8553408 CPUtime=0.12 cores=0,2,4,6
/proc/3599/task/3609/stat : 3609 (java) T 3597 3599 3599 0 -1 4202560 2903 0 0 0 12 0 0 0 15 0 19 0 869370448 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 0 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=3599/tid=3610] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3610/stat : 3610 (java) T 3597 3599 3599 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869370448 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3611] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3611/stat : 3611 (java) T 3597 3599 3599 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869370448 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3612] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3612/stat : 3612 (java) T 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370450 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606690225 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=3599/tid=3613] ppid=3597 vsize=8553408 CPUtime=0.74 cores=0,2,4,6
/proc/3599/task/3613/stat : 3613 (java) T 3597 3599 3599 0 -1 4202560 5261 0 0 0 74 0 0 0 15 0 19 0 869370450 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3599/tid=3614] ppid=3597 vsize=8553408 CPUtime=1.33 cores=0,2,4,6
/proc/3599/task/3614/stat : 3614 (java) T 3597 3599 3599 0 -1 4202560 9864 0 0 0 133 0 0 0 15 0 19 0 869370450 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=3599/tid=3615] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3615/stat : 3615 (java) T 3597 3599 3599 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869370450 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=3599/tid=3616] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3616/stat : 3616 (java) T 3597 3599 3599 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869370450 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=3599/tid=3617] ppid=3597 vsize=8553408 CPUtime=0 cores=0,2,4,6
/proc/3599/task/3617/stat : 3617 (java) T 3597 3599 3599 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869370524 8758689792 49962 33554432000 1073741824 1073778376 140733906367424 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=3597/tid=3620] ppid=3586 vsize=306464 CPUtime=0 cores=0,2,4,6
/proc/3597/task/3620/stat : 3620 (python) S 3586 3586 2236 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869375041 313819136 8978 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604448262230080 0 0 -1 2 0 0 0
[pid=3621] ppid=3586 vsize=316720 CPUtime=0.22 cores=0,2,4,6
/proc/3621/stat : 3621 (python) S 3586 3586 2236 0 -1 4202560 1118 0 0 0 11 11 0 0 17 0 2 0 869375044 324321280 8982 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/3621/statm: 79180 8982 396 364 0 14061 0
[pid=3623] ppid=3621 vsize=278140 CPUtime=48.06 cores=0,2,4,6
/proc/3623/stat : 3623 (scip-2.0.1.linu) T 3621 3623 3623 0 -1 4202496 65932 0 0 0 4774 32 0 0 25 0 1 0 869375044 284815360 63522 33554432000 4194304 15243407 140733889351472 18446744073709551615 7323016 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/3623/statm: 69535 63522 885 2698 0 66830 0
[pid=3621/tid=3626] ppid=3586 vsize=316720 CPUtime=0 cores=0,2,4,6
/proc/3621/task/3626/stat : 3626 (python) S 3586 3586 2236 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869379852 324321280 8982 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604449437560896 0 0 -1 6 0 0 0
[pid=3627] ppid=3586 vsize=326976 CPUtime=0.22 cores=0,2,4,6
/proc/3627/stat : 3627 (python) S 3586 3586 2236 0 -1 4202560 1143 0 0 0 11 11 0 0 17 0 2 0 869379854 334823424 8986 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/3627/statm: 81744 8986 396 364 0 16622 0
[pid=3629] ppid=3627 vsize=55468 CPUtime=48.22 cores=0,2,4,6
/proc/3629/stat : 3629 (wbo1.4a) T 3627 3629 3629 0 -1 4202496 14960 0 0 0 4808 14 0 0 25 0 1 0 869379855 56799232 13371 33554432000 134512640 135751879 4290095904 18446744073709551615 134606387 0 0 16781312 3 18446744071562691360 0 0 17 2 0 0 0
/proc/3629/statm: 13867 13371 146 303 0 13562 0
[pid=3627/tid=3692] ppid=3586 vsize=326976 CPUtime=0 cores=0,2,4,6
/proc/3627/task/3692/stat : 3692 (python) S 3586 3586 2236 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869384678 334823424 8986 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554946 18446604448271136064 0 0 -1 6 0 0 0
[pid=3693] ppid=3586 vsize=337232 CPUtime=0 cores=0,2,4,6
/proc/3693/stat : 3693 (python) S 3586 3586 2236 0 -1 4202560 813 0 0 0 0 0 0 0 20 0 1 0 869384680 345325568 8941 33554432000 4194304 5683644 140737313933952 18446744073709551615 235594886726 0 0 16781312 33554946 3407467099474362368 0 0 17 0 0 0 0
/proc/3693/statm: 84308 8941 348 364 0 19183 0
[pid=3695] ppid=3693 vsize=8466088 CPUtime=0.07 cores=0,2,4,6
/proc/3695/stat : 3695 (java) S 3693 3695 3695 0 -1 4202496 4673 0 1 0 7 0 0 0 22 0 18 0 869384681 8669274112 4129 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/3695/statm: 2116522 4129 1749 9 0 2107263 0
[pid=3695/tid=3696] ppid=3693 vsize=8466088 CPUtime=0.08 cores=0,2,4,6
/proc/3695/task/3696/stat : 3696 (java) R 3693 3695 3695 0 -1 4202560 3364 0 1 0 8 0 0 0 25 0 18 0 869384681 8669274112 4402 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 47893632153112 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=3695/tid=3697] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3697/stat : 3697 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4402 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3698] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3698/stat : 3698 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4403 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3699] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3699/stat : 3699 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4403 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3700] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3700/stat : 3700 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4403 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3701] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3701/stat : 3701 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4403 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3702] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3702/stat : 3702 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3703] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3703/stat : 3703 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3704] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3704/stat : 3704 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384682 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3705] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3705/stat : 3705 (java) S 3693 3695 3695 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869384683 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606683136 0 0 0 16800975 18446604453877462272 0 0 -1 6 0 0 0
[pid=3695/tid=3706] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3706/stat : 3706 (java) S 3693 3695 3695 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869384683 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3695/tid=3707] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3707/stat : 3707 (java) S 3693 3695 3695 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869384683 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 6 0 0 0
[pid=3695/tid=3708] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3708/stat : 3708 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384685 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606690225 0 4 0 16800975 18446604453877462272 0 0 -1 6 0 0 0
[pid=3695/tid=3709] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3709/stat : 3709 (java) R 3693 3695 3695 0 -1 4202560 190 0 0 0 0 0 0 0 25 0 18 0 869384685 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 47893632609838 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=3695/tid=3710] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3710/stat : 3710 (java) R 3693 3695 3695 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869384685 8669274112 4404 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235594533819 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=3695/tid=3711] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3711/stat : 3711 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384685 8669274112 4405 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606682521 0 4 0 16800975 18446604453877462272 0 0 -1 6 0 0 0
[pid=3695/tid=3712] ppid=3693 vsize=8466088 CPUtime=0 cores=0,2,4,6
/proc/3695/task/3712/stat : 3712 (java) S 3693 3695 3695 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869384685 8669274112 4405 33554432000 1073741824 1073778376 140734794996192 18446744073709551615 235606683136 0 4 0 16800975 18446604453877462272 0 0 -1 2 0 0 0
[pid=3586/tid=3593] ppid=3581 vsize=347476 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3593/stat : 3593 (python) S 3581 3586 2236 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 6 0 869365823 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3598] ppid=3581 vsize=347476 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3598/stat : 3598 (python) S 3581 3586 2236 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 6 0 869370446 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3622] ppid=3581 vsize=347476 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3622/stat : 3622 (python) S 3581 3586 2236 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 6 0 869375044 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 0 0 0 0
[pid=3586/tid=3628] ppid=3581 vsize=347476 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3628/stat : 3628 (python) S 3581 3586 2236 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 6 0 869379855 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 2 0 0 0
[pid=3586/tid=3694] ppid=3581 vsize=347476 CPUtime=0 cores=0,2,4,6
/proc/3586/task/3694/stat : 3694 (python) S 3581 3586 2236 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 6 0 869384681 355815424 10476 33554432000 4194304 5683644 140737313933952 18446744073709551615 235606690225 0 0 16781312 33554434 18446604452085861056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 192.84
Current children cumulated vsize (KiB) 19608516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3586 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=287804
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=142978
# CPU time returned by wait4() is 1.43078
# while last known CPU time is 192.84
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 190.294
CPU time (s): 192.84
CPU user time (s): 191.33
CPU system time (s): 1.51
CPU usage (%): 101.338
Max. virtual memory (cumulated for all children) (KiB): 19608516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.2878
system time used= 0.142978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19354
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2866
involuntary context switches= 21

runsolver used 1.23781 second user time and 2.23066 second system time

The end

Launcher Data 

Begin job on node120 at 2011-06-09 02:01:08
IDJOB=3481654
IDBENCH=25003
IDSOLVER=1970
FILE ID=node120/3481654-1307577668
RUNJOBID= node120-1307576358-2263
PBS_JOBID= 13547679
Free space on /tmp= 73536 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-LIN/submittedPB07/aksoy/area_delay/normalized-fir09_area_delay.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481654-1307577668/watcher-3481654-1307577668 -o /tmp/evaluation-result-3481654-1307577668/solver-3481654-1307577668 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481654-1307577668.opb -seed 1269312529 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5a18fe98bad06341d01eaf33ecb4f046
RANDOM SEED=1269312529

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21631560 kB
Buffers:        159104 kB
Cached:         761132 kB
SwapCached:      12060 kB
Active:       10809852 kB
Inactive:       175508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21631560 kB
SwapTotal:    67111528 kB
SwapFree:     34366004 kB
Dirty:          103812 kB
Writeback:          32 kB
AnonPages:    10063204 kB
Mapped:          84356 kB
Slab:           145416 kB
PageTables:     117932 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 119905740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73388 MiB
End job on node120 at 2011-06-09 02:04:21