Trace number 3481478

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 147.45 144.275

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_200_25_2.opb
MD5SUMfaa00895e2f6f80e77634e2be522df62
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark10
Best CPU time to get the best result obtained on this benchmark491.485
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 12
Optimality of the best value was proved NO
Number of variables200
Total number of constraints200
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints200
Minimum length of a constraint26
Maximum length of a constraint45
Number of terms in the objective function 200
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 200
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)6220
Sum of products size (including duplicates)12440
Number of different products6220
Sum of products size12440

Solver Data 

0.38/0.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.38/0.50	c INFO: solving HOME/instance-3481478-1307577864.opb
0.38/0.57	c INFO: wrote linearized instance to HOME/tmp20x0Zc.opb
0.52/0.66	c INFO: parsing took 0.08 s
0.72/0.82	c INFO: features took 0.17 CPU seconds
0.72/0.85	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.27)
48.41/48.43	c INFO: running scip-2.0.1-clp@0 for 45 with 1752 remaining (b = 0.06)
95.71/95.51	c INFO: running sat4j-pb-v20101225@0 for 45 with 1706 remaining (b = 0.03)
145.12/143.26	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1657 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481478-1307577864/watcher-3481478-1307577864 -o /tmp/evaluation-result-3481478-1307577864/solver-3481478-1307577864 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481478-1307577864.opb -seed 1015436975 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.19 2.13 1.68 1/584 3752
/proc/meminfo: memFree=20246196/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/3752/stat : 3752 (python) R 3750 3752 1406 0 -1 4202496 859 0 0 0 0 0 0 0 17 0 1 0 869384695 16154624 741 33554432000 4194304 5683644 140736915718560 18446744073709551615 4617142 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/3752/statm: 3944 745 339 364 0 431 0

[startup+0.0565939 s]
/proc/loadavg: 2.19 2.13 1.68 1/584 3752
/proc/meminfo: memFree=20246196/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=34244 CPUtime=0.04 cores=1,3,5,7
/proc/3752/stat : 3752 (python) R 3750 3752 1406 0 -1 4202496 1522 0 0 0 3 1 0 0 17 0 1 0 869384695 35065856 1359 33554432000 4194304 5683644 140736915718560 18446744073709551615 4864839 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/3752/statm: 8561 1359 448 364 0 899 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34244

[startup+0.100551 s]
/proc/loadavg: 2.19 2.13 1.68 1/584 3752
/proc/meminfo: memFree=20246196/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=96128 CPUtime=0.06 cores=1,3,5,7
/proc/3752/stat : 3752 (python) R 3750 3752 1406 0 -1 4202496 3165 933 1 0 5 1 0 0 18 0 1 0 869384695 98435072 2484 33554432000 4194304 5683644 140736915718560 18446744073709551615 5279480 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/3752/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96128

[startup+0.300533 s]
/proc/loadavg: 2.19 2.13 1.68 1/584 3752
/proc/meminfo: memFree=20246196/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=168308 CPUtime=0.23 cores=1,3,5,7
/proc/3752/stat : 3752 (python) R 3750 3752 1406 0 -1 4202496 5975 933 1 0 16 7 0 0 17 0 1 0 869384695 172347392 4292 33554432000 4194304 5683644 140736915718560 18446744073709551615 246520242857 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/3752/statm: 42077 4292 1200 364 0 3294 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 168308

[startup+0.700487 s]
/proc/loadavg: 2.19 2.13 1.68 1/584 3752
/proc/meminfo: memFree=20246196/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=285308 CPUtime=0.62 cores=1,3,5,7
/proc/3752/stat : 3752 (python) R 3750 3752 1406 0 -1 4202496 11276 1383 1 0 43 12 5 2 17 0 1 0 869384695 292155392 7675 33554432000 4194304 5683644 140736915718560 18446744073709551615 47824826265627 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/3752/statm: 71327 7675 1816 364 0 6220 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 285308

[startup+1.50033 s]
/proc/loadavg: 2.17 2.13 1.68 3/591 3769
/proc/meminfo: memFree=20121272/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=295728 CPUtime=0.77 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 11991 1383 1 0 58 12 5 2 20 0 2 0 869384695 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 73932 7788 1863 364 0 8819 0
[pid=3767] ppid=3752 vsize=285484 CPUtime=0 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 736 0 0 0 0 0 0 0 15 0 1 0 869384780 292335616 6240 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854287 0 0 16781312 33554946 3757327636393623552 0 0 17 3 0 0 0
/proc/3767/statm: 71371 6240 319 364 0 6258 0
[pid=3769] ppid=3767 vsize=84684 CPUtime=0.63 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) R 3767 3769 3769 0 -1 4202496 21148 0 0 0 45 18 0 0 18 0 1 0 869384780 86716416 18829 33554432000 4194304 13684479 140733274429472 18446744073709551615 6433465 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3769/statm: 21171 18829 755 2317 0 18849 0
[pid=3752/tid=3768] ppid=3750 vsize=295728 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 2 0 869384780 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 665896

[startup+3.10105 s]
/proc/loadavg: 2.17 2.13 1.68 3/591 3769
/proc/meminfo: memFree=20077188/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=295728 CPUtime=0.77 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 11991 1383 1 0 58 12 5 2 20 0 2 0 869384695 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 73932 7788 1863 364 0 8819 0
[pid=3767] ppid=3752 vsize=285484 CPUtime=0 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 740 0 0 0 0 0 0 0 15 0 1 0 869384780 292335616 6240 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854287 0 0 16781312 33554946 2424566672758145024 0 0 17 3 0 0 0
/proc/3767/statm: 71371 6240 319 364 0 6258 0
[pid=3769] ppid=3767 vsize=90272 CPUtime=2.23 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) R 3767 3769 3769 0 -1 4202496 22752 0 0 0 189 34 0 0 21 0 1 0 869384780 92438528 20210 33554432000 4194304 13684479 140733274429472 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3769/statm: 22568 20210 793 2317 0 20246 0
[pid=3752/tid=3768] ppid=3750 vsize=295728 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 2 0 869384780 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 671484

[startup+6.30046 s]
/proc/loadavg: 2.17 2.13 1.68 3/591 3770
/proc/meminfo: memFree=20065132/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=295728 CPUtime=0.77 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 11991 1383 1 0 58 12 5 2 20 0 2 0 869384695 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 73932 7788 1863 364 0 8819 0
[pid=3767] ppid=3752 vsize=285484 CPUtime=0.02 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 877 0 0 0 1 1 0 0 15 0 1 0 869384780 292335616 6264 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854287 0 0 16781312 33554946 3397783365561090048 0 0 17 3 0 0 0
/proc/3767/statm: 71371 6264 343 364 0 6258 0
[pid=3769] ppid=3767 vsize=94300 CPUtime=5.42 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) R 3767 3769 3769 0 -1 4202496 31938 0 0 0 500 42 0 0 25 0 1 0 869384780 96563200 21158 33554432000 4194304 13684479 140733274429472 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3769/statm: 23575 21158 800 2317 0 21253 0
[pid=3752/tid=3768] ppid=3750 vsize=295728 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 2 0 869384780 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 675512

[startup+12.7003 s]
/proc/loadavg: 2.22 2.14 1.69 3/591 3771
/proc/meminfo: memFree=20066932/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=295728 CPUtime=0.77 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 11991 1383 1 0 58 12 5 2 20 0 2 0 869384695 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 73932 7788 1863 364 0 8819 0
[pid=3767] ppid=3752 vsize=285484 CPUtime=0.03 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 887 0 0 0 2 1 0 0 15 0 1 0 869384780 292335616 6264 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854287 0 0 16781312 33554946 5623458817330129791 0 0 17 3 0 0 0
/proc/3767/statm: 71371 6264 343 364 0 6258 0
[pid=3769] ppid=3767 vsize=94300 CPUtime=11.81 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) R 3767 3769 3769 0 -1 4202496 31939 0 0 0 1129 52 0 0 25 0 1 0 869384780 96563200 21159 33554432000 4194304 13684479 140733274429472 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3769/statm: 23575 21159 801 2317 0 21253 0
[pid=3752/tid=3768] ppid=3750 vsize=295728 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 2 0 869384780 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 675512

[startup+25.517 s]
/proc/loadavg: 2.19 2.14 1.69 3/591 3771
/proc/meminfo: memFree=20067452/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=295728 CPUtime=0.77 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 11991 1383 1 0 58 12 5 2 20 0 2 0 869384695 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 73932 7788 1863 364 0 8819 0
[pid=3767] ppid=3752 vsize=285484 CPUtime=0.1 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 892 0 0 0 5 5 0 0 15 0 1 0 869384780 292335616 6264 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854287 0 0 16781312 33554946 5623458817330129791 0 0 17 3 0 0 0
/proc/3767/statm: 71371 6264 343 364 0 6258 0
[pid=3769] ppid=3767 vsize=96288 CPUtime=24.62 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) R 3767 3769 3769 0 -1 4202496 32478 0 0 0 2392 70 0 0 25 0 1 0 869384780 98598912 21643 33554432000 4194304 13684479 140733274429472 18446744073709551615 7268178 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3769/statm: 24072 21643 809 2317 0 21750 0
[pid=3752/tid=3768] ppid=3750 vsize=295728 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 2 0 869384780 302825472 7788 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 677500

[startup+51.1013 s]
/proc/loadavg: 2.11 2.12 1.70 3/595 3776
/proc/meminfo: memFree=19983772/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=305984 CPUtime=0.79 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 12864 1383 1 0 60 12 5 2 19 0 3 0 869384695 313327616 7803 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/3752/statm: 76496 7803 1874 364 0 11380 0
[pid=3767] ppid=3752 vsize=295728 CPUtime=0.19 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 1098 0 0 0 9 10 0 0 16 0 2 0 869384780 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/3767/statm: 73932 6332 406 364 0 8819 0
[pid=3769] ppid=3767 vsize=98224 CPUtime=47.49 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) T 3767 3769 3769 0 -1 4202496 32969 0 0 0 4652 97 0 0 25 0 1 0 869384780 100581376 22134 33554432000 4194304 13684479 140733274429472 18446744073709551615 7291888 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/3769/statm: 24556 22134 809 2317 0 22234 0
[pid=3767/tid=3773] ppid=3752 vsize=295728 CPUtime=0 cores=1,3,5,7
/proc/3767/task/3773/stat : 3773 (python) S 3752 3752 1406 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869389536 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604463495771392 0 0 -1 3 0 0 0
[pid=3774] ppid=3752 vsize=295740 CPUtime=0 cores=1,3,5,7
/proc/3774/stat : 3774 (python) S 3752 3752 1406 0 -1 4202560 764 0 0 0 0 0 0 0 15 0 1 0 869389539 302837760 6245 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854342 0 0 16781312 33554946 1730033842103779328 0 0 17 5 0 0 0
/proc/3774/statm: 73935 6245 320 364 0 8819 0
[pid=3776] ppid=3774 vsize=96280 CPUtime=2.64 cores=1,3,5,7
/proc/3776/stat : 3776 (scip-2.0.1.linu) R 3774 3776 3776 0 -1 4202496 23125 0 0 0 229 35 0 0 18 0 1 0 869389539 98590720 20650 33554432000 4194304 15243407 140735710126416 18446744073709551615 13277498 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/3776/statm: 24070 20650 873 2698 0 21365 0
[pid=3752/tid=3768] ppid=3750 vsize=305984 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 3 0 869384780 313327616 7803 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
[pid=3752/tid=3775] ppid=3750 vsize=305984 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3775/stat : 3775 (python) S 3750 3752 1406 0 -1 4202560 26 1383 0 0 0 0 5 2 20 0 3 0 869389539 313327616 7803 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.11
Current children cumulated vsize (KiB) 1091956

[startup+102.301 s]
/proc/loadavg: 2.05 2.10 1.71 3/643 3825
/proc/meminfo: memFree=19168816/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=316240 CPUtime=0.82 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 13740 1383 1 0 63 12 5 2 20 0 4 0 869384695 323829760 7809 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/3752/statm: 79060 7809 1876 364 0 13941 0
[pid=3767] ppid=3752 vsize=295728 CPUtime=0.19 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 1098 0 0 0 9 10 0 0 16 0 2 0 869384780 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/3767/statm: 73932 6332 406 364 0 8819 0
[pid=3769] ppid=3767 vsize=98224 CPUtime=47.49 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) T 3767 3769 3769 0 -1 4202496 32969 0 0 0 4652 97 0 0 25 0 1 0 869384780 100581376 22134 33554432000 4194304 13684479 140733274429472 18446744073709551615 7291888 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/3769/statm: 24556 22134 809 2317 0 22234 0
[pid=3767/tid=3773] ppid=3752 vsize=295728 CPUtime=0 cores=1,3,5,7
/proc/3767/task/3773/stat : 3773 (python) S 3752 3752 1406 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869389536 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604463495771392 0 0 -1 3 0 0 0
[pid=3774] ppid=3752 vsize=295740 CPUtime=0.19 cores=1,3,5,7
/proc/3774/stat : 3774 (python) S 3752 3752 1406 0 -1 4202560 1121 0 0 0 9 10 0 0 16 0 2 0 869389539 302837760 6317 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/3774/statm: 73935 6317 391 364 0 8819 0
[pid=3776] ppid=3774 vsize=102224 CPUtime=47.04 cores=1,3,5,7
/proc/3776/stat : 3776 (scip-2.0.1.linu) T 3774 3776 3776 0 -1 4202496 60064 0 0 0 4645 59 0 0 25 0 1 0 869389539 104677376 21679 33554432000 4194304 15243407 140735710126416 18446744073709551615 8145045 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/3776/statm: 25556 21679 928 2698 0 22851 0
[pid=3774/tid=3800] ppid=3752 vsize=295740 CPUtime=0 cores=1,3,5,7
/proc/3774/task/3800/stat : 3800 (python) S 3752 3752 1406 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869394244 302837760 6317 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458073869184 0 0 -1 7 0 0 0
[pid=3801] ppid=3752 vsize=305996 CPUtime=0.01 cores=1,3,5,7
/proc/3801/stat : 3801 (python) S 3752 3752 1406 0 -1 4202560 907 0 0 0 0 1 0 0 15 0 1 0 869394246 313339904 6273 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854342 0 0 16781312 33554946 4436726063153774854 0 0 17 7 0 0 0

################
# More data... #
################

[pid=3803/tid=3812] ppid=3801 vsize=8541572 CPUtime=0.01 cores=1,3,5,7
/proc/3803/task/3812/stat : 3812 (java) S 3801 3803 3803 0 -1 4202560 1648 0 0 0 1 0 0 0 15 0 19 0 869394248 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 1 0 0 0
[pid=3803/tid=3813] ppid=3801 vsize=8541572 CPUtime=0.07 cores=1,3,5,7
/proc/3803/task/3813/stat : 3813 (java) S 3801 3803 3803 0 -1 4202560 2505 0 0 0 7 0 0 0 15 0 19 0 869394249 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 0 0 16800975 18446604458073866496 0 0 -1 5 0 0 0
[pid=3803/tid=3814] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3814/stat : 3814 (java) S 3801 3803 3803 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869394249 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 1 0 0 0
[pid=3803/tid=3815] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3815/stat : 3815 (java) S 3801 3803 3803 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869394249 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 3 0 0 0
[pid=3803/tid=3816] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3816/stat : 3816 (java) S 3801 3803 3803 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869394251 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528657841 0 4 0 16800975 18446604458073866496 0 0 -1 1 0 0 0
[pid=3803/tid=3817] ppid=3801 vsize=8541572 CPUtime=0.55 cores=1,3,5,7
/proc/3803/task/3817/stat : 3817 (java) S 3801 3803 3803 0 -1 4202560 3385 0 0 0 55 0 0 0 15 0 19 0 869394251 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 3 0 0 0
[pid=3803/tid=3818] ppid=3801 vsize=8541572 CPUtime=0.54 cores=1,3,5,7
/proc/3803/task/3818/stat : 3818 (java) S 3801 3803 3803 0 -1 4202560 5589 0 0 0 54 0 0 0 15 0 19 0 869394251 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 7 0 0 0
[pid=3803/tid=3819] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3819/stat : 3819 (java) S 3801 3803 3803 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869394251 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446604458073866496 0 0 -1 1 0 0 0
[pid=3803/tid=3820] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3820/stat : 3820 (java) S 3801 3803 3803 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869394251 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 4 0 16800975 18446604458073866496 0 0 -1 7 0 0 0
[pid=3803/tid=3821] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3821/stat : 3821 (java) S 3801 3803 3803 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869394294 8746569728 148227 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 4 0 16800975 18446604458073866496 0 0 -1 5 0 0 0
[pid=3752/tid=3768] ppid=3750 vsize=316240 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 4 0 869384780 323829760 7809 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
[pid=3752/tid=3775] ppid=3750 vsize=316240 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3775/stat : 3775 (python) S 3750 3752 1406 0 -1 4202560 26 1383 0 0 0 0 5 2 20 0 4 0 869389539 323829760 7809 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 5 0 0 0
[pid=3752/tid=3802] ppid=3750 vsize=316240 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3802/stat : 3802 (python) S 3750 3752 1406 0 -1 4202560 30 1383 0 0 0 0 5 2 20 0 4 0 869394246 323829760 7809 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 103.71
Current children cumulated vsize (KiB) 9955724



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+144.201 s]
/proc/loadavg: 2.17 2.12 1.73 4/665 3848
/proc/meminfo: memFree=19178340/32951124 swapFree=43359760/67111528
[pid=3752] ppid=3750 vsize=326496 CPUtime=0.85 cores=1,3,5,7
/proc/3752/stat : 3752 (python) S 3750 3752 1406 0 -1 4202496 14642 1383 1 0 65 13 5 2 19 0 5 0 869384695 334331904 7815 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/3752/statm: 81624 7815 1878 364 0 16502 0
[pid=3767] ppid=3752 vsize=295728 CPUtime=0.19 cores=1,3,5,7
/proc/3767/stat : 3767 (python) S 3752 3752 1406 0 -1 4202560 1098 0 0 0 9 10 0 0 16 0 2 0 869384780 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/3767/statm: 73932 6332 406 364 0 8819 0
[pid=3769] ppid=3767 vsize=98224 CPUtime=47.49 cores=1,3,5,7
/proc/3769/stat : 3769 (scip-2.0.1.linu) T 3767 3769 3769 0 -1 4202496 32969 0 0 0 4652 97 0 0 25 0 1 0 869384780 100581376 22134 33554432000 4194304 13684479 140733274429472 18446744073709551615 7291888 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/3769/statm: 24556 22134 809 2317 0 22234 0
[pid=3767/tid=3773] ppid=3752 vsize=295728 CPUtime=0 cores=1,3,5,7
/proc/3767/task/3773/stat : 3773 (python) S 3752 3752 1406 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869389536 302825472 6332 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604463495771392 0 0 -1 3 0 0 0
[pid=3774] ppid=3752 vsize=295740 CPUtime=0.19 cores=1,3,5,7
/proc/3774/stat : 3774 (python) S 3752 3752 1406 0 -1 4202560 1121 0 0 0 9 10 0 0 16 0 2 0 869389539 302837760 6317 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/3774/statm: 73935 6317 391 364 0 8819 0
[pid=3776] ppid=3774 vsize=102224 CPUtime=47.04 cores=1,3,5,7
/proc/3776/stat : 3776 (scip-2.0.1.linu) T 3774 3776 3776 0 -1 4202496 60064 0 0 0 4645 59 0 0 25 0 1 0 869389539 104677376 21679 33554432000 4194304 15243407 140735710126416 18446744073709551615 8145045 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/3776/statm: 25556 21679 928 2698 0 22851 0
[pid=3774/tid=3800] ppid=3752 vsize=295740 CPUtime=0 cores=1,3,5,7
/proc/3774/task/3800/stat : 3800 (python) S 3752 3752 1406 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869394244 302837760 6317 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604458073869184 0 0 -1 7 0 0 0
[pid=3801] ppid=3752 vsize=305996 CPUtime=0.2 cores=1,3,5,7
/proc/3801/stat : 3801 (python) S 3752 3752 1406 0 -1 4202560 1114 0 0 0 10 10 0 0 16 0 2 0 869394246 313339904 6321 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528660939 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/3801/statm: 76499 6321 391 364 0 11380 0
[pid=3803] ppid=3801 vsize=8541572 CPUtime=49.23 cores=1,3,5,7
/proc/3803/stat : 3803 (java) T 3801 3803 3803 0 -1 4202496 159488 0 1 0 4901 22 0 0 18 0 19 0 869394247 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/3803/statm: 2135393 114073 2262 9 0 2126134 0
[pid=3803/tid=3804] ppid=3801 vsize=8541572 CPUtime=46.97 cores=1,3,5,7
/proc/3803/task/3804/stat : 3804 (java) T 3801 3803 3803 0 -1 4202560 128993 0 1 0 4681 16 0 0 25 0 19 0 869394247 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 46912505857420 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3805] ppid=3801 vsize=8541572 CPUtime=0.07 cores=1,3,5,7
/proc/3803/task/3805/stat : 3805 (java) T 3801 3803 3803 0 -1 4202560 1883 0 0 0 7 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=3803/tid=3806] ppid=3801 vsize=8541572 CPUtime=0.08 cores=1,3,5,7
/proc/3803/task/3806/stat : 3806 (java) T 3801 3803 3803 0 -1 4202560 3066 0 0 0 8 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3807] ppid=3801 vsize=8541572 CPUtime=0.08 cores=1,3,5,7
/proc/3803/task/3807/stat : 3807 (java) T 3801 3803 3803 0 -1 4202560 2718 0 0 0 8 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=3803/tid=3808] ppid=3801 vsize=8541572 CPUtime=0.08 cores=1,3,5,7
/proc/3803/task/3808/stat : 3808 (java) T 3801 3803 3803 0 -1 4202560 1464 0 0 0 8 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=3803/tid=3809] ppid=3801 vsize=8541572 CPUtime=0.07 cores=1,3,5,7
/proc/3803/task/3809/stat : 3809 (java) T 3801 3803 3803 0 -1 4202560 1778 0 0 0 7 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3810] ppid=3801 vsize=8541572 CPUtime=0.09 cores=1,3,5,7
/proc/3803/task/3810/stat : 3810 (java) T 3801 3803 3803 0 -1 4202560 1894 0 0 0 9 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3811] ppid=3801 vsize=8541572 CPUtime=0.08 cores=1,3,5,7
/proc/3803/task/3811/stat : 3811 (java) T 3801 3803 3803 0 -1 4202560 2125 0 0 0 8 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=3803/tid=3812] ppid=3801 vsize=8541572 CPUtime=0.08 cores=1,3,5,7
/proc/3803/task/3812/stat : 3812 (java) T 3801 3803 3803 0 -1 4202560 2587 0 0 0 8 0 0 0 15 0 19 0 869394248 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=3803/tid=3813] ppid=3801 vsize=8541572 CPUtime=0.42 cores=1,3,5,7
/proc/3803/task/3813/stat : 3813 (java) T 3801 3803 3803 0 -1 4202560 2606 0 0 0 41 1 0 0 15 0 19 0 869394249 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=3803/tid=3814] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3814/stat : 3814 (java) T 3801 3803 3803 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869394249 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3815] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3815/stat : 3815 (java) T 3801 3803 3803 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869394249 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=3803/tid=3816] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3816/stat : 3816 (java) T 3801 3803 3803 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869394251 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528657841 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3817] ppid=3801 vsize=8541572 CPUtime=0.57 cores=1,3,5,7
/proc/3803/task/3817/stat : 3817 (java) T 3801 3803 3803 0 -1 4202560 3393 0 0 0 57 0 0 0 15 0 19 0 869394251 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=3803/tid=3818] ppid=3801 vsize=8541572 CPUtime=0.55 cores=1,3,5,7
/proc/3803/task/3818/stat : 3818 (java) T 3801 3803 3803 0 -1 4202560 5590 0 0 0 55 0 0 0 15 0 19 0 869394251 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=3803/tid=3819] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3819/stat : 3819 (java) T 3801 3803 3803 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869394251 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650137 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3820] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3820/stat : 3820 (java) T 3801 3803 3803 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869394251 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=3803/tid=3821] ppid=3801 vsize=8541572 CPUtime=0 cores=1,3,5,7
/proc/3803/task/3821/stat : 3821 (java) T 3801 3803 3803 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869394294 8746569728 114073 33554432000 1073741824 1073778376 140734238641792 18446744073709551615 246528650752 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=3801/tid=3827] ppid=3752 vsize=305996 CPUtime=0 cores=1,3,5,7
/proc/3801/task/3827/stat : 3827 (python) S 3752 3752 1406 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869399019 313339904 6321 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554946 18446604461845563456 0 0 -1 7 0 0 0
[pid=3828] ppid=3752 vsize=316252 CPUtime=0 cores=1,3,5,7
/proc/3828/stat : 3828 (python) S 3752 3752 1406 0 -1 4202560 782 0 0 0 0 0 0 0 15 0 1 0 869399021 323842048 6253 33554432000 4194304 5683644 140736915718560 18446744073709551615 246516854342 0 0 16781312 33554946 4294934789 0 0 17 3 0 0 0
/proc/3828/statm: 79063 6253 320 364 0 13941 0
[pid=3830] ppid=3828 vsize=8542468 CPUtime=2.26 cores=1,3,5,7
/proc/3830/stat : 3830 (java) S 3828 3830 3830 0 -1 4202496 34869 0 1 0 222 4 0 0 18 0 19 0 869399022 8747487232 28888 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528636901 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/3830/statm: 2135617 28890 2231 9 0 2126358 0
[pid=3830/tid=3831] ppid=3828 vsize=8542468 CPUtime=0.93 cores=1,3,5,7
/proc/3830/task/3831/stat : 3831 (java) R 3828 3830 3830 0 -1 4202560 22758 0 1 0 90 3 0 0 25 0 19 0 869399023 8747487232 29683 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 46912505917259 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=3830/tid=3832] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3832/stat : 3832 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869399023 8747487232 29684 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 7 0 0 0
[pid=3830/tid=3833] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3833/stat : 3833 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869399023 8747487232 29685 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3834] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3834/stat : 3834 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869399023 8747487232 29686 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3835] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3835/stat : 3835 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869399023 8747487232 29687 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3836] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3836/stat : 3836 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869399023 8747487232 29689 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3837] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3837/stat : 3837 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869399023 8747487232 29690 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3838] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3838/stat : 3838 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869399023 8747487232 29691 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3839] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3839/stat : 3839 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869399023 8747487232 29692 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3840] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3840/stat : 3840 (java) S 3828 3830 3830 0 -1 4202560 2 0 0 0 0 0 0 0 23 0 19 0 869399024 8747487232 29693 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650752 0 0 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3841] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3841/stat : 3841 (java) S 3828 3830 3830 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 19 0 869399025 8747487232 29694 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 7 0 0 0
[pid=3830/tid=3842] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3842/stat : 3842 (java) S 3828 3830 3830 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 19 0 869399025 8747487232 29695 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 7 0 0 0
[pid=3830/tid=3843] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3843/stat : 3843 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869399027 8747487232 29696 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528657841 0 4 0 16800975 18446604458424988992 0 0 -1 7 0 0 0
[pid=3830/tid=3844] ppid=3828 vsize=8542468 CPUtime=0.67 cores=1,3,5,7
/proc/3830/task/3844/stat : 3844 (java) S 3828 3830 3830 0 -1 4202560 6004 0 0 0 67 0 0 0 18 0 19 0 869399027 8747487232 29698 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 3 0 0 0
[pid=3830/tid=3845] ppid=3828 vsize=8542468 CPUtime=0.64 cores=1,3,5,7
/proc/3830/task/3845/stat : 3845 (java) S 3828 3830 3830 0 -1 4202560 5503 0 0 0 64 0 0 0 25 0 19 0 869399027 8747487232 29699 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 3 0 0 0
[pid=3830/tid=3846] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3846/stat : 3846 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869399027 8747487232 29699 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650137 0 4 0 16800975 18446604458424988992 0 0 -1 7 0 0 0
[pid=3830/tid=3847] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3847/stat : 3847 (java) S 3828 3830 3830 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 869399027 8747487232 29700 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650752 0 4 0 16800975 18446604458424988992 0 0 -1 1 0 0 0
[pid=3830/tid=3848] ppid=3828 vsize=8542468 CPUtime=0 cores=1,3,5,7
/proc/3830/task/3848/stat : 3848 (java) S 3828 3830 3830 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869399070 8747487232 29702 33554432000 1073741824 1073778376 140736179920048 18446744073709551615 246528650752 0 4 0 16800975 18446604458424988992 0 0 -1 5 0 0 0
[pid=3752/tid=3768] ppid=3750 vsize=326496 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3768/stat : 3768 (python) S 3750 3752 1406 0 -1 4202560 25 1383 0 0 0 0 5 2 20 0 5 0 869384780 334331904 7815 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
[pid=3752/tid=3775] ppid=3750 vsize=326496 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3775/stat : 3775 (python) S 3750 3752 1406 0 -1 4202560 26 1383 0 0 0 0 5 2 20 0 5 0 869389539 334331904 7815 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 5 0 0 0
[pid=3752/tid=3802] ppid=3750 vsize=326496 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3802/stat : 3802 (python) S 3750 3752 1406 0 -1 4202560 30 1383 0 0 0 0 5 2 20 0 5 0 869394246 334331904 7815 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
[pid=3752/tid=3829] ppid=3750 vsize=326496 CPUtime=0.07 cores=1,3,5,7
/proc/3752/task/3829/stat : 3829 (python) S 3750 3752 1406 0 -1 4202560 31 1383 0 0 0 0 5 2 20 0 5 0 869399022 334331904 7815 33554432000 4194304 5683644 140736915718560 18446744073709551615 246528657841 0 0 16781312 33554434 18446604466446354304 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 147.45
Current children cumulated vsize (KiB) 18824700

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3752 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=706892
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=154976
# CPU time returned by wait4() is 0.861868
# while last known CPU time is 147.45
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 144.275
CPU time (s): 147.45
CPU user time (s): 145.18
CPU system time (s): 2.27
CPU usage (%): 102.2
Max. virtual memory (cumulated for all children) (KiB): 18824700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.706892
system time used= 0.154976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16027
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8019
involuntary context switches= 21

runsolver used 0.753885 second user time and 1.57376 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-09 02:04:24
IDJOB=3481478
IDBENCH=48145
IDSOLVER=1970
FILE ID=node134/3481478-1307577864
RUNJOBID= node134-1307576356-1425
PBS_JOBID= 13547665
Free space on /tmp= 73816 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_200_25_2.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481478-1307577864/watcher-3481478-1307577864 -o /tmp/evaluation-result-3481478-1307577864/solver-3481478-1307577864 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481478-1307577864.opb -seed 1015436975 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= faa00895e2f6f80e77634e2be522df62
RANDOM SEED=1015436975

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20246368 kB
Buffers:        185108 kB
Cached:         726256 kB
SwapCached:      10388 kB
Active:       12208648 kB
Inactive:       173116 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20246368 kB
SwapTotal:    67111528 kB
SwapFree:     43359760 kB
Dirty:          204768 kB
Writeback:           0 kB
AnonPages:    11467972 kB
Mapped:          76140 kB
Slab:           149148 kB
PageTables:     104168 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 119788368 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73624 MiB
End job on node134 at 2011-06-09 02:06:51