Trace number 3481437

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 612.27 607.216

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_60_4.opb
MD5SUMefe239846afd4f2627c83cec32ebc27d
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark14
Best CPU time to get the best result obtained on this benchmark1797.19
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 17
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint61
Maximum length of a constraint107
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)37458
Sum of products size (including duplicates)74916
Number of different products37458
Sum of products size74916

Solver Data 

0.37/0.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/0.50	c INFO: solving HOME/instance-3481437-1307577832.opb
0.38/0.94	c INFO: wrote linearized instance to HOME/tmpcO5BFy.opb
1.28/1.43	c INFO: parsing took 0.48 s
2.17/2.36	c INFO: features took 0.92 CPU seconds
2.17/2.38	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.03)
49.00/49.09	c INFO: running wbo1.4a@0 for 45 with 1752 remaining (b = 0.02)
96.71/96.52	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1705 remaining (b = 0.01)
145.76/142.80	c INFO: running clasp-1.3.7@0 for 91 with 1657 remaining (b = 0.01)
238.15/234.83	c INFO: running scip-2.0.1-spx@45 for 45 with 1565 remaining (b = 0.00)
284.09/280.56	c INFO: running scip-2.0.1-clp@0 for 91 with 1519 remaining (b = 0.01)
381.30/377.45	c INFO: running scip-2.0.1-spx@91 for 228 with 1423 remaining (b = 0.02)
611.59/606.76	c INFO: running sat4j-pb-v20101225@0 for 91 with 1194 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481437-1307577832/watcher-3481437-1307577832 -o /tmp/evaluation-result-3481437-1307577832/solver-3481437-1307577832 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481437-1307577832.opb -seed 1437018261 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.56 2.19 1.64 2/700 19407
/proc/meminfo: memFree=19611548/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=15760 CPUtime=0 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 844 0 0 0 0 0 0 0 17 0 1 0 948013714 16138240 727 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458063872 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/19407/statm: 3940 727 334 364 0 427 0

[startup+0.0459189 s]
/proc/loadavg: 2.56 2.19 1.64 2/700 19407
/proc/meminfo: memFree=19611548/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=29440 CPUtime=0.03 cores=0,2,4,6
/proc/19407/stat : 19407 (python) R 19405 19407 17566 0 -1 4202496 1365 0 0 0 3 0 0 0 17 0 1 0 948013714 30146560 1209 33554432000 4194304 5683644 140733977488384 18446744073709551615 4509104 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19407/statm: 7360 1211 443 364 0 730 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29440

[startup+0.100938 s]
/proc/loadavg: 2.56 2.19 1.64 2/700 19407
/proc/meminfo: memFree=19611548/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=96124 CPUtime=0.06 cores=0,2,4,6
/proc/19407/stat : 19407 (python) R 19405 19407 17566 0 -1 4202496 3168 933 1 0 5 1 0 0 18 0 1 0 948013714 98430976 2483 33554432000 4194304 5683644 140733977488384 18446744073709551615 5177488 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19407/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96124

[startup+0.300894 s]
/proc/loadavg: 2.56 2.19 1.64 2/700 19407
/proc/meminfo: memFree=19611548/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=175628 CPUtime=0.21 cores=0,2,4,6
/proc/19407/stat : 19407 (python) R 19405 19407 17566 0 -1 4202496 6238 933 1 0 16 5 0 0 17 0 1 0 948013714 179843072 4550 33554432000 4194304 5683644 140733977488384 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19407/statm: 43907 4550 1236 364 0 3534 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 175628

[startup+0.700781 s]
/proc/loadavg: 2.56 2.19 1.64 2/700 19407
/proc/meminfo: memFree=19611548/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=284324 CPUtime=0.37 cores=0,2,4,6
/proc/19407/stat : 19407 (python) R 19405 19407 17566 0 -1 4202496 9670 933 1 0 29 8 0 0 18 0 1 0 948013714 291147776 7402 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085903 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/19407/statm: 71081 7402 1777 364 0 5974 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 284324

[startup+1.50068 s]
/proc/loadavg: 2.56 2.19 1.64 3/701 19413
/proc/meminfo: memFree=19578432/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=300172 CPUtime=1.37 cores=0,2,4,6
/proc/19407/stat : 19407 (python) R 19405 19407 17566 0 -1 4202496 19607 1582 1 0 85 10 42 0 18 0 1 0 948013714 307376128 11391 33554432000 4194304 5683644 140733977488384 18446744073709551615 47509016449325 0 0 16781312 33554434 0 0 0 17 4 0 0 0
/proc/19407/statm: 75043 11391 1816 364 0 9936 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 300172

[startup+3.10032 s]
/proc/loadavg: 2.56 2.19 1.64 3/701 19413
/proc/meminfo: memFree=19566904/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=312208 CPUtime=2.26 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 20711 1582 1 0 174 10 42 0 22 0 2 0 948013714 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/19407/statm: 78052 11892 1871 364 0 12939 0
Current children cumulated CPU time (s) 2.26
Current children cumulated vsize (KiB) 312208
heavy processes:

[startup+6.30072 s]
/proc/loadavg: 2.52 2.18 1.64 3/704 19416
/proc/meminfo: memFree=19246252/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=312208 CPUtime=2.26 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 20711 1582 1 0 174 10 42 0 22 0 2 0 948013714 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/19407/statm: 78052 11892 1871 364 0 12939 0
[pid=19414] ppid=19407 vsize=301964 CPUtime=0.01 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 859 0 0 0 0 1 0 0 15 0 1 0 948013953 309211136 10359 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085903 0 0 16781312 33554946 4294934786 0 0 17 4 0 0 0
/proc/19414/statm: 75491 10359 342 364 0 10378 0
[pid=19416] ppid=19414 vsize=467792 CPUtime=3.9 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) R 19414 19416 19416 0 -1 4202496 115425 0 0 0 370 20 0 0 25 0 1 0 948013953 479019008 112027 33554432000 4194304 13684479 140734394149504 18446744073709551615 5325072 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/19416/statm: 116948 112027 710 2317 0 114626 0
[pid=19407/tid=19415] ppid=19405 vsize=312208 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19415/stat : 19415 (python) S 19405 19407 17566 0 -1 4202560 27 1582 0 0 0 0 42 0 22 0 2 0 948013953 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 1081964

[startup+12.7006 s]
/proc/loadavg: 2.47 2.18 1.64 3/704 19416
/proc/meminfo: memFree=19055724/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=312208 CPUtime=2.26 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 20711 1582 1 0 174 10 42 0 22 0 2 0 948013714 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/19407/statm: 78052 11892 1871 364 0 12939 0
[pid=19414] ppid=19407 vsize=301964 CPUtime=0.04 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 869 0 0 0 2 2 0 0 15 0 1 0 948013953 309211136 10359 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085903 0 0 16781312 33554946 72409437758827317 0 0 17 4 0 0 0
/proc/19414/statm: 75491 10359 342 364 0 10378 0
[pid=19416] ppid=19414 vsize=525160 CPUtime=10.29 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) R 19414 19416 19416 0 -1 4202496 132042 0 0 0 1002 27 0 0 25 0 1 0 948013953 537763840 127323 33554432000 4194304 13684479 140734394149504 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19416/statm: 131290 127323 784 2317 0 128968 0
[pid=19407/tid=19415] ppid=19405 vsize=312208 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19415/stat : 19415 (python) S 19405 19407 17566 0 -1 4202560 27 1582 0 0 0 0 42 0 22 0 2 0 948013953 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 1139332

[startup+25.5012 s]
/proc/loadavg: 2.52 2.20 1.66 3/704 19417
/proc/meminfo: memFree=19032928/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=312208 CPUtime=2.26 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 20711 1582 1 0 174 10 42 0 22 0 2 0 948013714 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/19407/statm: 78052 11892 1871 364 0 12939 0
[pid=19414] ppid=19407 vsize=301964 CPUtime=0.1 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 881 0 0 0 5 5 0 0 15 0 1 0 948013953 309211136 10359 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085903 0 0 16781312 33554946 72409437758827317 0 0 17 4 0 0 0
/proc/19414/statm: 75491 10359 342 364 0 10378 0
[pid=19416] ppid=19414 vsize=549448 CPUtime=23.07 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) R 19414 19416 19416 0 -1 4202496 138551 0 0 0 2229 78 0 0 25 0 1 0 948013953 562634752 133454 33554432000 4194304 13684479 140734394149504 18446744073709551615 6427716 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19416/statm: 137362 133454 828 2317 0 135040 0
[pid=19407/tid=19415] ppid=19405 vsize=312208 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19415/stat : 19415 (python) S 19405 19407 17566 0 -1 4202560 27 1582 0 0 0 0 42 0 22 0 2 0 948013953 319700992 11892 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 1163620

[startup+51.1004 s]
/proc/loadavg: 2.34 2.18 1.66 3/708 19421
/proc/meminfo: memFree=18999340/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=322464 CPUtime=2.29 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 21597 1582 1 0 176 11 42 0 20 0 3 0 948013714 330203136 11899 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/19407/statm: 80616 11899 1874 364 0 15500 0
[pid=19414] ppid=19407 vsize=312208 CPUtime=0.2 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 1089 0 0 0 11 9 0 0 16 0 2 0 948013953 319700992 10427 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19414/statm: 78052 10427 405 364 0 12939 0
[pid=19416] ppid=19414 vsize=552924 CPUtime=46.63 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) T 19414 19416 19416 0 -1 4202496 139513 0 0 0 4578 85 0 0 25 0 1 0 948013953 566194176 134385 33554432000 4194304 13684479 140734394149504 18446744073709551615 6433439 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/19416/statm: 138231 134385 797 2317 0 135909 0
[pid=19414/tid=19418] ppid=19407 vsize=312208 CPUtime=0 cores=0,2,4,6
/proc/19414/task/19418/stat : 19418 (python) S 19407 19407 17566 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 948018621 319700992 10427 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604451738972288 0 0 -1 6 0 0 0
[pid=19419] ppid=19407 vsize=312220 CPUtime=0 cores=0,2,4,6
/proc/19419/stat : 19419 (python) S 19407 19407 17566 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 948018624 319713280 10340 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085958 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/19419/statm: 78055 10340 319 364 0 12939 0
[pid=19421] ppid=19419 vsize=28740 CPUtime=1.99 cores=0,2,4,6
/proc/19421/stat : 19421 (wbo1.4a) R 19419 19421 19421 0 -1 4202496 9460 0 0 0 199 0 0 0 25 0 1 0 948018624 29429760 6547 33554432000 134512640 135751879 4292331184 18446744073709551615 134616334 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/19421/statm: 7185 6547 146 303 0 6880 0
[pid=19407/tid=19415] ppid=19405 vsize=322464 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19415/stat : 19415 (python) S 19405 19407 17566 0 -1 4202560 27 1582 0 0 0 0 42 0 22 0 3 0 948013953 330203136 11899 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
[pid=19407/tid=19420] ppid=19405 vsize=322464 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19420/stat : 19420 (python) S 19405 19407 17566 0 -1 4202560 29 1582 0 0 0 0 42 0 20 0 3 0 948018624 330203136 11899 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.11
Current children cumulated vsize (KiB) 1528556

[startup+102.32 s]
/proc/loadavg: 2.36 2.21 1.70 3/733 19448
/proc/meminfo: memFree=18306500/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=332720 CPUtime=2.31 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 22501 1582 1 0 178 11 42 0 20 0 4 0 948013714 340705280 11905 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19407/statm: 83180 11905 1876 364 0 18061 0
[pid=19414] ppid=19407 vsize=312208 CPUtime=0.2 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 1089 0 0 0 11 9 0 0 16 0 2 0 948013953 319700992 10427 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19414/statm: 78052 10427 405 364 0 12939 0
[pid=19416] ppid=19414 vsize=552924 CPUtime=46.63 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) T 19414 19416 19416 0 -1 4202496 139513 0 0 0 4578 85 0 0 25 0 1 0 948013953 566194176 134385 33554432000 4194304 13684479 140734394149504 18446744073709551615 6433439 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/19416/statm: 138231 134385 797 2317 0 135909 0
[pid=19414/tid=19418] ppid=19407 vsize=312208 CPUtime=0 cores=0,2,4,6
/proc/19414/task/19418/stat : 19418 (python) S 19407 19407 17566 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 948018621 319700992 10427 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604451738972288 0 0 -1 6 0 0 0
[pid=19419] ppid=19407 vsize=312220 CPUtime=0.2 cores=0,2,4,6
/proc/19419/stat : 19419 (python) S 19407 19407 17566 0 -1 4202560 1184 0 0 0 11 9 0 0 16 0 2 0 948018624 319713280 10418 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19419/statm: 78055 10418 396 364 0 12939 0
[pid=19421] ppid=19419 vsize=79500 CPUtime=47.39 cores=0,2,4,6
/proc/19421/stat : 19421 (wbo1.4a) T 19419 19421 19421 0 -1 4202496 22167 0 0 0 4731 8 0 0 25 0 1 0 948018624 81408000 19254 33554432000 134512640 135751879 4292331184 18446744073709551615 134620474 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/19421/statm: 19875 19254 146 303 0 19570 0
[pid=19419/tid=19427] ppid=19407 vsize=312220 CPUtime=0 cores=0,2,4,6
/proc/19419/task/19427/stat : 19427 (python) S 19407 19407 17566 0 -1 4202560 110 0 0 0 0 0 0 0 16 0 2 0 948023364 319713280 10418 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604453862909248 0 0 -1 6 0 0 0
[pid=19428] ppid=19407 vsize=322476 CPUtime=0.02 cores=0,2,4,6
/proc/19428/stat : 19428 (python) S 19407 19407 17566 0 -1 4202560 1004 0 0 0 1 1 0 0 15 0 1 0 948023367 330215424 10374 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085958 0 0 16781312 33554946 9711606846569021698 0 0 17 2 0 0 0
/proc/19428/statm: 80619 10374 349 364 0 15500 0
[pid=19430] ppid=19428 vsize=8542512 CPUtime=7.65 cores=0,2,4,6
/proc/19430/stat : 19430 (java) S 19428 19430 19430 0 -1 4202496 160693 0 1 0 743 22 0 0 20 0 19 0 948023367 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469868517 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/19430/statm: 2135628 156505 2251 9 0 2126369 0
[pid=19430/tid=19431] ppid=19428 vsize=8542512 CPUtime=5.56 cores=0,2,4,6
/proc/19430/task/19431/stat : 19431 (java) R 19428 19430 19430 0 -1 4202560 115766 0 1 0 541 15 0 0 25 0 19 0 948023368 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 46912505987616 0 4 0 16800975 0 0 0 -1 0 0 0 4
[pid=19430/tid=19432] ppid=19428 vsize=8542512 CPUtime=0.06 cores=0,2,4,6
/proc/19430/task/19432/stat : 19432 (java) S 19428 19430 19430 0 -1 4202560 4773 0 0 0 6 0 0 0 16 0 19 0 948023369 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446604445118087360 0 0 -1 6 0 0 0
[pid=19430/tid=19433] ppid=19428 vsize=8542512 CPUtime=0.05 cores=0,2,4,6
/proc/19430/task/19433/stat : 19433 (java) S 19428 19430 19430 0 -1 4202560 4198 0 0 0 5 0 0 0 15 0 19 0 948023369 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446604445118087360 0 0 -1 6 0 0 0
[pid=19430/tid=19434] ppid=19428 vsize=8542512 CPUtime=0.06 cores=0,2,4,6
/proc/19430/task/19434/stat : 19434 (java) S 19428 19430 19430 0 -1 4202560 3932 0 0 0 6 0 0 0 15 0 19 0 948023369 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446604445118087360 0 0 -1 0 0 0 0
[pid=19430/tid=19435] ppid=19428 vsize=8542512 CPUtime=0.04 cores=0,2,4,6
/proc/19430/task/19435/stat : 19435 (java) S 19428 19430 19430 0 -1 4202560 3584 0 0 0 4 0 0 0 16 0 19 0 948023369 8747532288 156505 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446604445118087360 0 0 -1 4 0 0 0
[pid=19430/tid=19436] ppid=19428 vsize=8542512 CPUtime=0.06 cores=0,2,4,6

################
# More data... #
################

[pid=19407/tid=19420] ppid=19405 vsize=353232 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19420/stat : 19420 (python) S 19405 19407 17566 0 -1 4202560 29 1582 0 0 0 0 42 0 20 0 6 0 948018624 361709568 11917 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
[pid=19407/tid=19429] ppid=19405 vsize=353232 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19429/stat : 19429 (python) S 19405 19407 17566 0 -1 4202560 28 1582 0 0 0 0 42 0 20 0 6 0 948023367 361709568 11917 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
[pid=19407/tid=19452] ppid=19405 vsize=353232 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19452/stat : 19452 (python) S 19405 19407 17566 0 -1 4202560 28 1582 0 0 0 0 42 0 20 0 6 0 948027996 361709568 11917 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
[pid=19407/tid=19460] ppid=19405 vsize=353232 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19460/stat : 19460 (python) S 19405 19407 17566 0 -1 4202560 31 1582 0 0 0 0 42 0 20 0 6 0 948041771 361709568 11917 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 587.11
Current children cumulated vsize (KiB) 11774104



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+607.102 s]
/proc/loadavg: 2.19 2.11 1.84 6/762 19490
/proc/meminfo: memFree=16024756/32951124 swapFree=56297244/67111528
[pid=19407] ppid=19405 vsize=363488 CPUtime=2.44 cores=0,2,4,6
/proc/19407/stat : 19407 (python) S 19405 19407 17566 0 -1 4202496 25498 1582 1 0 190 12 42 0 20 0 7 0 948013714 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/19407/statm: 90872 11923 1882 364 0 25744 0
[pid=19414] ppid=19407 vsize=312208 CPUtime=1.4 cores=0,2,4,6
/proc/19414/stat : 19414 (python) S 19407 19407 17566 0 -1 4202560 1176 0 0 0 73 67 0 0 15 0 2 0 948013953 319700992 10428 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19414/statm: 78052 10428 406 364 0 12939 0
[pid=19416] ppid=19414 vsize=571688 CPUtime=321.63 cores=0,2,4,6
/proc/19416/stat : 19416 (scip-2.0.1.linu) T 19414 19416 19416 0 -1 4202496 181192 0 0 0 32023 140 0 0 25 0 1 0 948013953 585408512 138918 33554432000 4194304 13684479 140734394149504 18446744073709551615 5325497 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/19416/statm: 142922 138918 831 2317 0 140600 0
[pid=19414/tid=19418] ppid=19407 vsize=312208 CPUtime=0 cores=0,2,4,6
/proc/19414/task/19418/stat : 19418 (python) S 19407 19407 17566 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 948018621 319700992 10428 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604451738972288 0 0 -1 6 0 0 0
[pid=19419] ppid=19407 vsize=312220 CPUtime=0.2 cores=0,2,4,6
/proc/19419/stat : 19419 (python) S 19407 19407 17566 0 -1 4202560 1184 0 0 0 11 9 0 0 16 0 2 0 948018624 319713280 10418 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19419/statm: 78055 10418 396 364 0 12939 0
[pid=19421] ppid=19419 vsize=79500 CPUtime=47.39 cores=0,2,4,6
/proc/19421/stat : 19421 (wbo1.4a) T 19419 19421 19421 0 -1 4202496 22167 0 0 0 4731 8 0 0 25 0 1 0 948018624 81408000 19254 33554432000 134512640 135751879 4292331184 18446744073709551615 134620474 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/19421/statm: 19875 19254 146 303 0 19570 0
[pid=19419/tid=19427] ppid=19407 vsize=312220 CPUtime=0 cores=0,2,4,6
/proc/19419/task/19427/stat : 19427 (python) S 19407 19407 17566 0 -1 4202560 110 0 0 0 0 0 0 0 16 0 2 0 948023364 319713280 10418 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604453862909248 0 0 -1 6 0 0 0
[pid=19428] ppid=19407 vsize=322476 CPUtime=0.2 cores=0,2,4,6
/proc/19428/stat : 19428 (python) S 19407 19407 17566 0 -1 4202560 1190 0 0 0 11 9 0 0 17 0 2 0 948023367 330215424 10422 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19428/statm: 80619 10422 396 364 0 15500 0
[pid=19430] ppid=19428 vsize=8542512 CPUtime=48.81 cores=0,2,4,6
/proc/19430/stat : 19430 (java) T 19428 19430 19430 0 -1 4202496 569592 0 1 0 4811 70 0 0 18 0 19 0 948023367 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469868517 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/19430/statm: 2135628 565184 2251 9 0 2126369 0
[pid=19430/tid=19431] ppid=19428 vsize=8542512 CPUtime=45.87 cores=0,2,4,6
/proc/19430/task/19431/stat : 19431 (java) T 19428 19430 19430 0 -1 4202560 478430 0 1 0 4531 56 0 0 25 0 19 0 948023368 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 46912506198704 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 4
[pid=19430/tid=19432] ppid=19428 vsize=8542512 CPUtime=0.15 cores=0,2,4,6
/proc/19430/task/19432/stat : 19432 (java) T 19428 19430 19430 0 -1 4202560 11453 0 0 0 13 2 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19433] ppid=19428 vsize=8542512 CPUtime=0.11 cores=0,2,4,6
/proc/19430/task/19433/stat : 19433 (java) T 19428 19430 19430 0 -1 4202560 8656 0 0 0 10 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19430/tid=19434] ppid=19428 vsize=8542512 CPUtime=0.13 cores=0,2,4,6
/proc/19430/task/19434/stat : 19434 (java) T 19428 19430 19430 0 -1 4202560 8873 0 0 0 12 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19435] ppid=19428 vsize=8542512 CPUtime=0.13 cores=0,2,4,6
/proc/19430/task/19435/stat : 19435 (java) T 19428 19430 19430 0 -1 4202560 10381 0 0 0 13 0 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19430/tid=19436] ppid=19428 vsize=8542512 CPUtime=0.16 cores=0,2,4,6
/proc/19430/task/19436/stat : 19436 (java) T 19428 19430 19430 0 -1 4202560 10950 0 0 0 15 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=19430/tid=19437] ppid=19428 vsize=8542512 CPUtime=0.12 cores=0,2,4,6
/proc/19430/task/19437/stat : 19437 (java) T 19428 19430 19430 0 -1 4202560 8681 0 0 0 11 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=19430/tid=19438] ppid=19428 vsize=8542512 CPUtime=0.1 cores=0,2,4,6
/proc/19430/task/19438/stat : 19438 (java) T 19428 19430 19430 0 -1 4202560 9260 0 0 0 9 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19430/tid=19439] ppid=19428 vsize=8542512 CPUtime=0.13 cores=0,2,4,6
/proc/19430/task/19439/stat : 19439 (java) T 19428 19430 19430 0 -1 4202560 9699 0 0 0 12 1 0 0 15 0 19 0 948023369 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19430/tid=19440] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19440/stat : 19440 (java) T 19428 19430 19430 0 -1 4202560 1271 0 0 0 0 0 0 0 15 0 19 0 948023370 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469882368 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19430/tid=19441] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19441/stat : 19441 (java) T 19428 19430 19430 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 948023370 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19442] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19442/stat : 19442 (java) T 19428 19430 19430 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 948023370 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19443] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19443/stat : 19443 (java) T 19428 19430 19430 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948023372 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469889457 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19444] ppid=19428 vsize=8542512 CPUtime=0.94 cores=0,2,4,6
/proc/19430/task/19444/stat : 19444 (java) T 19428 19430 19430 0 -1 4202560 6279 0 0 0 93 1 0 0 15 0 19 0 948023372 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=19430/tid=19445] ppid=19428 vsize=8542512 CPUtime=0.86 cores=0,2,4,6
/proc/19430/task/19445/stat : 19445 (java) T 19428 19430 19430 0 -1 4202560 4259 0 0 0 86 0 0 0 15 0 19 0 948023372 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19430/tid=19446] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19446/stat : 19446 (java) T 19428 19430 19430 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948023372 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469881753 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19430/tid=19447] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19447/stat : 19447 (java) T 19428 19430 19430 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 948023372 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469882368 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=19430/tid=19448] ppid=19428 vsize=8542512 CPUtime=0 cores=0,2,4,6
/proc/19430/task/19448/stat : 19448 (java) T 19428 19430 19430 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 948023452 8747532288 565184 33554432000 1073741824 1073778376 140737437119840 18446744073709551615 252469882368 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=19428/tid=19450] ppid=19407 vsize=322476 CPUtime=0 cores=0,2,4,6
/proc/19428/task/19450/stat : 19450 (python) S 19407 19407 17566 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 948027993 330215424 10422 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604444721689664 0 0 -1 6 0 0 0
[pid=19451] ppid=19407 vsize=332732 CPUtime=0.39 cores=0,2,4,6
/proc/19451/stat : 19451 (python) S 19407 19407 17566 0 -1 4202560 1200 0 0 0 19 20 0 0 17 0 2 0 948027995 340717568 10420 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19451/statm: 83183 10420 390 364 0 18061 0
[pid=19453] ppid=19451 vsize=45176 CPUtime=91.99 cores=0,2,4,6
/proc/19453/stat : 19453 (clasp-1.3.7-x86) T 19451 19453 19453 0 -1 4202496 12010 0 0 0 9197 2 0 0 25 0 1 0 948027996 46260224 11033 33554432000 134512640 136139019 4288506000 18446744073709551615 134598533 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/19453/statm: 11294 11033 187 398 0 10894 0
[pid=19451/tid=19456] ppid=19407 vsize=332732 CPUtime=0 cores=0,2,4,6
/proc/19451/task/19456/stat : 19456 (python) S 19407 19407 17566 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 948037195 340717568 10420 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604452992161792 0 0 -1 6 0 0 0
[pid=19459] ppid=19407 vsize=342988 CPUtime=0.47 cores=0,2,4,6
/proc/19459/stat : 19459 (python) S 19407 19407 17566 0 -1 4202560 1204 0 0 0 24 23 0 0 17 0 2 0 948041771 351219712 10424 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469892555 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/19459/statm: 85747 10424 390 364 0 20622 0
[pid=19461] ppid=19459 vsize=561360 CPUtime=96.75 cores=0,2,4,6
/proc/19461/stat : 19461 (scip-2.0.1.linu) T 19459 19461 19461 0 -1 4202496 196127 0 0 0 9571 104 0 0 25 0 1 0 948041772 574832640 136012 33554432000 4194304 15243407 140736668069472 18446744073709551615 5319307 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/19461/statm: 140340 136012 960 2698 0 137635 0
[pid=19459/tid=19464] ppid=19407 vsize=342988 CPUtime=0 cores=0,2,4,6
/proc/19459/task/19464/stat : 19464 (python) S 19407 19407 17566 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 948051457 351219712 10424 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554946 18446604442300536832 0 0 -1 6 0 0 0
[pid=19471] ppid=19407 vsize=353244 CPUtime=0 cores=0,2,4,6
/proc/19471/stat : 19471 (python) S 19407 19407 17566 0 -1 4202560 816 0 0 0 0 0 0 0 18 0 1 0 948074391 361721856 10356 33554432000 4194304 5683644 140733977488384 18446744073709551615 252458085958 0 0 16781312 33554946 3493349617712496640 0 0 17 6 0 0 0
/proc/19471/statm: 88311 10356 319 364 0 23183 0
[pid=19473] ppid=19471 vsize=8538784 CPUtime=0.6 cores=0,2,4,6
/proc/19473/stat : 19473 (java) S 19471 19473 19473 0 -1 4202496 10085 0 1 0 59 1 0 0 20 0 18 0 948074392 8743714816 8565 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469868517 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/19473/statm: 2134696 8566 2216 9 0 2125437 0
[pid=19473/tid=19474] ppid=19471 vsize=8540984 CPUtime=0.3 cores=0,2,4,6
/proc/19473/task/19474/stat : 19474 (java) R 19471 19473 19473 0 -1 4202560 5258 0 1 0 30 0 0 0 18 0 18 0 948074393 8745967616 9218 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 46924711258932 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19473/tid=19475] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19475/stat : 19475 (java) S 19471 19473 19473 0 -1 4202560 2 0 0 0 0 0 0 0 22 0 18 0 948074393 8745967616 9218 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19476] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19476/stat : 19476 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 948074393 8745967616 9219 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19477] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19477/stat : 19477 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 948074393 8745967616 9219 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19478] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19478/stat : 19478 (java) S 19471 19473 19473 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 948074393 8745967616 9220 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19479] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19479/stat : 19479 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074393 8745967616 9220 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19480] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19480/stat : 19480 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074393 8745967616 9220 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19481] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19481/stat : 19481 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074393 8745967616 9221 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19482] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19482/stat : 19482 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074393 8745967616 9221 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19483] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19483/stat : 19483 (java) S 19471 19473 19473 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 948074394 8745967616 9222 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469882368 0 0 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19484] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19484/stat : 19484 (java) S 19471 19473 19473 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 948074395 8745967616 9222 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19485] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19485/stat : 19485 (java) S 19471 19473 19473 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 948074395 8745967616 9223 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19486] ppid=19471 vsize=8540984 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19486/stat : 19486 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074397 8745967616 9223 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469889457 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19487] ppid=19471 vsize=8540984 CPUtime=0.14 cores=0,2,4,6
/proc/19473/task/19487/stat : 19487 (java) R 19471 19473 19473 0 -1 4202560 2516 0 0 0 14 0 0 0 18 0 18 0 948074397 8745967616 9223 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252457726661 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19473/tid=19488] ppid=19471 vsize=8540984 CPUtime=0.16 cores=0,2,4,6
/proc/19473/task/19488/stat : 19488 (java) R 19471 19473 19473 0 -1 4202560 2041 0 0 0 16 0 0 0 25 0 18 0 948074397 8745967616 9223 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19473/tid=19489] ppid=19471 vsize=8541144 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19489/stat : 19489 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 948074397 8746131456 9243 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469881753 0 4 0 16800975 18446604449905615872 0 0 -1 6 0 0 0
[pid=19473/tid=19490] ppid=19471 vsize=8541144 CPUtime=0 cores=0,2,4,6
/proc/19473/task/19490/stat : 19490 (java) S 19471 19473 19473 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 948074397 8746131456 9255 33554432000 1073741824 1073778376 140733436948288 18446744073709551615 252469882368 0 4 0 16800975 18446604449905615872 0 0 -1 0 0 0 0
[pid=19407/tid=19415] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19415/stat : 19415 (python) S 19405 19407 17566 0 -1 4202560 39 1582 0 0 0 0 42 0 18 0 7 0 948013953 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
[pid=19407/tid=19420] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19420/stat : 19420 (python) S 19405 19407 17566 0 -1 4202560 29 1582 0 0 0 0 42 0 20 0 7 0 948018624 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 6 0 0 0
[pid=19407/tid=19429] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19429/stat : 19429 (python) S 19405 19407 17566 0 -1 4202560 28 1582 0 0 0 0 42 0 20 0 7 0 948023367 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
[pid=19407/tid=19452] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19452/stat : 19452 (python) S 19405 19407 17566 0 -1 4202560 28 1582 0 0 0 0 42 0 20 0 7 0 948027996 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
[pid=19407/tid=19460] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19460/stat : 19460 (python) S 19405 19407 17566 0 -1 4202560 31 1582 0 0 0 0 42 0 20 0 7 0 948041771 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
[pid=19407/tid=19472] ppid=19405 vsize=363488 CPUtime=0.42 cores=0,2,4,6
/proc/19407/task/19472/stat : 19472 (python) S 19405 19407 17566 0 -1 4202560 30 1582 0 0 0 0 42 0 20 0 7 0 948074391 372211712 11923 33554432000 4194304 5683644 140733977488384 18446744073709551615 252469889457 0 0 16781312 33554434 18446604442300535040 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 612.27
Current children cumulated vsize (KiB) 20678376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19407 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=334645
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=137979
# CPU time returned by wait4() is 2.47262
# while last known CPU time is 612.27
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 607.216
CPU time (s): 612.27
CPU user time (s): 607.62
CPU system time (s): 4.65
CPU usage (%): 100.832
Max. virtual memory (cumulated for all children) (KiB): 20678376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.33465
system time used= 0.137979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27083
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27372
involuntary context switches= 31

runsolver used 5.09622 second user time and 10.1215 second system time

The end

Launcher Data 

Begin job on node111 at 2011-06-09 02:03:52
IDJOB=3481437
IDBENCH=48104
IDSOLVER=1970
FILE ID=node111/3481437-1307577832
RUNJOBID= node111-1307576439-17584
PBS_JOBID= 13547694
Free space on /tmp= 73520 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_60_4.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481437-1307577832/watcher-3481437-1307577832 -o /tmp/evaluation-result-3481437-1307577832/solver-3481437-1307577832 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481437-1307577832.opb -seed 1437018261 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= efe239846afd4f2627c83cec32ebc27d
RANDOM SEED=1437018261

node111.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5428.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19611704 kB
Buffers:        188144 kB
Cached:         842656 kB
SwapCached:      11444 kB
Active:       12795816 kB
Inactive:       221220 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19611704 kB
SwapTotal:    67111528 kB
SwapFree:     56297244 kB
Dirty:          106168 kB
Writeback:           0 kB
AnonPages:    11984212 kB
Mapped:         102948 kB
Slab:           168504 kB
PageTables:      81416 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 157968952 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73416 MiB
End job on node111 at 2011-06-09 02:14:02