Trace number 3481734

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 289.73 287.29

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
domset/normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb
MD5SUM1e2b8f542cc5dec610d6e9b4663a878b
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark189
Best CPU time to get the best result obtained on this benchmark1797.08
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 183
Optimality of the best value was proved NO
Number of variables473
Total number of constraints472
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints472
Minimum length of a constraint3
Maximum length of a constraint17
Number of terms in the objective function 473
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 473
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 30
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 473
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.37/1.44	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/1.44	c INFO: solving HOME/instance-3481734-1307576397.opb
0.37/1.45	c INFO: parsing took 0.01 s
0.37/1.47	c INFO: features took 0.01 CPU seconds
0.37/1.49	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.74)
46.93/47.88	c INFO: running scip-2.0.1-clp@0 for 45 with 1753 remaining (b = 0.16)
94.16/94.95	c INFO: running clasp-1.3.7@0 for 45 with 1706 remaining (b = 0.03)
142.81/143.46	c INFO: running wbo1.4a@0 for 45 with 1658 remaining (b = 0.01)
192.82/193.29	c INFO: running clasp-1.3.7@48 for 45 with 1609 remaining (b = 0.01)
239.35/239.51	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1562 remaining (b = 0.01)
288.57/286.62	c INFO: running sat4j-pb-v20101225@0 for 91 with 1514 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481734-1307576397/watcher-3481734-1307576397 -o /tmp/evaluation-result-3481734-1307576397/solver-3481734-1307576397 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481734-1307576397.opb -seed 640418217 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.41 0.11 0.03 2/509 27699
/proc/meminfo: memFree=22085380/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=15764 CPUtime=0 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 846 0 0 0 0 0 0 0 17 0 1 0 850055596 16142336 728 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726403072 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/27698/statm: 3941 728 334 364 0 428 0

[startup+0.089938 s]
/proc/loadavg: 0.41 0.11 0.03 2/509 27699
/proc/meminfo: memFree=22085380/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=21128 CPUtime=0.02 cores=0,2,4,6
/proc/27698/stat : 27698 (python) D 27696 27698 27575 0 -1 4202496 1316 0 0 0 2 0 0 0 17 0 1 0 850055596 21635072 1166 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726403072 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/27698/statm: 5282 1166 428 364 0 729 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21128

[startup+0.100948 s]
/proc/loadavg: 0.41 0.11 0.03 2/509 27699
/proc/meminfo: memFree=22085380/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=23208 CPUtime=0.02 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 1324 0 0 0 2 0 0 0 17 0 1 0 850055596 23764992 1173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726403072 0 2147483391 16781312 2 18446744071699953811 0 0 17 4 0 0 0
/proc/27698/statm: 5802 1173 432 364 0 729 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 23208

[startup+0.300839 s]
/proc/loadavg: 0.41 0.11 0.03 2/509 27699
/proc/meminfo: memFree=22085380/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=94064 CPUtime=0.07 cores=0,2,4,6
/proc/27698/stat : 27698 (python) R 27696 27698 27575 0 -1 4202496 2946 467 1 0 5 2 0 0 16 0 1 0 850055596 96321536 2479 33554432000 4194304 5683644 140736428028624 18446744073709551615 5158281 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/27698/statm: 23516 2479 788 364 0 1627 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94064

[startup+0.70079 s]
/proc/loadavg: 0.41 0.11 0.03 2/509 27699
/proc/meminfo: memFree=22085380/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=123740 CPUtime=0.19 cores=0,2,4,6
/proc/27698/stat : 27698 (python) D 27696 27698 27575 0 -1 4202496 5358 931 1 0 12 7 0 0 16 0 1 0 850055596 126709760 3744 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726401029 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/27698/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 123740

[startup+1.50057 s]
/proc/loadavg: 0.41 0.11 0.03 2/515 27712
/proc/meminfo: memFree=22059488/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=293248 CPUtime=0.46 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 9666 931 1 0 33 13 0 0 18 0 2 0 850055596 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 73312 7173 1870 364 0 8199 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 293248

[startup+3.1003 s]
/proc/loadavg: 0.45 0.12 0.04 3/518 27715
/proc/meminfo: memFree=21982088/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=293248 CPUtime=0.46 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 9666 931 1 0 33 13 0 0 18 0 2 0 850055596 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 73312 7173 1870 364 0 8199 0
[pid=27713] ppid=27698 vsize=283004 CPUtime=0 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 755 0 0 0 0 0 0 0 16 0 1 0 850055745 289796096 5651 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425103 0 0 16781312 33554946 164020501771976704 0 0 17 6 0 0 0
/proc/27713/statm: 70751 5651 352 364 0 5638 0
[pid=27715] ppid=27713 vsize=26732 CPUtime=1.59 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) R 27713 27715 27715 0 -1 4202496 5096 0 0 0 158 1 0 0 18 0 1 0 850055746 27373568 4472 33554432000 4194304 13684479 140733427628832 18446744073709551615 7430616 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27715/statm: 6683 4472 797 2317 0 4361 0
[pid=27698/tid=27714] ppid=27696 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 2 0 850055746 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 602984
heavy processes:

[startup+6.3007 s]
/proc/loadavg: 0.45 0.12 0.04 3/518 27715
/proc/meminfo: memFree=21900440/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=293248 CPUtime=0.46 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 9666 931 1 0 33 13 0 0 18 0 2 0 850055596 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 73312 7173 1870 364 0 8199 0
[pid=27713] ppid=27698 vsize=283004 CPUtime=0.02 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 894 0 0 0 1 1 0 0 15 0 1 0 850055745 289796096 5675 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425103 0 0 16781312 33554946 810001265470734336 0 0 17 6 0 0 0
/proc/27713/statm: 70751 5675 376 364 0 5638 0
[pid=27715] ppid=27713 vsize=29636 CPUtime=4.79 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) R 27713 27715 27715 0 -1 4202496 5824 0 0 0 475 4 0 0 18 0 1 0 850055746 30347264 5179 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27715/statm: 7409 5179 777 2317 0 5087 0
[pid=27698/tid=27714] ppid=27696 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 2 0 850055746 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.27
Current children cumulated vsize (KiB) 605888

[startup+12.7005 s]
/proc/loadavg: 0.84 0.22 0.07 3/521 27718
/proc/meminfo: memFree=21831032/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=293248 CPUtime=0.46 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 9666 931 1 0 33 13 0 0 18 0 2 0 850055596 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 73312 7173 1870 364 0 8199 0
[pid=27713] ppid=27698 vsize=283004 CPUtime=0.04 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 898 0 0 0 2 2 0 0 15 0 1 0 850055745 289796096 5675 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425103 0 0 16781312 33554946 1724077147665989632 0 0 17 6 0 0 0
/proc/27713/statm: 70751 5675 376 364 0 5638 0
[pid=27715] ppid=27713 vsize=32188 CPUtime=11.19 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) R 27713 27715 27715 0 -1 4202496 6507 0 0 0 1111 8 0 0 18 0 1 0 850055746 32960512 5862 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27715/statm: 8047 5862 802 2317 0 5725 0
[pid=27698/tid=27714] ppid=27696 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 2 0 850055746 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.69
Current children cumulated vsize (KiB) 608440

[startup+25.5191 s]
/proc/loadavg: 1.02 0.27 0.09 3/521 27718
/proc/meminfo: memFree=21827888/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=293248 CPUtime=0.46 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 9666 931 1 0 33 13 0 0 18 0 2 0 850055596 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 73312 7173 1870 364 0 8199 0
[pid=27713] ppid=27698 vsize=283004 CPUtime=0.1 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 906 0 0 0 5 5 0 0 15 0 1 0 850055745 289796096 5675 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425103 0 0 16781312 33554946 72556772316949251 0 0 17 6 0 0 0
/proc/27713/statm: 70751 5675 376 364 0 5638 0
[pid=27715] ppid=27713 vsize=32188 CPUtime=24 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) R 27713 27715 27715 0 -1 4202496 6507 0 0 0 2383 17 0 0 25 0 1 0 850055746 32960512 5862 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27715/statm: 8047 5862 802 2317 0 5725 0
[pid=27698/tid=27714] ppid=27696 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 2 0 850055746 300285952 7173 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.56
Current children cumulated vsize (KiB) 608440

[startup+51.1012 s]
/proc/loadavg: 1.59 0.46 0.16 3/525 27723
/proc/meminfo: memFree=21771596/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=304024 CPUtime=0.49 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 10496 931 1 0 35 14 0 0 20 0 3 0 850055596 311320576 7304 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/27698/statm: 76006 7304 1873 364 0 10890 0
[pid=27713] ppid=27698 vsize=293248 CPUtime=0.2 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 1074 0 0 0 10 10 0 0 17 0 2 0 850055745 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/27713/statm: 73312 5711 407 364 0 8199 0
[pid=27715] ppid=27713 vsize=32188 CPUtime=46.35 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) T 27713 27715 27715 0 -1 4202496 6510 0 0 0 4596 39 0 0 25 0 1 0 850055746 32960512 5865 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/27715/statm: 8047 5865 805 2317 0 5725 0
[pid=27713/tid=27720] ppid=27698 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27713/task/27720/stat : 27720 (python) S 27698 27698 27575 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850060381 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604452600602816 0 0 -1 6 0 0 0
[pid=27721] ppid=27698 vsize=293780 CPUtime=0.02 cores=0,2,4,6
/proc/27721/stat : 27721 (python) S 27698 27698 27575 0 -1 4202560 946 0 0 0 1 1 0 0 16 0 1 0 850060384 300830720 5800 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425158 0 0 16781312 33554946 4294934785 0 0 17 0 0 0 0
/proc/27721/statm: 73445 5800 373 364 0 8329 0
[pid=27723] ppid=27721 vsize=31872 CPUtime=3.14 cores=0,2,4,6
/proc/27723/stat : 27723 (scip-2.0.1.linu) R 27721 27723 27723 0 -1 4202496 5845 0 0 0 313 1 0 0 25 0 1 0 850060389 32636928 5224 33554432000 4194304 15243407 140734955240208 18446744073709551615 4900621 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27723/statm: 7968 5224 884 2698 0 5263 0
[pid=27698/tid=27714] ppid=27696 vsize=304024 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 3 0 850055746 311320576 7304 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
[pid=27698/tid=27722] ppid=27696 vsize=304024 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27722/stat : 27722 (python) S 27696 27698 27575 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 3 0 850060384 311320576 7304 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.2
Current children cumulated vsize (KiB) 955112

[startup+102.301 s]
/proc/loadavg: 1.83 0.72 0.26 3/533 27732
/proc/meminfo: memFree=21344852/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=314148 CPUtime=0.52 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 11413 931 1 0 38 14 0 0 20 0 4 0 850055596 321687552 7261 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/27698/statm: 78537 7261 1875 364 0 13418 0
[pid=27713] ppid=27698 vsize=293248 CPUtime=0.2 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 1074 0 0 0 10 10 0 0 17 0 2 0 850055745 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/27713/statm: 73312 5711 407 364 0 8199 0
[pid=27715] ppid=27713 vsize=32188 CPUtime=46.35 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) T 27713 27715 27715 0 -1 4202496 6510 0 0 0 4596 39 0 0 25 0 1 0 850055746 32960512 5865 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/27715/statm: 8047 5865 805 2317 0 5725 0
[pid=27713/tid=27720] ppid=27698 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27713/task/27720/stat : 27720 (python) S 27698 27698 27575 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850060381 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604452600602816 0 0 -1 6 0 0 0
[pid=27721] ppid=27698 vsize=293780 CPUtime=0.22 cores=0,2,4,6
/proc/27721/stat : 27721 (python) S 27698 27698 27575 0 -1 4202560 1131 0 0 0 10 12 0 0 17 0 2 0 850060384 300830720 5825 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/27721/statm: 73445 5825 397 364 0 8329 0
[pid=27723] ppid=27721 vsize=31508 CPUtime=46.94 cores=0,2,4,6
/proc/27723/stat : 27723 (scip-2.0.1.linu) T 27721 27723 27723 0 -1 4202496 22951 0 0 0 4674 20 0 0 25 0 1 0 850060389 32264192 5380 33554432000 4194304 15243407 140734955240208 18446744073709551615 8081135 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/27723/statm: 7877 5380 930 2698 0 5172 0
[pid=27721/tid=27729] ppid=27698 vsize=293780 CPUtime=0 cores=0,2,4,6
/proc/27721/task/27729/stat : 27729 (python) S 27698 27698 27575 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 850065088 300830720 5825 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604450801095872 0 0 -1 4 0 0 0
[pid=27730] ppid=27698 vsize=303904 CPUtime=0.01 cores=0,2,4,6
/proc/27730/stat : 27730 (python) S 27698 27698 27575 0 -1 4202560 919 0 0 0 0 1 0 0 15 0 1 0 850065091 311197696 5755 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425158 0 0 16781312 33554946 8096743673493946626 0 0 17 0 0 0 0
/proc/27730/statm: 75976 5755 373 364 0 10857 0
[pid=27732] ppid=27730 vsize=2256 CPUtime=7.33 cores=0,2,4,6
/proc/27732/stat : 27732 (clasp-1.3.7-x86) R 27730 27732 27732 0 -1 4202496 580 0 0 0 733 0 0 0 25 0 1 0 850065091 2310144 312 33554432000 134512640 136139019 4290178944 18446744073709551615 134875832 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/27732/statm: 564 312 184 398 0 164 0
[pid=27698/tid=27714] ppid=27696 vsize=314148 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 4 0 850055746 321687552 7261 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
[pid=27698/tid=27722] ppid=27696 vsize=314148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=27698/tid=27731] ppid=27696 vsize=334972 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27731/stat : 27731 (python) S 27696 27698 27575 0 -1 4202560 34 931 0 0 0 0 0 0 18 0 6 0 850065091 343011328 7370 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27737] ppid=27696 vsize=334972 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27737/stat : 27737 (python) S 27696 27698 27575 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 6 0 850069942 343011328 7370 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27743] ppid=27696 vsize=334972 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27743/stat : 27743 (python) S 27696 27698 27575 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 6 0 850079547 343011328 7370 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 284.18
Current children cumulated vsize (KiB) 10618564



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+287.202 s]
/proc/loadavg: 1.99 1.30 0.57 6/581 27785
/proc/meminfo: memFree=20094720/32951124 swapFree=62998992/67111528
[pid=27698] ppid=27696 vsize=345228 CPUtime=0.63 cores=0,2,4,6
/proc/27698/stat : 27698 (python) S 27696 27698 27575 0 -1 4202496 14064 931 1 0 48 15 0 0 20 0 7 0 850055596 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/27698/statm: 86307 7376 1881 364 0 21179 0
[pid=27713] ppid=27698 vsize=293248 CPUtime=0.2 cores=0,2,4,6
/proc/27713/stat : 27713 (python) S 27698 27698 27575 0 -1 4202560 1074 0 0 0 10 10 0 0 17 0 2 0 850055745 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/27713/statm: 73312 5711 407 364 0 8199 0
[pid=27715] ppid=27713 vsize=32188 CPUtime=46.35 cores=0,2,4,6
/proc/27715/stat : 27715 (scip-2.0.1.linu) T 27713 27715 27715 0 -1 4202496 6510 0 0 0 4596 39 0 0 25 0 1 0 850055746 32960512 5865 33554432000 4194304 13684479 140733427628832 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/27715/statm: 8047 5865 805 2317 0 5725 0
[pid=27713/tid=27720] ppid=27698 vsize=293248 CPUtime=0 cores=0,2,4,6
/proc/27713/task/27720/stat : 27720 (python) S 27698 27698 27575 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850060381 300285952 5711 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604452600602816 0 0 -1 6 0 0 0
[pid=27721] ppid=27698 vsize=293780 CPUtime=0.22 cores=0,2,4,6
/proc/27721/stat : 27721 (python) S 27698 27698 27575 0 -1 4202560 1131 0 0 0 10 12 0 0 17 0 2 0 850060384 300830720 5825 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/27721/statm: 73445 5825 397 364 0 8329 0
[pid=27723] ppid=27721 vsize=31508 CPUtime=46.94 cores=0,2,4,6
/proc/27723/stat : 27723 (scip-2.0.1.linu) T 27721 27723 27723 0 -1 4202496 22951 0 0 0 4674 20 0 0 25 0 1 0 850060389 32264192 5380 33554432000 4194304 15243407 140734955240208 18446744073709551615 8081135 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/27723/statm: 7877 5380 930 2698 0 5172 0
[pid=27721/tid=27729] ppid=27698 vsize=293780 CPUtime=0 cores=0,2,4,6
/proc/27721/task/27729/stat : 27729 (python) S 27698 27698 27575 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 850065088 300830720 5825 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604450801095872 0 0 -1 4 0 0 0
[pid=27730] ppid=27698 vsize=303904 CPUtime=0.41 cores=0,2,4,6
/proc/27730/stat : 27730 (python) S 27698 27698 27575 0 -1 4202560 1184 0 0 0 21 20 0 0 15 0 2 0 850065091 311197696 5786 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/27730/statm: 75976 5786 403 364 0 10857 0
[pid=27732] ppid=27730 vsize=2256 CPUtime=94.63 cores=0,2,4,6
/proc/27732/stat : 27732 (clasp-1.3.7-x86) T 27730 27732 27732 0 -1 4202496 585 0 0 0 9463 0 0 0 25 0 1 0 850065091 2310144 317 33554432000 134512640 136139019 4290178944 18446744073709551615 134831215 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/27732/statm: 564 317 184 398 0 164 0
[pid=27730/tid=27735] ppid=27698 vsize=303904 CPUtime=0 cores=0,2,4,6
/proc/27730/task/27735/stat : 27735 (python) S 27698 27698 27575 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 850069939 311197696 5786 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604445170299136 0 0 -1 6 0 0 0
[pid=27736] ppid=27698 vsize=314472 CPUtime=0.23 cores=0,2,4,6
/proc/27736/stat : 27736 (python) S 27698 27698 27575 0 -1 4202560 1193 0 0 0 12 11 0 0 17 0 2 0 850069942 322019328 5868 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/27736/statm: 78618 5868 403 364 0 13496 0
[pid=27738] ppid=27736 vsize=143584 CPUtime=49.79 cores=0,2,4,6
/proc/27738/stat : 27738 (wbo1.4a) T 27736 27738 27738 0 -1 4202496 35695 0 0 0 4937 42 0 0 25 0 1 0 850069943 147030016 35416 33554432000 134512640 135751879 4290736656 18446744073709551615 134517408 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/27738/statm: 35896 35416 146 303 0 35591 0
[pid=27736/tid=27740] ppid=27698 vsize=314472 CPUtime=0 cores=0,2,4,6
/proc/27736/task/27740/stat : 27740 (python) S 27698 27698 27575 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 850074922 322019328 5868 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604453642638528 0 0 -1 6 0 0 0
[pid=27742] ppid=27698 vsize=324728 CPUtime=0.22 cores=0,2,4,6
/proc/27742/stat : 27742 (python) S 27698 27698 27575 0 -1 4202560 1132 0 0 0 11 11 0 0 17 0 2 0 850079547 332521472 5885 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738231755 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/27742/statm: 81182 5885 397 364 0 16057 0
[pid=27744] ppid=27742 vsize=8543924 CPUtime=48.97 cores=0,2,4,6
/proc/27744/stat : 27744 (java) T 27742 27744 27744 0 -1 4202496 151389 0 1 0 4877 20 0 0 18 0 19 0 850079548 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/27744/statm: 2135981 125043 2236 9 0 2126722 0
[pid=27744/tid=27745] ppid=27742 vsize=8543924 CPUtime=46.54 cores=0,2,4,6
/proc/27744/task/27745/stat : 27745 (java) T 27742 27744 27744 0 -1 4202560 91233 0 1 0 4644 10 0 0 25 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 46912505565222 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27746] ppid=27742 vsize=8543924 CPUtime=0.11 cores=0,2,4,6
/proc/27744/task/27746/stat : 27746 (java) T 27742 27744 27744 0 -1 4202560 6700 0 0 0 11 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27747] ppid=27742 vsize=8543924 CPUtime=0.14 cores=0,2,4,6
/proc/27744/task/27747/stat : 27747 (java) T 27742 27744 27744 0 -1 4202560 7332 0 0 0 13 1 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=27744/tid=27748] ppid=27742 vsize=8543924 CPUtime=0.13 cores=0,2,4,6
/proc/27744/task/27748/stat : 27748 (java) T 27742 27744 27744 0 -1 4202560 6795 0 0 0 13 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27749] ppid=27742 vsize=8543924 CPUtime=0.13 cores=0,2,4,6
/proc/27744/task/27749/stat : 27749 (java) T 27742 27744 27744 0 -1 4202560 6375 0 0 0 13 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=27744/tid=27750] ppid=27742 vsize=8543924 CPUtime=0.1 cores=0,2,4,6
/proc/27744/task/27750/stat : 27750 (java) T 27742 27744 27744 0 -1 4202560 4787 0 0 0 10 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=27744/tid=27751] ppid=27742 vsize=8543924 CPUtime=0.09 cores=0,2,4,6
/proc/27744/task/27751/stat : 27751 (java) T 27742 27744 27744 0 -1 4202560 5397 0 0 0 9 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=27744/tid=27752] ppid=27742 vsize=8543924 CPUtime=0.1 cores=0,2,4,6
/proc/27744/task/27752/stat : 27752 (java) T 27742 27744 27744 0 -1 4202560 6392 0 0 0 10 0 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=27744/tid=27753] ppid=27742 vsize=8543924 CPUtime=0.1 cores=0,2,4,6
/proc/27744/task/27753/stat : 27753 (java) T 27742 27744 27744 0 -1 4202560 4681 0 0 0 9 1 0 0 15 0 19 0 850079549 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=27744/tid=27754] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27754/stat : 27754 (java) T 27742 27744 27744 0 -1 4202560 191 0 0 0 0 0 0 0 15 0 19 0 850079550 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738221568 0 0 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27755] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27755/stat : 27755 (java) T 27742 27744 27744 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850079551 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27756] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27756/stat : 27756 (java) T 27742 27744 27744 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 850079551 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 4
[pid=27744/tid=27757] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27757/stat : 27757 (java) T 27742 27744 27744 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850079553 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738228657 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=27744/tid=27758] ppid=27742 vsize=8543924 CPUtime=0.44 cores=0,2,4,6
/proc/27744/task/27758/stat : 27758 (java) T 27742 27744 27744 0 -1 4202560 4857 0 0 0 43 1 0 0 15 0 19 0 850079553 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27759] ppid=27742 vsize=8543924 CPUtime=0.96 cores=0,2,4,6
/proc/27744/task/27759/stat : 27759 (java) T 27742 27744 27744 0 -1 4202560 5249 0 0 0 96 0 0 0 15 0 19 0 850079553 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=27744/tid=27760] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27760/stat : 27760 (java) T 27742 27744 27744 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850079553 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738220953 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=27744/tid=27761] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27761/stat : 27761 (java) T 27742 27744 27744 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 19 0 850079553 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738221568 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27744/tid=27762] ppid=27742 vsize=8543924 CPUtime=0 cores=0,2,4,6
/proc/27744/task/27762/stat : 27762 (java) T 27742 27744 27744 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850079572 8748978176 125043 33554432000 1073741824 1073778376 140736654354112 18446744073709551615 264738221568 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=27742/tid=27764] ppid=27698 vsize=324728 CPUtime=0 cores=0,2,4,6
/proc/27742/task/27764/stat : 27764 (python) S 27698 27698 27575 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850084255 332521472 5885 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554946 18446604441055478144 0 0 -1 0 0 0 0
[pid=27765] ppid=27698 vsize=334984 CPUtime=0 cores=0,2,4,6
/proc/27765/stat : 27765 (python) S 27698 27698 27575 0 -1 4202560 829 0 0 0 0 0 0 0 15 0 1 0 850084258 343023616 5840 33554432000 4194304 5683644 140736428028624 18446744073709551615 264726425158 0 0 16781312 33554946 4294934786 0 0 17 6 0 0 0
/proc/27765/statm: 83746 5840 349 364 0 18618 0
[pid=27767] ppid=27765 vsize=8538820 CPUtime=1.14 cores=0,2,4,6
/proc/27767/stat : 27767 (java) S 27765 27767 27767 0 -1 4202496 19969 0 1 0 111 3 0 0 20 0 19 0 850084258 8743751680 17903 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/27767/statm: 2134705 17904 2214 9 0 2125446 0
[pid=27767/tid=27768] ppid=27765 vsize=8538820 CPUtime=0.56 cores=0,2,4,6
/proc/27767/task/27768/stat : 27768 (java) R 27765 27767 27767 0 -1 4202560 14034 0 1 0 55 1 0 0 18 0 19 0 850084259 8743751680 17945 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 46912505543701 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=27767/tid=27769] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27769/stat : 27769 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 850084260 8743751680 17947 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27770] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27770/stat : 27770 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 850084260 8743751680 17949 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27771] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27771/stat : 27771 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 850084260 8743751680 17949 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27772] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27772/stat : 27772 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084260 8743751680 17950 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27773] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27773/stat : 27773 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084260 8743751680 17953 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27774] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27774/stat : 27774 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084260 8743751680 17954 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27775] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27775/stat : 27775 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084260 8743751680 17955 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27776] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27776/stat : 27776 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084260 8743751680 17956 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27777] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27777/stat : 27777 (java) S 27765 27767 27767 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 850084261 8743751680 17959 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738221568 0 0 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27778] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27778/stat : 27778 (java) S 27765 27767 27767 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 850084261 8743751680 17960 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27779] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27779/stat : 27779 (java) S 27765 27767 27767 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 850084261 8743751680 17962 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27780] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27780/stat : 27780 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084263 8743751680 17962 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738228657 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27781] ppid=27765 vsize=8538820 CPUtime=0.26 cores=0,2,4,6
/proc/27767/task/27781/stat : 27781 (java) S 27765 27767 27767 0 -1 4202560 1179 0 0 0 26 0 0 0 16 0 19 0 850084263 8743751680 17963 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 0 0 0 0
[pid=27767/tid=27782] ppid=27765 vsize=8538820 CPUtime=0.29 cores=0,2,4,6
/proc/27767/task/27782/stat : 27782 (java) S 27765 27767 27767 0 -1 4202560 3404 0 0 0 29 0 0 0 16 0 19 0 850084263 8743751680 17965 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27767/tid=27783] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27783/stat : 27783 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 850084264 8743751680 17966 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738220953 0 4 0 16800975 18446604448793892992 0 0 -1 6 0 0 0
[pid=27767/tid=27784] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27784/stat : 27784 (java) S 27765 27767 27767 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 850084264 8743751680 17968 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738221568 0 4 0 16800975 18446604448793892992 0 0 -1 4 0 0 0
[pid=27767/tid=27785] ppid=27765 vsize=8538820 CPUtime=0 cores=0,2,4,6
/proc/27767/task/27785/stat : 27785 (java) S 27765 27767 27767 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 850084281 8743751680 17968 33554432000 1073741824 1073778376 140733924839888 18446744073709551615 264738221568 0 4 0 16800975 18446604448793892992 0 0 -1 2 0 0 0
[pid=27698/tid=27714] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27714/stat : 27714 (python) S 27696 27698 27575 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 7 0 850055746 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
[pid=27698/tid=27722] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27722/stat : 27722 (python) S 27696 27698 27575 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 7 0 850060384 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27731] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27731/stat : 27731 (python) S 27696 27698 27575 0 -1 4202560 34 931 0 0 0 0 0 0 18 0 7 0 850065091 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27737] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27737/stat : 27737 (python) S 27696 27698 27575 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 7 0 850069942 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27743] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27743/stat : 27743 (python) S 27696 27698 27575 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 7 0 850079547 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 0 0 0 0
[pid=27698/tid=27766] ppid=27696 vsize=345228 CPUtime=0 cores=0,2,4,6
/proc/27698/task/27766/stat : 27766 (python) S 27696 27698 27575 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 7 0 850084258 353513472 7376 33554432000 4194304 5683644 140736428028624 18446744073709551615 264738228657 0 0 16781312 33554434 18446604453060305024 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 289.73
Current children cumulated vsize (KiB) 19502624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27698 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=486925
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=159975
# CPU time returned by wait4() is 0.6469
# while last known CPU time is 289.73
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 287.29
CPU time (s): 289.73
CPU user time (s): 287.7
CPU system time (s): 2.03
CPU usage (%): 100.849
Max. virtual memory (cumulated for all children) (KiB): 19503012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.486925
system time used= 0.159975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14998
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11212
involuntary context switches= 17

runsolver used 1.73673 second user time and 3.60445 second system time

The end

Launcher Data 

Begin job on node141 at 2011-06-09 01:39:57
IDJOB=3481734
IDBENCH=1962
IDSOLVER=1970
FILE ID=node141/3481734-1307576397
RUNJOBID= node141-1307576354-27593
PBS_JOBID= 13547658
Free space on /tmp= 73912 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/domset/normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481734-1307576397/watcher-3481734-1307576397 -o /tmp/evaluation-result-3481734-1307576397/solver-3481734-1307576397 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481734-1307576397.opb -seed 640418217 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1e2b8f542cc5dec610d6e9b4663a878b
RANDOM SEED=640418217

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22085420 kB
Buffers:        137852 kB
Cached:         474512 kB
SwapCached:       8884 kB
Active:       10435300 kB
Inactive:       162936 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22085420 kB
SwapTotal:    67111528 kB
SwapFree:     62998992 kB
Dirty:          220740 kB
Writeback:           0 kB
AnonPages:     9984256 kB
Mapped:          25032 kB
Slab:           127616 kB
PageTables:      69844 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 150651588 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73796 MiB
End job on node141 at 2011-06-09 01:44:49