Trace number 3481847

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 290.43 300.283

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
domset/normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb
MD5SUMa65a3b6248e07fcc15fb8d2bec9ac9bd
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark187
Best CPU time to get the best result obtained on this benchmark1797.05
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 182
Optimality of the best value was proved NO
Number of variables470
Total number of constraints470
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints470
Minimum length of a constraint4
Maximum length of a constraint20
Number of terms in the objective function 470
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 470
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 30
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 470
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.56/13.08	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.56/13.09	c INFO: solving HOME/instance-3481847-1307576359.opb
0.56/13.09	c INFO: parsing took 0.01 s
0.62/13.11	c INFO: features took 0.01 CPU seconds
0.62/13.17	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.74)
49.61/62.09	c INFO: running scip-2.0.1-clp@0 for 45 with 1752 remaining (b = 0.15)
96.87/109.23	c INFO: running clasp-1.3.7@0 for 45 with 1705 remaining (b = 0.03)
145.25/157.43	c INFO: running wbo1.4a@0 for 45 with 1657 remaining (b = 0.02)
195.02/207.02	c INFO: running clasp-1.3.7@48 for 45 with 1608 remaining (b = 0.01)
240.75/252.66	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1563 remaining (b = 0.01)
289.71/299.89	c INFO: running sat4j-pb-v20101225@0 for 91 with 1514 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481847-1307576359/watcher-3481847-1307576359 -o /tmp/evaluation-result-3481847-1307576359/solver-3481847-1307576359 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481847-1307576359.opb -seed 10733940 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.72 0.16 0.05 4/399 11038
/proc/meminfo: memFree=30291132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/11036/stat : 11036 (runsolver) S 11032 11036 11000 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 1 0 869238375 12079104 51 33554432000 4194304 5432328 140737161155440 18446744073709551615 4881591 0 2147483391 4096 24578 18446744071699960631 0 0 17 1 0 0 0
/proc/11036/statm: 2949 51 31 303 0 2643 0

[startup+0.07544 s]
/proc/loadavg: 0.72 0.16 0.05 4/399 11038
/proc/meminfo: memFree=30291132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/11036/stat : 11036 (runsolver) D 11032 11036 11000 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 1 0 869238375 12079104 54 33554432000 4194304 5432328 140737161155440 18446744073709551615 5055479 0 0 4096 24578 18446744071562234166 0 0 17 1 0 0 0
/proc/11036/statm: 2949 54 34 303 0 2643 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11796

[startup+0.100454 s]
/proc/loadavg: 0.72 0.16 0.05 4/399 11038
/proc/meminfo: memFree=30291132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=1840 CPUtime=0 cores=1,3,5,7
/proc/11036/stat : 11036 (python) D 11032 11036 11000 0 -1 4194304 46 0 0 0 0 0 0 0 18 0 1 0 869238375 1884160 1 33554432000 0 0 140735921546921 18446744073709551615 5055479 0 0 4096 0 18446744071562234166 0 0 17 1 0 0 1
/proc/11036/statm: 460 1 0 0 0 36 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 1840

[startup+0.300402 s]
/proc/loadavg: 0.72 0.16 0.05 4/399 11038
/proc/meminfo: memFree=30291132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=14252 CPUtime=0 cores=1,3,5,7
/proc/11036/stat : 11036 (python) D 11032 11036 11000 0 -1 4194304 194 0 3 0 0 0 0 0 17 0 1 0 869238375 14594048 133 33554432000 4194304 5683644 140735921539488 18446744073709551615 5051632 0 0 4096 0 18446744071562234166 0 0 17 7 0 0 12
/proc/11036/statm: 3563 133 105 364 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14252

[startup+0.700329 s]
/proc/loadavg: 0.72 0.16 0.05 4/399 11038
/proc/meminfo: memFree=30291132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=15380 CPUtime=0 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 786 0 5 0 0 0 0 0 15 0 1 0 869238375 15749120 679 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 21
/proc/11036/statm: 3845 679 322 364 0 332 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15380

[startup+1.50019 s]
/proc/loadavg: 0.72 0.16 0.05 1/401 11040
/proc/meminfo: memFree=30284280/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=16400 CPUtime=0.02 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 1110 0 5 0 1 1 0 0 16 0 1 0 869238375 16793600 984 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278875493 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 32
/proc/11036/statm: 4100 984 408 364 0 587 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16400

[startup+3.1009 s]
/proc/loadavg: 0.72 0.16 0.05 1/401 11040
/proc/meminfo: memFree=30280088/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=20980 CPUtime=0.04 cores=1,3,5,7
/proc/11036/stat : 11036 (python) D 11032 11036 11000 0 -1 4202496 1294 0 7 0 2 2 0 0 16 0 1 0 869238375 21483520 1153 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278877696 0 0 16781312 2 0 0 0 17 7 0 0 38
/proc/11036/statm: 5245 1153 428 364 0 692 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 20980
heavy processes:

[startup+6.30033 s]
/proc/loadavg: 0.98 0.22 0.07 3/401 11048
/proc/meminfo: memFree=30262940/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=111980 CPUtime=0.2 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 4650 920 33 9 9 11 0 0 16 0 1 0 869238375 114667520 3132 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 61
/proc/11036/statm: 27995 3132 901 364 0 2174 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 111980
heavy processes:

[startup+12.7002 s]
/proc/loadavg: 0.90 0.22 0.07 1/401 11048
/proc/meminfo: memFree=30215412/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=261396 CPUtime=0.54 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 8152 920 108 9 27 27 0 0 16 0 1 0 869238375 267669504 6353 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 135
/proc/11036/statm: 65349 6353 1677 364 0 5065 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 261396
heavy processes:

[startup+25.5009 s]
/proc/loadavg: 1.08 0.29 0.10 3/407 11054
/proc/meminfo: memFree=30161340/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=293276 CPUtime=0.65 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 9572 920 112 9 36 29 0 0 18 0 2 0 869238375 300314624 7186 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 137
/proc/11036/statm: 73319 7186 1870 364 0 8206 0
[pid=11050] ppid=11036 vsize=283032 CPUtime=0.04 cores=1,3,5,7
/proc/11050/stat : 11050 (python) S 11036 11036 11000 0 -1 4202560 910 0 0 0 2 2 0 0 15 0 1 0 869239693 289824768 5688 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278899727 0 0 16781312 33554946 5623753486446373777 0 0 17 7 0 0 0
/proc/11050/statm: 70758 5688 376 364 0 5645 0
[pid=11053] ppid=11050 vsize=33076 CPUtime=12.31 cores=1,3,5,7
/proc/11053/stat : 11053 (scip-2.0.1.linu) R 11050 11053 11053 0 -1 4202496 6726 0 0 0 1197 34 0 0 20 0 1 0 869239693 33869824 6068 33554432000 4194304 13684479 140735353835056 18446744073709551615 7416470 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11053/statm: 8269 6068 804 2317 0 5947 0
[pid=11036/tid=11052] ppid=11032 vsize=293276 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11052/stat : 11052 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 18 0 2 0 869239693 300314624 7186 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 13
Current children cumulated vsize (KiB) 609384
heavy processes:

[startup+51.1004 s]
/proc/loadavg: 1.39 0.43 0.15 3/407 11055
/proc/meminfo: memFree=30162012/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=293276 CPUtime=0.65 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 9572 920 112 9 36 29 0 0 18 0 2 0 869238375 300314624 7186 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 137
/proc/11036/statm: 73319 7186 1870 364 0 8206 0
[pid=11050] ppid=11036 vsize=283032 CPUtime=0.12 cores=1,3,5,7
/proc/11050/stat : 11050 (python) S 11036 11036 11000 0 -1 4202560 921 0 0 0 5 7 0 0 15 0 1 0 869239693 289824768 5688 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278899727 0 0 16781312 33554946 5623606151888251793 0 0 17 5 0 0 0
/proc/11050/statm: 70758 5688 376 364 0 5645 0
[pid=11053] ppid=11050 vsize=33076 CPUtime=37.91 cores=1,3,5,7
/proc/11053/stat : 11053 (scip-2.0.1.linu) R 11050 11053 11053 0 -1 4202496 6729 0 0 0 3682 109 0 0 25 0 1 0 869239693 33869824 6071 33554432000 4194304 13684479 140735353835056 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11053/statm: 8269 6071 807 2317 0 5947 0
[pid=11036/tid=11052] ppid=11032 vsize=293276 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11052/stat : 11052 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 18 0 2 0 869239693 300314624 7186 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38.68
Current children cumulated vsize (KiB) 609384
heavy processes:

[startup+102.316 s]
/proc/loadavg: 1.71 0.68 0.25 3/415 11064
/proc/meminfo: memFree=30117952/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=304044 CPUtime=0.67 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 10390 920 112 9 38 29 0 0 20 0 3 0 869238375 311341056 7307 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 137
/proc/11036/statm: 76011 7307 1873 364 0 10895 0
[pid=11050] ppid=11036 vsize=293276 CPUtime=0.17 cores=1,3,5,7
/proc/11050/stat : 11050 (python) S 11036 11036 11000 0 -1 4202560 1084 0 0 0 7 10 0 0 16 0 2 0 869239693 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/11050/statm: 73319 5724 407 364 0 8206 0
[pid=11053] ppid=11050 vsize=33076 CPUtime=48.87 cores=1,3,5,7
/proc/11053/stat : 11053 (scip-2.0.1.linu) T 11050 11053 11053 0 -1 4202496 6738 0 0 0 4734 153 0 0 25 0 1 0 869239693 33869824 6080 33554432000 4194304 13684479 140735353835056 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/11053/statm: 8269 6080 814 2317 0 5947 0
[pid=11050/tid=11060] ppid=11036 vsize=293276 CPUtime=0 cores=1,3,5,7
/proc/11050/task/11060/stat : 11060 (python) S 11036 11036 11000 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 869244582 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604465300795456 0 0 -1 5 0 0 0
[pid=11061] ppid=11036 vsize=293800 CPUtime=0.14 cores=1,3,5,7
/proc/11061/stat : 11061 (python) S 11036 11036 11000 0 -1 4202560 966 0 0 0 8 6 0 0 15 0 1 0 869244584 300851200 5803 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278899782 0 0 16781312 33554946 5623311482772007825 0 0 17 1 0 0 0
/proc/11061/statm: 73450 5803 373 364 0 8334 0
[pid=11063] ppid=11061 vsize=31628 CPUtime=40.12 cores=1,3,5,7
/proc/11063/stat : 11063 (scip-2.0.1.linu) R 11061 11063 11063 0 -1 4202496 21150 0 0 0 3989 23 0 0 25 0 1 0 869244586 32387072 5343 33554432000 4194304 15243407 140733522397680 18446744073709551615 13354455 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11063/statm: 7907 5343 931 2698 0 5202 0
[pid=11036/tid=11052] ppid=11032 vsize=304044 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11052/stat : 11052 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 18 0 3 0 869239693 311341056 7307 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
[pid=11036/tid=11062] ppid=11032 vsize=304044 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11062/stat : 11062 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 20 0 3 0 869244584 311341056 7307 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 89.97
Current children cumulated vsize (KiB) 955824

[startup+162.301 s]
/proc/loadavg: 1.88 0.90 0.34 3/431 11082
/proc/meminfo: memFree=30069132/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=324760 CPUtime=0.73 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 12290 920 112 9 43 30 0 0 19 0 5 0 869238375 332554240 7355 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 137
/proc/11036/statm: 81190 7355 1877 364 0 16068 0
[pid=11050] ppid=11036 vsize=293276 CPUtime=0.17 cores=1,3,5,7
/proc/11050/stat : 11050 (python) S 11036 11036 11000 0 -1 4202560 1084 0 0 0 7 10 0 0 16 0 2 0 869239693 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/11050/statm: 73319 5724 407 364 0 8206 0
[pid=11053] ppid=11050 vsize=33076 CPUtime=48.87 cores=1,3,5,7
/proc/11053/stat : 11053 (scip-2.0.1.linu) T 11050 11053 11053 0 -1 4202496 6738 0 0 0 4734 153 0 0 25 0 1 0 869239693 33869824 6080 33554432000 4194304 13684479 140735353835056 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/11053/statm: 8269 6080 814 2317 0 5947 0
[pid=11050/tid=11060] ppid=11036 vsize=293276 CPUtime=0 cores=1,3,5,7
/proc/11050/task/11060/stat : 11060 (python) S 11036 11036 11000 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 869244582 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604465300795456 0 0 -1 5 0 0 0
[pid=11061] ppid=11036 vsize=293800 CPUtime=0.18 cores=1,3,5,7
/proc/11061/stat : 11061 (python) S 11036 11036 11000 0 -1 4202560 1129 0 0 0 10 8 0 0 16 0 2 0 869244584 300851200 5828 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/11061/statm: 73450 5828 397 364 0 8334 0
[pid=11063] ppid=11061 vsize=30916 CPUtime=47.01 cores=1,3,5,7
/proc/11063/stat : 11063 (scip-2.0.1.linu) T 11061 11063 11063 0 -1 4202496 21687 0 0 0 4673 28 0 0 25 0 1 0 869244586 31657984 5314 33554432000 4194304 15243407 140733522397680 18446744073709551615 7103774 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/11063/statm: 7729 5314 937 2698 0 5024 0
[pid=11061/tid=11066] ppid=11036 vsize=293800 CPUtime=0 cores=1,3,5,7
/proc/11061/task/11066/stat : 11066 (python) S 11036 11036 11000 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869249296 300851200 5828 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604471149740352 0 0 -1 1 0 0 0
[pid=11067] ppid=11036 vsize=303928 CPUtime=0.16 cores=1,3,5,7
/proc/11067/stat : 11067 (python) S 11036 11036 11000 0 -1 4202560 1158 0 0 0 8 8 0 0 16 0 2 0 869249298 311222272 5795 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/11067/statm: 75982 5795 403 364 0 10863 0
[pid=11069] ppid=11067 vsize=2256 CPUtime=48.17 cores=1,3,5,7
/proc/11069/stat : 11069 (clasp-1.3.7-x86) T 11067 11069 11069 0 -1 4202496 584 0 0 0 4817 0 0 0 25 0 1 0 869249299 2310144 317 33554432000 134512640 136139019 4287439440 18446744073709551615 134833163 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/11069/statm: 564 317 184 398 0 164 0
[pid=11067/tid=11075] ppid=11036 vsize=303928 CPUtime=0 cores=1,3,5,7
/proc/11067/task/11075/stat : 11075 (python) S 11036 11036 11000 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 869254116 311222272 5795 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604454826609728 0 0 -1 7 0 0 0
[pid=11076] ppid=11036 vsize=314516 CPUtime=0.02 cores=1,3,5,7
/proc/11076/stat : 11076 (python) S 11036 11036 11000 0 -1 4202560 1007 0 0 0 1 1 0 0 15 0 1 0 869254119 322064384 5852 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278899782 0 0 16781312 33554946 4294934791 0 0 17 1 0 0 0
/proc/11076/statm: 78629 5852 378 364 0 13507 0
[pid=11078] ppid=11076 vsize=16760 CPUtime=4.85 cores=1,3,5,7

################
# More data... #
################

[pid=11036/tid=11068] ppid=11032 vsize=335180 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11068/stat : 11068 (python) S 11032 11036 11000 0 -1 4202560 33 920 0 9 0 0 0 0 18 0 6 0 869249299 343224320 7402 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
[pid=11036/tid=11077] ppid=11032 vsize=335180 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11077/stat : 11077 (python) S 11032 11036 11000 0 -1 4202560 30 920 0 9 0 0 0 0 20 0 6 0 869254119 343224320 7402 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
[pid=11036/tid=11088] ppid=11032 vsize=335180 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11088/stat : 11088 (python) S 11032 11036 11000 0 -1 4202560 27 920 0 9 0 0 0 0 20 0 6 0 869263642 343224320 7402 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 271.88
Current children cumulated vsize (KiB) 10613148



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+300.202 s]
/proc/loadavg: 1.99 1.30 0.57 5/481 11176
/proc/meminfo: memFree=29134760/32950904 swapFree=56615552/67111528
[pid=11036] ppid=11032 vsize=345436 CPUtime=0.8 cores=1,3,5,7
/proc/11036/stat : 11036 (python) S 11032 11036 11000 0 -1 4202496 14131 920 112 9 50 30 0 0 20 0 7 0 869238375 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 137
/proc/11036/statm: 86359 7408 1881 364 0 21231 0
[pid=11050] ppid=11036 vsize=293276 CPUtime=0.17 cores=1,3,5,7
/proc/11050/stat : 11050 (python) S 11036 11036 11000 0 -1 4202560 1084 0 0 0 7 10 0 0 16 0 2 0 869239693 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/11050/statm: 73319 5724 407 364 0 8206 0
[pid=11053] ppid=11050 vsize=33076 CPUtime=48.87 cores=1,3,5,7
/proc/11053/stat : 11053 (scip-2.0.1.linu) T 11050 11053 11053 0 -1 4202496 6738 0 0 0 4734 153 0 0 25 0 1 0 869239693 33869824 6080 33554432000 4194304 13684479 140735353835056 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/11053/statm: 8269 6080 814 2317 0 5947 0
[pid=11050/tid=11060] ppid=11036 vsize=293276 CPUtime=0 cores=1,3,5,7
/proc/11050/task/11060/stat : 11060 (python) S 11036 11036 11000 0 -1 4202560 43 0 0 0 0 0 0 0 16 0 2 0 869244582 300314624 5724 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604465300795456 0 0 -1 5 0 0 0
[pid=11061] ppid=11036 vsize=293800 CPUtime=0.18 cores=1,3,5,7
/proc/11061/stat : 11061 (python) S 11036 11036 11000 0 -1 4202560 1129 0 0 0 10 8 0 0 16 0 2 0 869244584 300851200 5828 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/11061/statm: 73450 5828 397 364 0 8334 0
[pid=11063] ppid=11061 vsize=30916 CPUtime=47.01 cores=1,3,5,7
/proc/11063/stat : 11063 (scip-2.0.1.linu) T 11061 11063 11063 0 -1 4202496 21687 0 0 0 4673 28 0 0 25 0 1 0 869244586 31657984 5314 33554432000 4194304 15243407 140733522397680 18446744073709551615 7103774 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/11063/statm: 7729 5314 937 2698 0 5024 0
[pid=11061/tid=11066] ppid=11036 vsize=293800 CPUtime=0 cores=1,3,5,7
/proc/11061/task/11066/stat : 11066 (python) S 11036 11036 11000 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869249296 300851200 5828 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604471149740352 0 0 -1 1 0 0 0
[pid=11067] ppid=11036 vsize=303928 CPUtime=0.31 cores=1,3,5,7
/proc/11067/stat : 11067 (python) S 11036 11036 11000 0 -1 4202560 1186 0 0 0 15 16 0 0 15 0 2 0 869249298 311222272 5795 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/11067/statm: 75982 5795 403 364 0 10863 0
[pid=11069] ppid=11067 vsize=2256 CPUtime=93.78 cores=1,3,5,7
/proc/11069/stat : 11069 (clasp-1.3.7-x86) T 11067 11069 11069 0 -1 4202496 586 0 0 0 9378 0 0 0 25 0 1 0 869249299 2310144 319 33554432000 134512640 136139019 4287439440 18446744073709551615 134599831 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/11069/statm: 564 319 184 398 0 164 0
[pid=11067/tid=11075] ppid=11036 vsize=303928 CPUtime=0 cores=1,3,5,7
/proc/11067/task/11075/stat : 11075 (python) S 11036 11036 11000 0 -1 4202560 44 0 0 0 0 0 0 0 15 0 2 0 869254116 311222272 5795 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604454826609728 0 0 -1 7 0 0 0
[pid=11076] ppid=11036 vsize=314516 CPUtime=0.18 cores=1,3,5,7
/proc/11076/stat : 11076 (python) S 11036 11036 11000 0 -1 4202560 1190 0 0 0 8 10 0 0 16 0 2 0 869254119 322064384 5878 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/11076/statm: 78629 5878 403 364 0 13507 0
[pid=11078] ppid=11076 vsize=136124 CPUtime=49.55 cores=1,3,5,7
/proc/11078/stat : 11078 (wbo1.4a) T 11076 11078 11078 0 -1 4202496 33837 0 0 0 4849 106 0 0 25 0 1 0 869254119 139390976 33558 33554432000 134512640 135751879 4291471376 18446744073709551615 134517408 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/11078/statm: 34031 33558 146 303 0 33726 0
[pid=11076/tid=11084] ppid=11036 vsize=314516 CPUtime=0 cores=1,3,5,7
/proc/11076/task/11084/stat : 11084 (python) S 11036 11036 11000 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869259075 322064384 5878 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604466030708032 0 0 -1 7 0 0 0
[pid=11087] ppid=11036 vsize=324936 CPUtime=0.16 cores=1,3,5,7
/proc/11087/stat : 11087 (python) S 11036 11036 11000 0 -1 4202560 1143 0 0 0 7 9 0 0 16 0 2 0 869263642 332734464 5917 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290706379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/11087/statm: 81234 5917 397 364 0 16109 0
[pid=11089] ppid=11087 vsize=8545140 CPUtime=48.8 cores=1,3,5,7
/proc/11089/stat : 11089 (java) T 11087 11089 11089 0 -1 4202496 118314 0 118 0 4862 18 0 0 15 0 19 0 869263642 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 17
/proc/11089/statm: 2136285 88202 2237 9 0 2127026 0
[pid=11089/tid=11090] ppid=11087 vsize=8545140 CPUtime=46.32 cores=1,3,5,7
/proc/11089/task/11090/stat : 11090 (java) T 11087 11089 11089 0 -1 4202560 78750 0 59 0 4623 9 0 0 25 0 19 0 869263662 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 46912505584917 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 12
[pid=11089/tid=11091] ppid=11087 vsize=8545140 CPUtime=0.13 cores=1,3,5,7
/proc/11089/task/11091/stat : 11091 (java) T 11087 11089 11089 0 -1 4202560 3259 0 0 0 13 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11092] ppid=11087 vsize=8545140 CPUtime=0.1 cores=1,3,5,7
/proc/11089/task/11092/stat : 11092 (java) T 11087 11089 11089 0 -1 4202560 2315 0 0 0 10 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=11089/tid=11093] ppid=11087 vsize=8545140 CPUtime=0.11 cores=1,3,5,7
/proc/11089/task/11093/stat : 11093 (java) T 11087 11089 11089 0 -1 4202560 2980 0 0 0 11 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=11089/tid=11094] ppid=11087 vsize=8545140 CPUtime=0.11 cores=1,3,5,7
/proc/11089/task/11094/stat : 11094 (java) T 11087 11089 11089 0 -1 4202560 2549 0 0 0 11 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=11089/tid=11095] ppid=11087 vsize=8545140 CPUtime=0.13 cores=1,3,5,7
/proc/11089/task/11095/stat : 11095 (java) T 11087 11089 11089 0 -1 4202560 3803 0 0 0 12 1 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11096] ppid=11087 vsize=8545140 CPUtime=0.13 cores=1,3,5,7
/proc/11089/task/11096/stat : 11096 (java) T 11087 11089 11089 0 -1 4202560 2916 0 0 0 13 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11097] ppid=11087 vsize=8545140 CPUtime=0.1 cores=1,3,5,7
/proc/11089/task/11097/stat : 11097 (java) T 11087 11089 11089 0 -1 4202560 2933 0 0 0 10 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11098] ppid=11087 vsize=8545140 CPUtime=0.12 cores=1,3,5,7
/proc/11089/task/11098/stat : 11098 (java) T 11087 11089 11089 0 -1 4202560 3299 0 0 0 12 0 0 0 15 0 19 0 869263667 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=11089/tid=11099] ppid=11087 vsize=8545140 CPUtime=0.01 cores=1,3,5,7
/proc/11089/task/11099/stat : 11099 (java) T 11087 11089 11089 0 -1 4202560 138 0 0 0 0 1 0 0 15 0 19 0 869263670 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290696192 0 0 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=11089/tid=11100] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11100/stat : 11100 (java) T 11087 11089 11089 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869263671 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11101] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11101/stat : 11101 (java) T 11087 11089 11089 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869263671 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 25
[pid=11089/tid=11102] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11102/stat : 11102 (java) T 11087 11089 11089 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869263677 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290703281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11103] ppid=11087 vsize=8545140 CPUtime=0.69 cores=1,3,5,7
/proc/11089/task/11103/stat : 11103 (java) T 11087 11089 11089 0 -1 4202560 8592 0 0 0 68 1 0 0 15 0 19 0 869263677 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11104] ppid=11087 vsize=8545140 CPUtime=0.73 cores=1,3,5,7
/proc/11089/task/11104/stat : 11104 (java) T 11087 11089 11089 0 -1 4202560 5439 0 2 0 73 0 0 0 15 0 19 0 869263677 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=11089/tid=11105] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11105/stat : 11105 (java) T 11087 11089 11089 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869263677 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290695577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=11089/tid=11106] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11106/stat : 11106 (java) T 11087 11089 11089 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869263677 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290696192 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=11089/tid=11107] ppid=11087 vsize=8545140 CPUtime=0 cores=1,3,5,7
/proc/11089/task/11107/stat : 11107 (java) T 11087 11089 11089 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869263699 8750223360 88202 33554432000 1073741824 1073778376 140733465010624 18446744073709551615 237290696192 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=11087/tid=11155] ppid=11036 vsize=324936 CPUtime=0 cores=1,3,5,7
/proc/11087/task/11155/stat : 11155 (python) S 11036 11036 11000 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869268362 332734464 5917 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554946 18446604465848895680 0 0 -1 1 0 0 0
[pid=11156] ppid=11036 vsize=335192 CPUtime=0 cores=1,3,5,7
/proc/11156/stat : 11156 (python) S 11036 11036 11000 0 -1 4202560 830 0 0 0 0 0 0 0 17 0 1 0 869268365 343236608 5872 33554432000 4194304 5683644 140735921539488 18446744073709551615 237278899782 0 0 16781312 33554946 3872767050115973120 0 0 17 5 0 0 0
/proc/11156/statm: 83798 5872 349 364 0 18670 0
[pid=11158] ppid=11156 vsize=8536660 CPUtime=0.62 cores=1,3,5,7
/proc/11158/stat : 11158 (java) S 11156 11158 11158 0 -1 4202496 9622 0 1 0 60 2 0 0 20 0 19 0 869268365 8741539840 8447 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290682341 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/11158/statm: 2134165 8447 2205 9 0 2124906 0
[pid=11158/tid=11159] ppid=11156 vsize=8536660 CPUtime=0.32 cores=1,3,5,7
/proc/11158/task/11159/stat : 11159 (java) R 11156 11158 11158 0 -1 4202560 5312 0 1 0 31 1 0 0 25 0 19 0 869268366 8741539840 8606 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 46912505583209 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=11158/tid=11160] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11160/stat : 11160 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869268366 8741539840 8606 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11161] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11161/stat : 11161 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869268366 8741539840 8607 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11162] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11162/stat : 11162 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869268366 8741539840 8607 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11163] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11163/stat : 11163 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869268366 8741539840 8608 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11164] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11164/stat : 11164 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268366 8741539840 8608 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 7 0 0 0
[pid=11158/tid=11165] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11165/stat : 11165 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268366 8741539840 8609 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 7 0 0 0
[pid=11158/tid=11166] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11166/stat : 11166 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268366 8741539840 8609 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 7 0 0 0
[pid=11158/tid=11167] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11167/stat : 11167 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268366 8741539840 8609 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 7 0 0 0
[pid=11158/tid=11168] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11168/stat : 11168 (java) S 11156 11158 11158 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 869268367 8741539840 8610 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290696192 0 0 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11169] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11169/stat : 11169 (java) S 11156 11158 11158 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869268368 8741539840 8610 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11170] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11170/stat : 11170 (java) S 11156 11158 11158 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869268368 8741539840 8611 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 5 0 0 0
[pid=11158/tid=11171] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11171/stat : 11171 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268370 8741539840 8612 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290703281 0 4 0 16800975 18446604467876514880 0 0 -1 3 0 0 0
[pid=11158/tid=11172] ppid=11156 vsize=8536660 CPUtime=0.16 cores=1,3,5,7
/proc/11158/task/11172/stat : 11172 (java) R 11156 11158 11158 0 -1 4202560 1363 0 0 0 16 0 0 0 25 0 19 0 869268370 8741539840 8612 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 47866598141624 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=11158/tid=11173] ppid=11156 vsize=8536660 CPUtime=0.14 cores=1,3,5,7
/proc/11158/task/11173/stat : 11173 (java) R 11156 11158 11158 0 -1 4202560 1706 0 0 0 14 0 0 0 25 0 19 0 869268370 8741539840 8613 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 47866596234381 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=11158/tid=11174] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11174/stat : 11174 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869268370 8741539840 8613 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290695577 0 4 0 16800975 18446604467876514880 0 0 -1 5 0 0 0
[pid=11158/tid=11175] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11175/stat : 11175 (java) S 11156 11158 11158 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869268370 8741539840 8613 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290696192 0 4 0 16800975 18446604467876514880 0 0 -1 5 0 0 0
[pid=11158/tid=11176] ppid=11156 vsize=8536660 CPUtime=0 cores=1,3,5,7
/proc/11158/task/11176/stat : 11176 (java) S 11156 11158 11158 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869268387 8741539840 8614 33554432000 1073741824 1073778376 140734346952112 18446744073709551615 237290696192 0 4 0 16800975 18446604467876514880 0 0 -1 5 0 0 0
[pid=11036/tid=11052] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11052/stat : 11052 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 18 0 7 0 869239693 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
[pid=11036/tid=11062] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11062/stat : 11062 (python) S 11032 11036 11000 0 -1 4202560 28 920 0 9 0 0 0 0 20 0 7 0 869244584 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 7 0 0 0
[pid=11036/tid=11068] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11068/stat : 11068 (python) S 11032 11036 11000 0 -1 4202560 33 920 0 9 0 0 0 0 18 0 7 0 869249299 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
[pid=11036/tid=11077] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11077/stat : 11077 (python) S 11032 11036 11000 0 -1 4202560 30 920 0 9 0 0 0 0 20 0 7 0 869254119 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
[pid=11036/tid=11088] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11088/stat : 11088 (python) S 11032 11036 11000 0 -1 4202560 27 920 0 9 0 0 0 0 20 0 7 0 869263642 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 1 0 0 0
[pid=11036/tid=11157] ppid=11032 vsize=345436 CPUtime=0 cores=1,3,5,7
/proc/11036/task/11157/stat : 11157 (python) S 11032 11036 11000 0 -1 4202560 31 920 0 9 0 0 0 0 20 0 7 0 869268365 353726464 7408 33554432000 4194304 5683644 140735921539488 18446744073709551615 237290703281 0 0 16781312 33554434 18446604459786078976 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 290.43
Current children cumulated vsize (KiB) 19495256

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11036 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=510922
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=312952
# CPU time returned by wait4() is 0.823874
# while last known CPU time is 290.43
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 300.283
CPU time (s): 290.43
CPU user time (s): 286.53
CPU system time (s): 3.9
CPU usage (%): 96.7188
Max. virtual memory (cumulated for all children) (KiB): 19495820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.510922
system time used= 0.312952
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15054
page faults= 121
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22567
involuntary context switches= 67

runsolver used 1.35779 second user time and 3.3025 second system time

The end

Launcher Data 

Begin job on node121 at 2011-06-09 01:39:19
IDJOB=3481847
IDBENCH=1948
IDSOLVER=1970
FILE ID=node121/3481847-1307576359
RUNJOBID= node121-1307576358-11019
PBS_JOBID= 13547678
Free space on /tmp= 74068 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/domset/normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481847-1307576359/watcher-3481847-1307576359 -o /tmp/evaluation-result-3481847-1307576359/solver-3481847-1307576359 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481847-1307576359.opb -seed 10733940 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a65a3b6248e07fcc15fb8d2bec9ac9bd
RANDOM SEED=10733940

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      30293136 kB
Buffers:        145508 kB
Cached:         408884 kB
SwapCached:       9940 kB
Active:        2245244 kB
Inactive:       153704 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      30293136 kB
SwapTotal:    67111528 kB
SwapFree:     56615552 kB
Dirty:          205244 kB
Writeback:           0 kB
AnonPages:     1842268 kB
Mapped:          12568 kB
Slab:           137960 kB
PageTables:      51820 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 83503088 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73824 MiB
End job on node121 at 2011-06-09 01:44:49