Trace number 3481453

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 618.18 612.685

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_60_1.opb
MD5SUM7931a71f4daac58a32a56f6c89bc3525
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark14
Best CPU time to get the best result obtained on this benchmark1797.15
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 16
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint61
Maximum length of a constraint104
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)37366
Sum of products size (including duplicates)74732
Number of different products37366
Sum of products size74732

Solver Data 

0.36/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.36/0.69	c INFO: solving HOME/instance-3481453-1307577837.opb
0.93/1.10	c INFO: wrote linearized instance to HOME/tmpR15n1I.opb
1.52/1.59	c INFO: parsing took 0.48 s
2.62/2.60	c INFO: features took 1.01 CPU seconds
2.62/2.63	c INFO: running scip-2.0.1-spx@0 for 45 with 1797 remaining (b = 0.03)
53.10/52.93	c INFO: running wbo1.4a@0 for 45 with 1750 remaining (b = 0.02)
99.73/99.49	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1704 remaining (b = 0.01)
150.51/147.67	c INFO: running clasp-1.3.7@0 for 91 with 1654 remaining (b = 0.01)
242.72/239.57	c INFO: running scip-2.0.1-spx@47 for 45 with 1562 remaining (b = 0.00)
288.10/284.79	c INFO: running scip-2.0.1-clp@0 for 91 with 1517 remaining (b = 0.01)
383.84/380.19	c INFO: running scip-2.0.1-spx@92 for 228 with 1424 remaining (b = 0.02)
616.39/611.85	c INFO: running sat4j-pb-v20101225@0 for 91 with 1194 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481453-1307577837/watcher-3481453-1307577837 -o /tmp/evaluation-result-3481453-1307577837/solver-3481453-1307577837 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481453-1307577837.opb -seed 1889142764 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.14 2.08 1.59 2/643 1883
/proc/meminfo: memFree=22426120/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=15380 CPUtime=0 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 820 0 0 0 0 0 0 0 23 0 1 0 869384287 15749120 704 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/1883/statm: 3845 704 334 364 0 332 0

[startup+0.0407769 s]
/proc/loadavg: 2.14 2.08 1.59 2/643 1883
/proc/meminfo: memFree=22426120/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=18888 CPUtime=0.01 cores=1,3,5,7
/proc/1883/stat : 1883 (python) R 1881 1883 32706 0 -1 4202496 1278 0 0 0 1 0 0 0 17 0 1 0 869384287 19341312 1130 33554432000 4194304 5683644 140737303930336 18446744073709551615 230808856944 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1883/statm: 4722 1131 421 364 0 691 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18888

[startup+0.100766 s]
/proc/loadavg: 2.14 2.08 1.59 2/643 1883
/proc/meminfo: memFree=22426120/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=85620 CPUtime=0.06 cores=1,3,5,7
/proc/1883/stat : 1883 (python) R 1881 1883 32706 0 -1 4202496 2663 0 0 0 4 2 0 0 17 0 1 0 869384287 87674880 2382 33554432000 4194304 5683644 140737303930336 18446744073709551615 4530027 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1883/statm: 21405 2382 715 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300774 s]
/proc/loadavg: 2.14 2.08 1.59 2/643 1883
/proc/meminfo: memFree=22426120/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=123740 CPUtime=0.16 cores=1,3,5,7
/proc/1883/stat : 1883 (python) R 1881 1883 32706 0 -1 4202496 5358 928 1 0 10 6 0 0 16 0 1 0 869384287 126709760 3744 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809161733 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1883/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 123740

[startup+0.700634 s]
/proc/loadavg: 2.14 2.08 1.59 2/643 1883
/proc/meminfo: memFree=22426120/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=282400 CPUtime=0.42 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 9188 928 1 0 27 15 0 0 15 0 1 0 869384287 289177600 6937 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185807 0 0 16781312 2 2680548978457575424 0 0 17 1 0 0 0
/proc/1883/statm: 70600 6937 1777 364 0 5493 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 282400

[startup+1.50049 s]
/proc/loadavg: 2.05 2.06 1.59 3/645 1889
/proc/meminfo: memFree=22397384/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=299980 CPUtime=1.52 cores=1,3,5,7
/proc/1883/stat : 1883 (python) R 1881 1883 32706 0 -1 4202496 15243 1577 1 0 89 24 33 6 16 0 1 0 869384287 307179520 11272 33554432000 4194304 5683644 140737303930336 18446744073709551615 230808852202 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1883/statm: 74995 11274 1782 364 0 9888 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 299980

[startup+3.1002 s]
/proc/loadavg: 2.05 2.06 1.59 3/644 1889
/proc/meminfo: memFree=22378668/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=312152 CPUtime=2.65 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 20676 1577 1 0 202 24 33 6 19 0 2 0 869384287 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/1883/statm: 78038 11878 1871 364 0 12925 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 312152

[startup+6.30061 s]
/proc/loadavg: 2.12 2.08 1.59 3/647 1892
/proc/meminfo: memFree=22060976/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=312152 CPUtime=2.65 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 20676 1577 1 0 202 24 33 6 19 0 2 0 869384287 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/1883/statm: 78038 11878 1871 364 0 12925 0
[pid=1890] ppid=1883 vsize=301908 CPUtime=0.01 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 871 0 0 0 0 1 0 0 15 0 1 0 869384550 309153792 10345 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185807 0 0 16781312 33554946 4294934790 0 0 17 1 0 0 0
/proc/1890/statm: 75477 10345 342 364 0 10364 0
[pid=1892] ppid=1890 vsize=459252 CPUtime=3.66 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) R 1890 1892 1892 0 -1 4202496 113339 0 0 0 336 30 0 0 25 0 1 0 869384550 470274048 109958 33554432000 4194304 13684479 140734739753120 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1892/statm: 114813 109958 711 2317 0 112491 0
[pid=1883/tid=1891] ppid=1881 vsize=312152 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1891/stat : 1891 (python) S 1881 1883 32706 0 -1 4202560 27 1577 0 0 0 0 33 6 19 0 2 0 869384550 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 1073312

[startup+12.7004 s]
/proc/loadavg: 2.11 2.07 1.60 3/647 1893
/proc/meminfo: memFree=21862400/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=312152 CPUtime=2.65 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 20676 1577 1 0 202 24 33 6 19 0 2 0 869384287 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/1883/statm: 78038 11878 1871 364 0 12925 0
[pid=1890] ppid=1883 vsize=301908 CPUtime=0.03 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 874 0 0 0 1 2 0 0 15 0 1 0 869384550 309153792 10345 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185807 0 0 16781312 33554946 5623311482772007730 0 0 17 1 0 0 0
/proc/1890/statm: 75477 10345 342 364 0 10364 0
[pid=1892] ppid=1890 vsize=523056 CPUtime=10.06 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) R 1890 1892 1892 0 -1 4202496 131536 0 0 0 961 45 0 0 25 0 1 0 869384550 535609344 126834 33554432000 4194304 13684479 140734739753120 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1892/statm: 130764 126834 785 2317 0 128442 0
[pid=1883/tid=1891] ppid=1881 vsize=312152 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1891/stat : 1891 (python) S 1881 1883 32706 0 -1 4202560 27 1577 0 0 0 0 33 6 19 0 2 0 869384550 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.74
Current children cumulated vsize (KiB) 1137116

[startup+25.5011 s]
/proc/loadavg: 2.10 2.07 1.60 3/639 1953
/proc/meminfo: memFree=21465024/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=312152 CPUtime=2.65 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 20676 1577 1 0 202 24 33 6 19 0 2 0 869384287 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/1883/statm: 78038 11878 1871 364 0 12925 0
[pid=1890] ppid=1883 vsize=301908 CPUtime=0.07 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 879 0 0 0 3 4 0 0 15 0 1 0 869384550 309153792 10345 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185807 0 0 16781312 33554946 5623753486446373682 0 0 17 7 0 0 0
/proc/1890/statm: 75477 10345 342 364 0 10364 0
[pid=1892] ppid=1890 vsize=547344 CPUtime=22.85 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) R 1890 1892 1892 0 -1 4202496 138004 0 0 0 1996 289 0 0 19 0 1 0 869384550 560480256 132907 33554432000 4194304 13684479 140734739753120 18446744073709551615 6427718 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1892/statm: 136836 132907 812 2317 0 134514 0
[pid=1883/tid=1891] ppid=1881 vsize=312152 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1891/stat : 1891 (python) S 1881 1883 32706 0 -1 4202560 27 1577 0 0 0 0 33 6 19 0 2 0 869384550 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.57
Current children cumulated vsize (KiB) 1161404

[startup+51.1004 s]
/proc/loadavg: 2.06 2.06 1.61 3/639 1953
/proc/meminfo: memFree=21448404/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=312152 CPUtime=2.65 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 20676 1577 1 0 202 24 33 6 19 0 2 0 869384287 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/1883/statm: 78038 11878 1871 364 0 12925 0
[pid=1890] ppid=1883 vsize=301908 CPUtime=0.16 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 893 0 0 0 7 9 0 0 15 0 1 0 869384550 309153792 10345 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185807 0 0 16781312 33554946 3530253213670309888 0 0 17 7 0 0 0
/proc/1890/statm: 75477 10345 342 364 0 10364 0
[pid=1892] ppid=1890 vsize=560012 CPUtime=48.45 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) R 1890 1892 1892 0 -1 4202496 138970 0 0 0 4538 307 0 0 25 0 1 0 869384550 573452288 133858 33554432000 4194304 13684479 140734739753120 18446744073709551615 6979201 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1892/statm: 140003 133858 801 2317 0 137681 0
[pid=1883/tid=1891] ppid=1881 vsize=312152 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1891/stat : 1891 (python) S 1881 1883 32706 0 -1 4202560 27 1577 0 0 0 0 33 6 19 0 2 0 869384550 319643648 11878 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.26
Current children cumulated vsize (KiB) 1174072

[startup+102.317 s]
/proc/loadavg: 2.02 2.05 1.63 3/669 1985
/proc/meminfo: memFree=20789732/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=332664 CPUtime=2.7 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 22447 1577 1 0 206 25 33 6 19 0 4 0 869384287 340647936 11891 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/1883/statm: 83166 11891 1876 364 0 18047 0
[pid=1890] ppid=1883 vsize=312152 CPUtime=0.18 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 1092 0 0 0 8 10 0 0 16 0 2 0 869384550 319643648 10413 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1890/statm: 78038 10413 405 364 0 12925 0
[pid=1892] ppid=1890 vsize=703448 CPUtime=50.27 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) T 1890 1892 1892 0 -1 4202496 175870 0 0 0 4714 313 0 0 25 0 1 0 869384550 720330752 170757 33554432000 4194304 13684479 140734739753120 18446744073709551615 5096704 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/1892/statm: 175862 170757 810 2317 0 173540 0
[pid=1890/tid=1954] ppid=1883 vsize=312152 CPUtime=0 cores=1,3,5,7
/proc/1890/task/1954/stat : 1954 (python) S 1883 1883 32706 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869389578 319643648 10413 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604468893689984 0 0 -1 3 0 0 0
[pid=1955] ppid=1883 vsize=312164 CPUtime=0.17 cores=1,3,5,7
/proc/1955/stat : 1955 (python) S 1883 1883 32706 0 -1 4202560 1174 0 0 0 8 9 0 0 16 0 2 0 869389581 319655936 10404 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1955/statm: 78041 10404 396 364 0 12925 0
[pid=1957] ppid=1955 vsize=106216 CPUtime=46.52 cores=1,3,5,7
/proc/1957/stat : 1957 (wbo1.4a) T 1955 1957 1957 0 -1 4202496 28790 0 0 0 4636 16 0 0 25 0 1 0 869389581 108765184 25916 33554432000 134512640 135751879 4289635920 18446744073709551615 134611292 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/1957/statm: 26554 25916 146 303 0 26249 0
[pid=1955/tid=1964] ppid=1883 vsize=312164 CPUtime=0 cores=1,3,5,7
/proc/1955/task/1964/stat : 1964 (python) S 1883 1883 32706 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869394234 319655936 10404 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604466738228160 0 0 -1 7 0 0 0
[pid=1965] ppid=1883 vsize=322420 CPUtime=0 cores=1,3,5,7
/proc/1965/stat : 1965 (python) S 1883 1883 32706 0 -1 4202560 877 0 0 0 0 0 0 0 15 0 1 0 869394236 330158080 10337 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185862 0 0 16781312 33554946 1558678738781077504 0 0 17 7 0 0 0
/proc/1965/statm: 80605 10337 326 364 0 15486 0
[pid=1967] ppid=1965 vsize=8549128 CPUtime=4.52 cores=1,3,5,7
/proc/1967/stat : 1967 (java) S 1965 1967 1967 0 -1 4202496 95341 0 1 0 441 11 0 0 20 0 19 0 869394237 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/1967/statm: 2137282 90644 2249 9 0 2128023 0
[pid=1967/tid=1968] ppid=1965 vsize=8549128 CPUtime=2.66 cores=1,3,5,7
/proc/1967/task/1968/stat : 1968 (java) R 1965 1967 1967 0 -1 4202560 62161 0 1 0 259 7 0 0 21 0 19 0 869394238 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 46912506061743 0 4 0 16800975 0 0 0 -1 5 0 0 4
[pid=1967/tid=1969] ppid=1965 vsize=8549128 CPUtime=0.02 cores=1,3,5,7
/proc/1967/task/1969/stat : 1969 (java) S 1965 1967 1967 0 -1 4202560 1878 0 0 0 2 0 0 0 15 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 1 0 0 0
[pid=1967/tid=1970] ppid=1965 vsize=8549128 CPUtime=0.05 cores=1,3,5,7
/proc/1967/task/1970/stat : 1970 (java) S 1965 1967 1967 0 -1 4202560 3894 0 0 0 5 0 0 0 16 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 5 0 0 0
[pid=1967/tid=1971] ppid=1965 vsize=8549128 CPUtime=0.05 cores=1,3,5,7
/proc/1967/task/1971/stat : 1971 (java) S 1965 1967 1967 0 -1 4202560 3533 0 0 0 5 0 0 0 16 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 7 0 0 0
[pid=1967/tid=1972] ppid=1965 vsize=8549128 CPUtime=0.03 cores=1,3,5,7
/proc/1967/task/1972/stat : 1972 (java) S 1965 1967 1967 0 -1 4202560 2265 0 0 0 3 0 0 0 15 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 1 0 0 0
[pid=1967/tid=1973] ppid=1965 vsize=8549128 CPUtime=0.06 cores=1,3,5,7
/proc/1967/task/1973/stat : 1973 (java) S 1965 1967 1967 0 -1 4202560 4632 0 0 0 6 0 0 0 16 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 1 0 0 0
[pid=1967/tid=1974] ppid=1965 vsize=8549128 CPUtime=0.02 cores=1,3,5,7
/proc/1967/task/1974/stat : 1974 (java) S 1965 1967 1967 0 -1 4202560 1415 0 0 0 2 0 0 0 15 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 5 0 0 0
[pid=1967/tid=1975] ppid=1965 vsize=8549128 CPUtime=0.01 cores=1,3,5,7
/proc/1967/task/1975/stat : 1975 (java) S 1965 1967 1967 0 -1 4202560 1662 0 0 0 1 0 0 0 16 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 3 0 0 0
[pid=1967/tid=1976] ppid=1965 vsize=8549128 CPUtime=0.01 cores=1,3,5,7
/proc/1967/task/1976/stat : 1976 (java) S 1965 1967 1967 0 -1 4202560 1318 0 0 0 1 0 0 0 15 0 19 0 869394239 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 7 0 0 0
[pid=1967/tid=1977] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1977/stat : 1977 (java) S 1965 1967 1967 0 -1 4202560 199 0 0 0 0 0 0 0 16 0 19 0 869394240 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820982272 0 0 0 16800975 18446604463120452608 0 0 -1 5 0 0 0
[pid=1967/tid=1978] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1978/stat : 1978 (java) S 1965 1967 1967 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869394240 8754307072 90644 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446604463120452608 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=1883/tid=1966] ppid=1881 vsize=353176 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1966/stat : 1966 (python) S 1881 1883 32706 0 -1 4202560 31 1577 0 0 0 0 33 6 20 0 6 0 869394237 361652224 11903 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
[pid=1883/tid=2011] ppid=1881 vsize=353176 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/2011/stat : 2011 (python) S 1881 1883 32706 0 -1 4202560 30 1577 0 0 0 0 33 6 20 0 6 0 869399055 361652224 11903 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 3 0 0 0
[pid=1883/tid=2027] ppid=1881 vsize=353176 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/2027/stat : 2027 (python) S 1881 1883 32706 0 -1 4202560 31 1577 0 0 0 0 33 6 20 0 6 0 869412767 361652224 11903 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 586.79
Current children cumulated vsize (KiB) 11808980



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+612.602 s]
/proc/loadavg: 2.09 2.10 1.83 7/740 2207
/proc/meminfo: memFree=11826196/32951124 swapFree=36471928/67111528
[pid=1883] ppid=1881 vsize=363432 CPUtime=2.82 cores=1,3,5,7
/proc/1883/stat : 1883 (python) S 1881 1883 32706 0 -1 4202496 25456 1577 1 0 217 26 33 6 20 0 7 0 869384287 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/1883/statm: 90858 11909 1882 364 0 25730 0
[pid=1890] ppid=1883 vsize=312152 CPUtime=1.21 cores=1,3,5,7
/proc/1890/stat : 1890 (python) S 1883 1883 32706 0 -1 4202560 1163 0 0 0 58 63 0 0 15 0 2 0 869384550 319643648 10414 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1890/statm: 78038 10414 406 364 0 12925 0
[pid=1892] ppid=1890 vsize=573800 CPUtime=327.12 cores=1,3,5,7
/proc/1892/stat : 1892 (scip-2.0.1.linu) T 1890 1892 1892 0 -1 4202496 181784 0 0 0 32249 463 0 0 25 0 1 0 869384550 587571200 139316 33554432000 4194304 13684479 140734739753120 18446744073709551615 4520304 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/1892/statm: 143450 139316 834 2317 0 141128 0
[pid=1890/tid=1954] ppid=1883 vsize=312152 CPUtime=0 cores=1,3,5,7
/proc/1890/task/1954/stat : 1954 (python) S 1883 1883 32706 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 869389578 319643648 10414 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604468893689984 0 0 -1 3 0 0 0
[pid=1955] ppid=1883 vsize=312164 CPUtime=0.17 cores=1,3,5,7
/proc/1955/stat : 1955 (python) S 1883 1883 32706 0 -1 4202560 1174 0 0 0 8 9 0 0 16 0 2 0 869389581 319655936 10404 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1955/statm: 78041 10404 396 364 0 12925 0
[pid=1957] ppid=1955 vsize=106216 CPUtime=46.52 cores=1,3,5,7
/proc/1957/stat : 1957 (wbo1.4a) T 1955 1957 1957 0 -1 4202496 28790 0 0 0 4636 16 0 0 25 0 1 0 869389581 108765184 25916 33554432000 134512640 135751879 4289635920 18446744073709551615 134611292 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/1957/statm: 26554 25916 146 303 0 26249 0
[pid=1955/tid=1964] ppid=1883 vsize=312164 CPUtime=0 cores=1,3,5,7
/proc/1955/task/1964/stat : 1964 (python) S 1883 1883 32706 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869394234 319655936 10404 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604466738228160 0 0 -1 7 0 0 0
[pid=1965] ppid=1883 vsize=322420 CPUtime=0.17 cores=1,3,5,7
/proc/1965/stat : 1965 (python) S 1883 1883 32706 0 -1 4202560 1183 0 0 0 8 9 0 0 16 0 2 0 869394236 330158080 10408 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/1965/statm: 80605 10408 396 364 0 15486 0
[pid=1967] ppid=1965 vsize=8549128 CPUtime=50.57 cores=1,3,5,7
/proc/1967/stat : 1967 (java) T 1965 1967 1967 0 -1 4202496 568811 0 1 0 4997 60 0 0 18 0 19 0 869394237 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/1967/statm: 2137282 563824 2251 9 0 2128023 0
[pid=1967/tid=1968] ppid=1965 vsize=8549128 CPUtime=47.8 cores=1,3,5,7
/proc/1967/task/1968/stat : 1968 (java) T 1965 1967 1967 0 -1 4202560 479142 0 1 0 4731 49 0 0 25 0 19 0 869394238 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 46912505955472 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 4
[pid=1967/tid=1969] ppid=1965 vsize=8549128 CPUtime=0.06 cores=1,3,5,7
/proc/1967/task/1969/stat : 1969 (java) T 1965 1967 1967 0 -1 4202560 5541 0 0 0 6 0 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=1967/tid=1970] ppid=1965 vsize=8549128 CPUtime=0.12 cores=1,3,5,7
/proc/1967/task/1970/stat : 1970 (java) T 1965 1967 1967 0 -1 4202560 9584 0 0 0 11 1 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=1967/tid=1971] ppid=1965 vsize=8549128 CPUtime=0.15 cores=1,3,5,7
/proc/1967/task/1971/stat : 1971 (java) T 1965 1967 1967 0 -1 4202560 12238 0 0 0 14 1 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=1967/tid=1972] ppid=1965 vsize=8549128 CPUtime=0.08 cores=1,3,5,7
/proc/1967/task/1972/stat : 1972 (java) T 1965 1967 1967 0 -1 4202560 7841 0 0 0 8 0 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1967/tid=1973] ppid=1965 vsize=8549128 CPUtime=0.18 cores=1,3,5,7
/proc/1967/task/1973/stat : 1973 (java) T 1965 1967 1967 0 -1 4202560 13838 0 0 0 16 2 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1974] ppid=1965 vsize=8549128 CPUtime=0.13 cores=1,3,5,7
/proc/1967/task/1974/stat : 1974 (java) T 1965 1967 1967 0 -1 4202560 12196 0 0 0 13 0 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=1967/tid=1975] ppid=1965 vsize=8549128 CPUtime=0.1 cores=1,3,5,7
/proc/1967/task/1975/stat : 1975 (java) T 1965 1967 1967 0 -1 4202560 8450 0 0 0 9 1 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1967/tid=1976] ppid=1965 vsize=8549128 CPUtime=0.07 cores=1,3,5,7
/proc/1967/task/1976/stat : 1976 (java) T 1965 1967 1967 0 -1 4202560 6288 0 0 0 7 0 0 0 15 0 19 0 869394239 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=1967/tid=1977] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1977/stat : 1977 (java) T 1965 1967 1967 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 869394240 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820982272 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=1967/tid=1978] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1978/stat : 1978 (java) T 1965 1967 1967 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869394240 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1979] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1979/stat : 1979 (java) T 1965 1967 1967 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869394240 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1980] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1980/stat : 1980 (java) T 1965 1967 1967 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869394242 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820989361 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1981] ppid=1965 vsize=8549128 CPUtime=0.94 cores=1,3,5,7
/proc/1967/task/1981/stat : 1981 (java) T 1965 1967 1967 0 -1 4202560 5285 0 0 0 94 0 0 0 15 0 19 0 869394242 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=1967/tid=1982] ppid=1965 vsize=8549128 CPUtime=0.81 cores=1,3,5,7
/proc/1967/task/1982/stat : 1982 (java) T 1965 1967 1967 0 -1 4202560 5742 0 0 0 81 0 0 0 15 0 19 0 869394242 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=1967/tid=1983] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1983/stat : 1983 (java) T 1965 1967 1967 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869394242 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820981657 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1984] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1984/stat : 1984 (java) T 1965 1967 1967 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869394242 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820982272 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1967/tid=1985] ppid=1965 vsize=8549128 CPUtime=0 cores=1,3,5,7
/proc/1967/task/1985/stat : 1985 (java) T 1965 1967 1967 0 -1 4202560 11 0 0 0 0 0 0 0 18 0 19 0 869394317 8754307072 563824 33554432000 1073741824 1073778376 140734285348576 18446744073709551615 230820982272 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=1965/tid=2009] ppid=1883 vsize=322420 CPUtime=0 cores=1,3,5,7
/proc/1965/task/2009/stat : 2009 (python) S 1883 1883 32706 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869399052 330158080 10408 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604463535745728 0 0 -1 7 0 0 0
[pid=2010] ppid=1883 vsize=332676 CPUtime=0.32 cores=1,3,5,7
/proc/2010/stat : 2010 (python) S 1883 1883 32706 0 -1 4202560 1179 0 0 0 15 17 0 0 17 0 2 0 869399054 340660224 10406 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2010/statm: 83169 10406 390 364 0 18047 0
[pid=2012] ppid=2010 vsize=46620 CPUtime=91.86 cores=1,3,5,7
/proc/2012/stat : 2012 (clasp-1.3.7-x86) T 2010 2012 2012 0 -1 4202496 12364 0 0 0 9185 1 0 0 25 0 1 0 869399055 47738880 11392 33554432000 134512640 136139019 4291479296 18446744073709551615 134599826 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/2012/statm: 11655 11392 187 398 0 11255 0
[pid=2010/tid=2019] ppid=1883 vsize=332676 CPUtime=0 cores=1,3,5,7
/proc/2010/task/2019/stat : 2019 (python) S 1883 1883 32706 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 869408242 340660224 10406 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604460378994560 0 0 -1 7 0 0 0
[pid=2026] ppid=1883 vsize=342932 CPUtime=0.35 cores=1,3,5,7
/proc/2026/stat : 2026 (python) S 1883 1883 32706 0 -1 4202560 1195 0 0 0 19 16 0 0 16 0 2 0 869412766 351162368 10410 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820992459 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2026/statm: 85733 10410 390 364 0 20608 0
[pid=2028] ppid=2026 vsize=559672 CPUtime=95.36 cores=1,3,5,7
/proc/2028/stat : 2028 (scip-2.0.1.linu) T 2026 2028 2028 0 -1 4202496 195815 0 0 0 9278 258 0 0 25 0 1 0 869412767 573104128 135404 33554432000 4194304 15243407 140733308908704 18446744073709551615 7280727 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/2028/statm: 139918 135404 966 2698 0 137213 0
[pid=2026/tid=2091] ppid=1883 vsize=342932 CPUtime=0 cores=1,3,5,7
/proc/2026/task/2091/stat : 2091 (python) S 1883 1883 32706 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869422304 351162368 10410 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554946 18446604470408176960 0 0 -1 7 0 0 0
[pid=2187] ppid=1883 vsize=353188 CPUtime=0 cores=1,3,5,7
/proc/2187/stat : 2187 (python) S 1883 1883 32706 0 -1 4202560 791 0 0 0 0 0 0 0 15 0 1 0 869445473 361664512 10342 33554432000 4194304 5683644 140737303930336 18446744073709551615 230809185862 0 0 16781312 33554946 4294934790 0 0 17 5 0 0 0
/proc/2187/statm: 88297 10342 319 364 0 23169 0
[pid=2189] ppid=2187 vsize=8550780 CPUtime=1.71 cores=1,3,5,7
/proc/2189/stat : 2189 (java) S 2187 2189 2189 0 -1 4202496 37090 0 1 0 166 5 0 0 20 0 19 0 869445473 8755998720 32958 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820968421 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/2189/statm: 2137695 32958 2231 9 0 2128436 0
[pid=2189/tid=2190] ppid=2187 vsize=8550780 CPUtime=0.75 cores=1,3,5,7
/proc/2189/task/2190/stat : 2190 (java) R 2187 2189 2189 0 -1 4202560 25356 0 1 0 72 3 0 0 19 0 19 0 869445474 8755998720 32995 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 46912505819216 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=2189/tid=2191] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2191/stat : 2191 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 869445474 8755998720 32995 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2192] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2192/stat : 2192 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 19 0 869445474 8755998720 32995 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2193] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2193/stat : 2193 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 19 0 869445474 8755998720 32995 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2194] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2194/stat : 2194 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445474 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2195] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2195/stat : 2195 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445474 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2196] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2196/stat : 2196 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445474 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2197] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2197/stat : 2197 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445474 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2198] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2198/stat : 2198 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445474 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2199] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2199/stat : 2199 (java) S 2187 2189 2189 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 19 0 869445475 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820982272 0 0 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2200] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2200/stat : 2200 (java) S 2187 2189 2189 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 19 0 869445475 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2201] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2201/stat : 2201 (java) S 2187 2189 2189 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869445476 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2202] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2202/stat : 2202 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445478 8755998720 32996 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820989361 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2203] ppid=2187 vsize=8550780 CPUtime=0.48 cores=1,3,5,7
/proc/2189/task/2203/stat : 2203 (java) R 2187 2189 2189 0 -1 4202560 4930 0 0 0 48 0 0 0 17 0 19 0 869445478 8755998720 32997 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 46973471675781 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=2189/tid=2204] ppid=2187 vsize=8550780 CPUtime=0.45 cores=1,3,5,7
/proc/2189/task/2204/stat : 2204 (java) R 2187 2189 2189 0 -1 4202560 5439 0 0 0 45 0 0 0 25 0 19 0 869445478 8755998720 32997 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 46973475296962 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=2189/tid=2205] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2205/stat : 2205 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869445478 8755998720 32997 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820981657 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=2189/tid=2206] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2206/stat : 2206 (java) S 2187 2189 2189 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869445478 8755998720 32997 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820982272 0 4 0 16800975 18446604458966379584 0 0 -1 7 0 0 0
[pid=2189/tid=2207] ppid=2187 vsize=8550780 CPUtime=0 cores=1,3,5,7
/proc/2189/task/2207/stat : 2207 (java) S 2187 2189 2189 0 -1 4202560 12 0 0 0 0 0 0 0 19 0 19 0 869445547 8755998720 32997 33554432000 1073741824 1073778376 140734746648976 18446744073709551615 230820982272 0 4 0 16800975 18446604458966379584 0 0 -1 3 0 0 0
[pid=1883/tid=1891] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1891/stat : 1891 (python) S 1881 1883 32706 0 -1 4202560 38 1577 0 0 0 0 33 6 18 0 7 0 869384550 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 1 0 0 0
[pid=1883/tid=1956] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1956/stat : 1956 (python) S 1881 1883 32706 0 -1 4202560 28 1577 0 0 0 0 33 6 20 0 7 0 869389581 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
[pid=1883/tid=1966] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/1966/stat : 1966 (python) S 1881 1883 32706 0 -1 4202560 31 1577 0 0 0 0 33 6 20 0 7 0 869394237 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
[pid=1883/tid=2011] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/2011/stat : 2011 (python) S 1881 1883 32706 0 -1 4202560 30 1577 0 0 0 0 33 6 20 0 7 0 869399055 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 3 0 0 0
[pid=1883/tid=2027] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/2027/stat : 2027 (python) S 1881 1883 32706 0 -1 4202560 31 1577 0 0 0 0 33 6 20 0 7 0 869412767 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
[pid=1883/tid=2188] ppid=1881 vsize=363432 CPUtime=0.39 cores=1,3,5,7
/proc/1883/task/2188/stat : 2188 (python) S 1881 1883 32706 0 -1 4202560 28 1577 0 0 0 0 33 6 20 0 7 0 869445473 372154368 11909 33554432000 4194304 5683644 140737303930336 18446744073709551615 230820989361 0 0 16781312 33554434 18446604470408176064 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 618.18
Current children cumulated vsize (KiB) 20725180

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1883 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=511618
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=324950
# CPU time returned by wait4() is 2.83657
# while last known CPU time is 618.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 612.685
CPU time (s): 618.18
CPU user time (s): 608.69
CPU system time (s): 9.49
CPU usage (%): 100.897
Max. virtual memory (cumulated for all children) (KiB): 20725180

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.51162
system time used= 0.32495
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27037
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29162
involuntary context switches= 24

runsolver used 3.85141 second user time and 9.05362 second system time

The end

Launcher Data 

Begin job on node104 at 2011-06-09 02:03:58
IDJOB=3481453
IDBENCH=48120
IDSOLVER=1970
FILE ID=node104/3481453-1307577837
RUNJOBID= node104-1307576440-32729
PBS_JOBID= 13547701
Free space on /tmp= 73644 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_60_1.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481453-1307577837/watcher-3481453-1307577837 -o /tmp/evaluation-result-3481453-1307577837/solver-3481453-1307577837 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481453-1307577837.opb -seed 1889142764 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7931a71f4daac58a32a56f6c89bc3525
RANDOM SEED=1889142764

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22426400 kB
Buffers:        181736 kB
Cached:         825140 kB
SwapCached:      26012 kB
Active:        9986488 kB
Inactive:       199568 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22426400 kB
SwapTotal:    67111528 kB
SwapFree:     36471928 kB
Dirty:          105604 kB
Writeback:           0 kB
AnonPages:     9176496 kB
Mapped:          93388 kB
Slab:           157240 kB
PageTables:     111536 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 101550696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node104 at 2011-06-09 02:14:13