Trace number 3741836

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 617.29 614.981

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K99.opb
MD5SUM827b46126fccb5cb8162396480ca6949
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark341.971
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6732
Total number of constraints6932
Number of constraints which are clauses6833
Number of constraints which are cardinality constraints (but not clauses)99
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint99
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 100
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.35/0.74	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.35/0.74	c INFO: solving HOME/instance-3741836-1338721696.opb
0.45/0.81	c INFO: parsing took 0.07 s
0.55/0.96	c INFO: features took 0.14 CPU seconds
0.55/0.98	c INFO: running scip-2.0.1-clp@0 for 45 with 1799 remaining (b = 0.67)
50.08/50.43	c INFO: running clasp-1.3.7@0 for 45 with 1750 remaining (b = 0.36)
97.22/97.58	c INFO: running scip-2.0.1-spx@0 for 45 with 1703 remaining (b = 0.06)
143.35/143.68	c INFO: running clasp-1.3.7@47 for 45 with 1658 remaining (b = 0.01)
189.21/189.45	c INFO: wrote minion input file to HOME/tmpjdu8E8.minion
189.21/189.45	c INFO: running minion-0.12@0 for 45 with 1612 remaining (b = 0.09)
236.65/236.83	c INFO: running wbo1.4a@0 for 45 with 1564 remaining (b = 0.02)
286.10/286.21	c INFO: running scip-2.0.1-clp@48 for 45 with 1516 remaining (b = 0.01)
332.16/332.23	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1470 remaining (b = 0.03)
381.75/379.78	c INFO: running clasp-1.3.7@92 for 136 with 1421 remaining (b = 0.02)
519.38/517.18	c INFO: running scip-2.0.1-spx@45 for 45 with 1283 remaining (b = 0.01)
568.65/566.34	c INFO: running bsolo_pb10-l3@0 for 45 with 1234 remaining (b = 0.02)
616.19/613.88	c INFO: running bsolo_pb10-l1@0 for 91 with 1187 remaining (b = 0.02)
617.29/614.97	c INFO: running scip-2.0.1-spx@94 for 410 with 1187 remaining (b = 0.06)
617.29/614.97	Traceback (most recent call last):
617.29/614.97	  File "HOME/solve", line 33, in <module>
617.29/614.97	    plac.call(main)
617.29/614.97	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
617.29/614.97	    cmd, result = parser_from(obj).consume(arglist)
617.29/614.97	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741836-1338721696/watcher-3741836-1338721696 -o /tmp/evaluation-result-3741836-1338721696/solver-3741836-1338721696 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3741836-1338721696.opb -seed 1881093658 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.15 4.07 3.52 2/202 8308
/proc/meminfo: memFree=19234880/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=15276 CPUtime=0 cores=0,2,4,6
/proc/8308/stat : 8308 (python) D 8306 8308 3958 0 -1 4202496 671 0 0 0 0 0 0 0 20 0 1 0 338295679 15642624 559 33554432000 4194304 5683644 140733682588528 140733682560712 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 3819 559 324 364 0 261 0

[startup+0.0422651 s]
/proc/loadavg: 3.15 4.07 3.52 2/202 8308
/proc/meminfo: memFree=19234880/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=16104 CPUtime=0 cores=0,2,4,6
/proc/8308/stat : 8308 (python) D 8306 8308 3958 0 -1 4202496 1013 0 0 0 0 0 0 0 20 0 1 0 338295679 16490496 845 33554432000 4194304 5683644 140733682588528 140733682513288 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 4026 845 368 364 0 468 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16104

[startup+0.100263 s]
/proc/loadavg: 3.15 4.07 3.52 2/202 8308
/proc/meminfo: memFree=19234880/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=23416 CPUtime=0.02 cores=0,2,4,6
/proc/8308/stat : 8308 (python) R 8306 8308 3958 0 -1 4202496 1438 0 0 0 2 0 0 0 20 0 1 0 338295679 23977984 1185 33554432000 4194304 5683644 140733682588528 140733682519032 4620076 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 5846 1184 441 364 0 728 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 23416

[startup+0.300197 s]
/proc/loadavg: 3.15 4.07 3.52 2/202 8308
/proc/meminfo: memFree=19234880/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=107188 CPUtime=0.11 cores=0,2,4,6
/proc/8308/stat : 8308 (python) R 8306 8308 3958 0 -1 4202496 4655 1014 1 0 9 2 0 0 20 0 1 0 338295679 109760512 2893 33554432000 4194304 5683644 140733682588528 140733682462616 217401309747 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 26797 2896 905 364 0 1904 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 107188

[startup+0.700199 s]
/proc/loadavg: 3.15 4.07 3.52 2/202 8308
/proc/meminfo: memFree=19234880/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=262740 CPUtime=0.35 cores=0,2,4,6
/proc/8308/stat : 8308 (python) R 8306 8308 3958 0 -1 4202496 9278 1014 1 0 27 8 0 0 20 0 1 0 338295679 269045760 6551 33554432000 4194304 5683644 140733682588528 140733682496936 5119139 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 65685 6553 1711 364 0 5218 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 262740

[startup+1.5003 s]
/proc/loadavg: 3.15 4.07 3.52 3/205 8316
/proc/meminfo: memFree=19199244/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=360020 CPUtime=0.63 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 11422 1014 1 0 54 9 0 0 20 0 2 0 338295679 368660480 7866 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 90005 7866 1901 364 0 25228 0
[pid=8314] ppid=8308 vsize=284240 CPUtime=0 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 765 0 0 0 0 0 0 0 20 0 1 0 338295778 291061760 6300 33554432000 4194304 5683644 140733682588528 140733682579616 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/8314/statm: 71060 6300 341 364 0 6283 0
[pid=8316] ppid=8314 vsize=70364 CPUtime=0.5 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) R 8314 8316 8316 0 -1 4202496 15452 0 0 0 46 4 0 0 20 0 1 0 338295778 72052736 14851 33554432000 4194304 15243407 140733980338720 140733980334392 4880912 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 17591 14851 682 2698 0 14886 0
[pid=8308/tid=8315] ppid=8306 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 2 0 338295778 368660480 7866 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 714624

[startup+3.10026 s]
/proc/loadavg: 3.15 4.07 3.52 3/205 8316
/proc/meminfo: memFree=19131788/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=360020 CPUtime=0.63 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 11422 1014 1 0 54 9 0 0 20 0 2 0 338295679 368660480 7866 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 90005 7866 1901 364 0 25228 0
[pid=8314] ppid=8308 vsize=284240 CPUtime=0 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 766 0 0 0 0 0 0 0 20 0 1 0 338295778 291061760 6300 33554432000 4194304 5683644 140733682588528 140733682579616 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 71060 6300 341 364 0 6283 0
[pid=8316] ppid=8314 vsize=107132 CPUtime=2.1 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) R 8314 8316 8316 0 -1 4202496 24067 0 0 0 204 6 0 0 20 0 1 0 338295778 109703168 23466 33554432000 4194304 15243407 140733980338720 140733980335016 13277498 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 26783 23466 682 2698 0 24078 0
[pid=8308/tid=8315] ppid=8306 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 2 0 338295778 368660480 7866 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 751392

[startup+6.30031 s]
/proc/loadavg: 3.13 4.05 3.51 3/205 8316
/proc/meminfo: memFree=19070788/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=360020 CPUtime=0.63 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 11422 1014 1 0 54 9 0 0 20 0 2 0 338295679 368660480 7866 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 90005 7866 1901 364 0 25228 0
[pid=8314] ppid=8308 vsize=284240 CPUtime=0 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 893 0 0 0 0 0 0 0 20 0 1 0 338295778 291061760 6323 33554432000 4194304 5683644 140733682588528 140733682579616 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 71060 6323 364 364 0 6283 0
[pid=8316] ppid=8314 vsize=166256 CPUtime=5.3 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) R 8314 8316 8316 0 -1 4202496 38697 0 0 0 517 13 0 0 20 0 1 0 338295778 170246144 38096 33554432000 4194304 15243407 140733980338720 140733980335032 13277498 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 41564 38096 686 2698 0 38859 0
[pid=8308/tid=8315] ppid=8306 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 2 0 338295778 368660480 7866 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 810516

[startup+12.7003 s]
/proc/loadavg: 3.04 4.02 3.50 3/205 8316
/proc/meminfo: memFree=19014996/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=360020 CPUtime=0.63 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 11422 1014 1 0 54 9 0 0 20 0 2 0 338295679 368660480 7866 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 90005 7866 1901 364 0 25228 0
[pid=8314] ppid=8308 vsize=284240 CPUtime=0 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 898 0 0 0 0 0 0 0 20 0 1 0 338295778 291061760 6323 33554432000 4194304 5683644 140733682588528 140733682579616 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 71060 6323 364 364 0 6283 0
[pid=8316] ppid=8314 vsize=214240 CPUtime=11.7 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) R 8314 8316 8316 0 -1 4202496 50607 0 0 0 1149 21 0 0 20 0 1 0 338295778 219381760 50006 33554432000 4194304 15243407 140733980338720 140733980335016 13229099 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 53560 50006 686 2698 0 50855 0
[pid=8308/tid=8315] ppid=8306 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 2 0 338295778 368660480 7866 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 858500

[startup+25.5003 s]
/proc/loadavg: 2.81 3.92 3.48 3/205 8316
/proc/meminfo: memFree=18934148/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=360020 CPUtime=0.63 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 11422 1014 1 0 54 9 0 0 20 0 2 0 338295679 368660480 7866 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 90005 7866 1901 364 0 25228 0
[pid=8314] ppid=8308 vsize=284240 CPUtime=0.03 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 1008 0 0 0 2 1 0 0 20 0 1 0 338295778 291061760 6328 33554432000 4194304 5683644 140733682588528 140733682579616 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 71060 6328 369 364 0 6283 0
[pid=8316] ppid=8314 vsize=292124 CPUtime=24.5 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) R 8314 8316 8316 0 -1 4202496 69893 0 0 0 2409 41 0 0 20 0 1 0 338295778 299134976 69263 33554432000 4194304 15243407 140733980338720 140733980334808 13277498 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 73031 69263 873 2698 0 70326 0
[pid=8308/tid=8315] ppid=8306 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 2 0 338295778 368660480 7866 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.16
Current children cumulated vsize (KiB) 936384

[startup+51.1004 s]
/proc/loadavg: 2.53 3.76 3.44 3/210 8321
/proc/meminfo: memFree=18901076/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=435812 CPUtime=0.65 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 12346 1014 1 0 56 9 0 0 20 0 3 0 338295679 446271488 7875 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 108953 7875 1904 364 0 44173 0
[pid=8314] ppid=8308 vsize=360020 CPUtime=0.08 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 1155 0 0 0 4 4 0 0 20 0 2 0 338295778 368660480 6363 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 90005 6363 397 364 0 25228 0
[pid=8316] ppid=8314 vsize=320312 CPUtime=49.4 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) T 8314 8316 8316 0 -1 4202496 77615 0 0 0 4854 86 0 0 20 0 1 0 338295778 327999488 75294 33554432000 4194304 15243407 140733980338720 140733980333112 8097040 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 80078 75294 898 2698 0 77373 0
[pid=8314/tid=8318] ppid=8308 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8314/task/8318/stat : 8318 (python) S 8308 8308 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338300721 368660480 6363 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8319] ppid=8308 vsize=360032 CPUtime=0 cores=0,2,4,6
/proc/8319/stat : 8319 (python) S 8308 8308 3958 0 -1 4202560 754 0 0 0 0 0 0 0 20 0 1 0 338300723 368672768 6298 33554432000 4194304 5683644 140733682588528 140733682579616 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/8319/statm: 90008 6298 333 364 0 25228 0
[pid=8321] ppid=8319 vsize=4224 CPUtime=0.65 cores=0,2,4,6
/proc/8321/stat : 8321 (clasp-1.3.7-x86) R 8319 8321 8321 0 -1 4202496 1153 0 0 0 65 0 0 0 20 0 1 0 338300723 4325376 798 33554432000 134512640 136139019 4293988368 4293987344 134883787 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/8321/statm: 1056 798 182 398 0 656 0
[pid=8308/tid=8315] ppid=8306 vsize=435812 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 27 1014 0 0 0 0 0 0 20 0 3 0 338295778 446271488 7875 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8308/tid=8320] ppid=8306 vsize=435812 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8320/stat : 8320 (python) S 8306 8308 3958 0 -1 4202560 21 1014 0 0 0 0 0 0 20 0 3 0 338300723 446271488 7875 33554432000 4194304 5683644 140733682588528 140020088525360 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.78
Current children cumulated vsize (KiB) 1480400

[startup+102.301 s]
/proc/loadavg: 2.24 3.49 3.36 3/191 8393
/proc/meminfo: memFree=30726164/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=511604 CPUtime=0.68 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 13219 1014 1 0 59 9 0 0 20 0 4 0 338295679 523882496 7883 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8308/statm: 127901 7883 1906 364 0 63118 0
[pid=8314] ppid=8308 vsize=360020 CPUtime=0.08 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 1155 0 0 0 4 4 0 0 20 0 2 0 338295778 368660480 6363 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 90005 6363 397 364 0 25228 0
[pid=8316] ppid=8314 vsize=320312 CPUtime=49.4 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) T 8314 8316 8316 0 -1 4202496 77615 0 0 0 4854 86 0 0 20 0 1 0 338295778 327999488 75294 33554432000 4194304 15243407 140733980338720 140733980333112 8097040 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 80078 75294 898 2698 0 77373 0
[pid=8314/tid=8318] ppid=8308 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8314/task/8318/stat : 8318 (python) S 8308 8308 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338300721 368660480 6363 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8319] ppid=8308 vsize=360032 CPUtime=0.06 cores=0,2,4,6
/proc/8319/stat : 8319 (python) S 8308 8308 3958 0 -1 4202560 1093 0 0 0 4 2 0 0 20 0 2 0 338300723 368672768 6350 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8319/statm: 90008 6350 384 364 0 25228 0
[pid=8321] ppid=8319 vsize=15976 CPUtime=47.1 cores=0,2,4,6
/proc/8321/stat : 8321 (clasp-1.3.7-x86) T 8319 8321 8321 0 -1 4202496 4081 0 0 0 4710 0 0 0 20 0 1 0 338300723 16359424 3726 33554432000 134512640 136139019 4293988368 4293987248 134599014 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8321/statm: 3994 3726 182 398 0 3594 0
[pid=8319/tid=8390] ppid=8308 vsize=360032 CPUtime=0 cores=0,2,4,6
/proc/8319/task/8390/stat : 8390 (python) S 8308 8308 3958 0 -1 4202560 51 0 0 0 0 0 0 0 20 0 2 0 338305435 368672768 6350 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8391] ppid=8308 vsize=435824 CPUtime=0 cores=0,2,4,6
/proc/8391/stat : 8391 (python) S 8308 8308 3958 0 -1 4202560 928 0 0 0 0 0 0 0 20 0 1 0 338305438 446283776 6330 33554432000 4194304 5683644 140733682588528 140733682579616 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0

################
# More data... #
################

[pid=8423/tid=8445] ppid=8308 vsize=663768 CPUtime=0 cores=0,2,4,6
/proc/8423/task/8445/stat : 8445 (python) S 8308 8308 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338333655 679698432 6516 33554432000 4194304 5683644 140733682588528 140020057055792 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8469] ppid=8308 vsize=739560 CPUtime=0.02 cores=0,2,4,6
/proc/8469/stat : 8469 (python) S 8308 8308 3958 0 -1 4202560 997 0 0 0 1 1 0 0 20 0 1 0 338352314 757309440 6496 33554432000 4194304 5683644 140733682588528 140733682579616 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/8469/statm: 184890 6496 359 364 0 120095 0
[pid=8471] ppid=8469 vsize=52408 CPUtime=15.93 cores=0,2,4,6
/proc/8471/stat : 8471 (bsolo_pb10) R 8469 8471 8471 0 -1 4202496 11151 0 0 0 1585 8 0 0 20 0 1 0 338352314 53665792 10663 33554432000 134512640 137138936 4288788400 4288786824 134606964 0 0 16781312 16384 0 0 0 17 0 0 0 0 0 0
/proc/8471/statm: 13102 10663 192 642 0 12458 0
[pid=8308/tid=8315] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 32 1014 0 0 0 0 0 0 20 0 8 0 338295778 834908160 8565 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=8308/tid=8320] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8320/stat : 8320 (python) S 8306 8308 3958 0 -1 4202560 30 1014 0 0 0 0 0 0 20 0 8 0 338300723 834908160 8565 33554432000 4194304 5683644 140733682588528 140020088525360 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=8308/tid=8392] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8392/stat : 8392 (python) S 8306 8308 3958 0 -1 4202560 25 1014 0 0 0 0 0 0 20 0 8 0 338305438 834908160 8565 33554432000 4194304 5683644 140733682588528 140020078035504 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8308/tid=8407] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8407/stat : 8407 (python) S 8306 8308 3958 0 -1 4202560 22 1014 0 0 0 0 0 0 20 0 8 0 338314625 834908160 8565 33554432000 4194304 5683644 140733682588528 140020067545648 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8308/tid=8413] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8413/stat : 8413 (python) S 8306 8308 3958 0 -1 4202560 21 1014 0 0 0 0 0 0 20 0 8 0 338319363 834908160 8565 33554432000 4194304 5683644 140733682588528 140020057055792 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8308/tid=8424] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8424/stat : 8424 (python) S 8306 8308 3958 0 -1 4202560 22 1014 0 0 0 0 0 0 20 0 8 0 338328903 834908160 8565 33554432000 4194304 5683644 140733682588528 140020046565936 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8308/tid=8470] ppid=8306 vsize=815340 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8470/stat : 8470 (python) S 8306 8308 3958 0 -1 4202560 20 1014 0 0 0 0 0 0 20 0 8 0 338352314 834908160 8565 33554432000 4194304 5683644 140733682588528 140019691938352 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 584.65
Current children cumulated vsize (KiB) 15023828



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+614.901 s]
/proc/loadavg: 2.00 2.25 2.76 3/268 8475
/proc/meminfo: memFree=26841808/32873648 swapFree=7628/7628
[pid=8308] ppid=8306 vsize=891132 CPUtime=1.52 cores=0,2,4,6
/proc/8308/stat : 8308 (python) S 8306 8308 3958 0 -1 4202496 18237 1014 1 0 141 11 0 0 20 0 9 0 338295679 912519168 8573 33554432000 4194304 5683644 140733682588528 140733682583360 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/8308/statm: 222783 8573 1916 364 0 157985 0
[pid=8314] ppid=8308 vsize=360020 CPUtime=0.15 cores=0,2,4,6
/proc/8314/stat : 8314 (python) S 8308 8308 3958 0 -1 4202560 1188 0 0 0 9 6 0 0 20 0 2 0 338295778 368660480 6364 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8314/statm: 90005 6364 398 364 0 25228 0
[pid=8316] ppid=8314 vsize=321460 CPUtime=95.39 cores=0,2,4,6
/proc/8316/stat : 8316 (scip-2.0.1.linu) T 8314 8316 8316 0 -1 4202496 90413 0 0 0 9443 96 0 0 20 0 1 0 338295778 329175040 76817 33554432000 4194304 15243407 140733980338720 140733980333432 8112843 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8316/statm: 80365 76817 932 2698 0 77660 0
[pid=8314/tid=8318] ppid=8308 vsize=360020 CPUtime=0 cores=0,2,4,6
/proc/8314/task/8318/stat : 8318 (python) S 8308 8308 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338300721 368660480 6364 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8319] ppid=8308 vsize=360032 CPUtime=0.38 cores=0,2,4,6
/proc/8319/stat : 8319 (python) S 8308 8308 3958 0 -1 4202560 1179 0 0 0 23 15 0 0 20 0 2 0 338300723 368672768 6350 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8319/statm: 90008 6350 384 364 0 25228 0
[pid=8321] ppid=8319 vsize=33756 CPUtime=229.56 cores=0,2,4,6
/proc/8321/stat : 8321 (clasp-1.3.7-x86) T 8319 8321 8321 0 -1 4202496 8618 0 0 0 22955 1 0 0 20 0 1 0 338300723 34566144 8199 33554432000 134512640 136139019 4293988368 4293987348 134883821 0 0 16781312 16386 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/8321/statm: 8439 8199 182 398 0 8039 0
[pid=8319/tid=8390] ppid=8308 vsize=360032 CPUtime=0 cores=0,2,4,6
/proc/8319/task/8390/stat : 8390 (python) S 8308 8308 3958 0 -1 4202560 51 0 0 0 0 0 0 0 20 0 2 0 338305435 368672768 6350 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8391] ppid=8308 vsize=435824 CPUtime=0.15 cores=0,2,4,6
/proc/8391/stat : 8391 (python) S 8308 8308 3958 0 -1 4202560 1147 0 0 0 9 6 0 0 20 0 2 0 338305438 446283776 6356 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8391/statm: 108956 6356 384 364 0 44173 0
[pid=8393] ppid=8391 vsize=302372 CPUtime=95.16 cores=0,2,4,6
/proc/8393/stat : 8393 (scip-2.0.1.linu) T 8391 8393 8393 0 -1 4202496 77010 0 0 0 9475 41 0 0 20 0 1 0 338305438 309628928 72580 33554432000 4194304 13684479 140734936422816 140734936414728 7360265 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8393/statm: 75593 72580 758 2317 0 73271 0
[pid=8391/tid=8401] ppid=8308 vsize=435824 CPUtime=0 cores=0,2,4,6
/proc/8391/task/8401/stat : 8401 (python) S 8308 8308 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338310045 446283776 6356 33554432000 4194304 5683644 140733682588528 140020088525360 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8406] ppid=8308 vsize=511616 CPUtime=0.07 cores=0,2,4,6
/proc/8406/stat : 8406 (python) S 8308 8308 3958 0 -1 4202560 1138 0 0 0 4 3 0 0 20 0 2 0 338314625 523894784 6362 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8406/statm: 127904 6362 384 364 0 63118 0
[pid=8408] ppid=8406 vsize=89968 CPUtime=47.33 cores=0,2,4,6
/proc/8408/stat : 8408 (minion) T 8406 8408 8408 0 -1 4202496 8894 0 0 0 4732 1 0 0 20 0 1 0 338314625 92127232 15199 33554432000 134512640 165565024 4288342592 4288339824 159737071 0 0 16781312 8396802 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8408/statm: 22492 15199 336 7582 0 14907 0
[pid=8406/tid=8411] ppid=8308 vsize=511616 CPUtime=0 cores=0,2,4,6
/proc/8406/task/8411/stat : 8411 (python) S 8308 8308 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338319360 523894784 6362 33554432000 4194304 5683644 140733682588528 140020078035504 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8412] ppid=8308 vsize=587408 CPUtime=0.07 cores=0,2,4,6
/proc/8412/stat : 8412 (python) S 8308 8308 3958 0 -1 4202560 1143 0 0 0 4 3 0 0 20 0 2 0 338319363 601505792 6384 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8412/statm: 146852 6384 384 364 0 82063 0
[pid=8414] ppid=8412 vsize=125324 CPUtime=49.33 cores=0,2,4,6
/proc/8414/stat : 8414 (wbo1.4a) T 8412 8414 8414 0 -1 4202496 31242 0 0 0 4857 76 0 0 20 0 1 0 338319363 128331776 30876 33554432000 134512640 135751879 4290184608 4290182224 134604779 0 0 16781312 3 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8414/statm: 31331 30876 143 303 0 31026 0
[pid=8412/tid=8418] ppid=8308 vsize=587408 CPUtime=0 cores=0,2,4,6
/proc/8412/task/8418/stat : 8418 (python) S 8308 8308 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338324298 601505792 6384 33554432000 4194304 5683644 140733682588528 140020067545648 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8423] ppid=8308 vsize=663768 CPUtime=0.08 cores=0,2,4,6
/proc/8423/stat : 8423 (python) S 8308 8308 3958 0 -1 4202560 1148 0 0 0 4 4 0 0 20 0 2 0 338328903 679698432 6516 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8423/statm: 165942 6516 384 364 0 101150 0
[pid=8425] ppid=8423 vsize=9624972 CPUtime=49.53 cores=0,2,4,6
/proc/8425/stat : 8425 (java) T 8423 8425 8425 0 -1 4202496 13820 0 1 0 4925 28 0 0 20 0 19 0 338328903 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140733303178736 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8425/statm: 2406243 255404 2267 9 0 2396937 0
[pid=8425/tid=8426] ppid=8423 vsize=9624972 CPUtime=47.15 cores=0,2,4,6
/proc/8425/task/8426/stat : 8426 (java) T 8423 8425 8425 0 -1 4202560 3263 0 1 0 4699 16 0 0 20 0 19 0 338328905 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135916027104 140135740900857 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8427] ppid=8423 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/8425/task/8427/stat : 8427 (java) T 8423 8425 8425 0 -1 4202560 26 0 0 0 10 0 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135877520296 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8428] ppid=8423 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/8425/task/8428/stat : 8428 (java) T 8423 8425 8425 0 -1 4202560 31 0 0 0 9 2 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135876467752 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8429] ppid=8423 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/8425/task/8429/stat : 8429 (java) T 8423 8425 8425 0 -1 4202560 46 0 0 0 10 2 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135875414696 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8430] ppid=8423 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/8425/task/8430/stat : 8430 (java) T 8423 8425 8425 0 -1 4202560 34 0 0 0 11 2 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135874362152 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8431] ppid=8423 vsize=9624972 CPUtime=0.14 cores=0,2,4,6
/proc/8425/task/8431/stat : 8431 (java) T 8423 8425 8425 0 -1 4202560 89 0 0 0 12 2 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135873309096 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8432] ppid=8423 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/8425/task/8432/stat : 8432 (java) T 8423 8425 8425 0 -1 4202560 72 0 0 0 11 0 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135872256552 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8433] ppid=8423 vsize=9624972 CPUtime=0.08 cores=0,2,4,6
/proc/8425/task/8433/stat : 8433 (java) T 8423 8425 8425 0 -1 4202560 60 0 0 0 8 0 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135871203496 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8434] ppid=8423 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/8425/task/8434/stat : 8434 (java) T 8423 8425 8425 0 -1 4202560 102 0 0 0 11 2 0 0 20 0 19 0 338328906 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135870150952 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8435] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8435/stat : 8435 (java) T 8423 8425 8425 0 -1 4202560 438 0 0 0 0 0 0 0 20 0 19 0 338328907 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135739943784 217413892009 0 0 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8436] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8436/stat : 8436 (java) T 8423 8425 8425 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338328907 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135738890104 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8437] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8437/stat : 8437 (java) T 8423 8425 8425 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338328907 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135737836936 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8438] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8438/stat : 8438 (java) T 8423 8425 8425 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338328909 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135736785680 217413900064 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8439] ppid=8423 vsize=9624972 CPUtime=0.58 cores=0,2,4,6
/proc/8425/task/8439/stat : 8439 (java) T 8423 8425 8425 0 -1 4202560 3219 0 0 0 58 0 0 0 20 0 19 0 338328909 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135735732536 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8440] ppid=8423 vsize=9624972 CPUtime=0.72 cores=0,2,4,6
/proc/8425/task/8440/stat : 8440 (java) T 8423 8425 8425 0 -1 4202560 5019 0 0 0 72 0 0 0 20 0 19 0 338328910 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135734679992 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=8425/tid=8441] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8441/stat : 8441 (java) T 8423 8425 8425 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338328910 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135733627128 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=8425/tid=8442] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8442/stat : 8442 (java) T 8423 8425 8425 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338328910 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135732574792 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8425/tid=8443] ppid=8423 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/8425/task/8443/stat : 8443 (java) T 8423 8425 8425 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 338328943 9855971328 255404 33554432000 1073741824 1073778376 140733303187600 140135731521064 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=8423/tid=8445] ppid=8308 vsize=663768 CPUtime=0 cores=0,2,4,6
/proc/8423/task/8445/stat : 8445 (python) S 8308 8308 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338333655 679698432 6516 33554432000 4194304 5683644 140733682588528 140020057055792 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8469] ppid=8308 vsize=739560 CPUtime=0.08 cores=0,2,4,6
/proc/8469/stat : 8469 (python) S 8308 8308 3958 0 -1 4202560 1166 0 0 0 5 3 0 0 20 0 2 0 338352314 757309440 6522 33554432000 4194304 5683644 140733682588528 140733682580176 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8469/statm: 184890 6522 384 364 0 120095 0
[pid=8471] ppid=8469 vsize=107916 CPUtime=47.48 cores=0,2,4,6
/proc/8471/stat : 8471 (bsolo_pb10) T 8469 8471 8471 0 -1 4202496 25042 0 0 0 4736 12 0 0 20 0 1 0 338352314 110505984 24554 33554432000 134512640 137138936 4288788400 4288786944 134607563 0 0 16781312 16384 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/8471/statm: 26979 24554 192 642 0 26335 0
[pid=8469/tid=8472] ppid=8308 vsize=739560 CPUtime=0 cores=0,2,4,6
/proc/8469/task/8472/stat : 8472 (python) S 8308 8308 3958 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 338357066 757309440 6522 33554432000 4194304 5683644 140733682588528 140020046565936 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8473] ppid=8308 vsize=815352 CPUtime=0 cores=0,2,4,6
/proc/8473/stat : 8473 (python) S 8308 8308 3958 0 -1 4202560 862 0 0 0 0 0 0 0 20 0 1 0 338357068 834920448 6987 33554432000 4194304 5683644 140733682588528 140733682579616 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/8473/statm: 203838 6987 336 364 0 139040 0
[pid=8475] ppid=8473 vsize=13268 CPUtime=1.01 cores=0,2,4,6
/proc/8475/stat : 8475 (bsolo_pb10) R 8473 8475 8475 0 -1 4202496 1223 0 0 0 101 0 0 0 20 0 1 0 338357068 13586432 850 33554432000 134512640 137138936 4288783056 4288700972 136570369 0 0 16781312 16384 0 0 0 17 4 0 0 0 0 0
/proc/8475/statm: 3317 850 184 642 0 2673 0
[pid=8308/tid=8315] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8315/stat : 8315 (python) S 8306 8308 3958 0 -1 4202560 32 1014 0 0 0 0 0 0 20 0 9 0 338295778 912519168 8573 33554432000 4194304 5683644 140733682588528 140020099015216 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=8308/tid=8320] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8320/stat : 8320 (python) S 8306 8308 3958 0 -1 4202560 30 1014 0 0 0 0 0 0 20 0 9 0 338300723 912519168 8573 33554432000 4194304 5683644 140733682588528 140020088525360 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=8308/tid=8392] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8392/stat : 8392 (python) S 8306 8308 3958 0 -1 4202560 25 1014 0 0 0 0 0 0 20 0 9 0 338305438 912519168 8573 33554432000 4194304 5683644 140733682588528 140020078035504 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8308/tid=8407] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8407/stat : 8407 (python) S 8306 8308 3958 0 -1 4202560 22 1014 0 0 0 0 0 0 20 0 9 0 338314625 912519168 8573 33554432000 4194304 5683644 140733682588528 140020067545648 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8308/tid=8413] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8413/stat : 8413 (python) S 8306 8308 3958 0 -1 4202560 21 1014 0 0 0 0 0 0 20 0 9 0 338319363 912519168 8573 33554432000 4194304 5683644 140733682588528 140020057055792 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=8308/tid=8424] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8424/stat : 8424 (python) S 8306 8308 3958 0 -1 4202560 22 1014 0 0 0 0 0 0 20 0 9 0 338328903 912519168 8573 33554432000 4194304 5683644 140733682588528 140020046565936 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8308/tid=8470] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8470/stat : 8470 (python) S 8306 8308 3958 0 -1 4202560 20 1014 0 0 0 0 0 0 20 0 9 0 338352314 912519168 8573 33554432000 4194304 5683644 140733682588528 140019691938352 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=8308/tid=8474] ppid=8306 vsize=891132 CPUtime=0 cores=0,2,4,6
/proc/8308/task/8474/stat : 8474 (python) S 8306 8308 3958 0 -1 4202560 21 1014 0 0 0 0 0 0 20 0 9 0 338357068 912519168 8573 33554432000 4194304 5683644 140733682588528 140019681448496 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 617.29
Current children cumulated vsize (KiB) 15983748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8308 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=533766
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=188971
# CPU time returned by wait4() is 1.72274
# while last known CPU time is 617.29
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 614.981
CPU time (s): 617.29
CPU user time (s): 614.23
CPU system time (s): 3.06
CPU usage (%): 100.375
Max. virtual memory (cumulated for all children) (KiB): 15983748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.53377
system time used= 0.188971
maximum resident set size= 34308
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21100
page faults= 1
swaps= 0
block input operations= 32
block output operations= 1616
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1518
involuntary context switches= 15

runsolver used 2.48962 second user time and 6.556 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-03 13:08:16
IDJOB=3741836
IDBENCH=90111
IDSOLVER=2327
FILE ID=node122/3741836-1338721696
RUNJOBID= node122-1338713392-3974
PBS_JOBID= 14636732
Free space on /tmp= 63136 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K99.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741836-1338721696/watcher-3741836-1338721696 -o /tmp/evaluation-result-3741836-1338721696/solver-3741836-1338721696 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3741836-1338721696.opb -seed 1881093658 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 827b46126fccb5cb8162396480ca6949
RANDOM SEED=1881093658

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        19235020 kB
Buffers:          196936 kB
Cached:          7934888 kB
SwapCached:         1804 kB
Active:          4150324 kB
Inactive:        8161856 kB
Active(anon):    3501996 kB
Inactive(anon):   680848 kB
Active(file):     648328 kB
Inactive(file):  7481008 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67100164 kB
Dirty:            102240 kB
Writeback:             0 kB
AnonPages:       4186536 kB
Mapped:            23080 kB
Shmem:               108 kB
Slab:            1172480 kB
SReclaimable:     614948 kB
SUnreclaim:       557532 kB
KernelStack:        1640 kB
PageTables:        19356 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    6323488 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    153600 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70984 MiB
End job on node122 at 2012-06-03 13:18:34