Trace number 3742057

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 614.33 612.163

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K89.opb
MD5SUM30c9df0e6d94fba856558f98ad1383d9
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6052
Total number of constraints6232
Number of constraints which are clauses6143
Number of constraints which are cardinality constraints (but not clauses)89
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint89
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 90
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.37/1.17	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.37/1.18	c INFO: solving HOME/instance-3742057-1338723012.opb
0.44/1.24	c INFO: parsing took 0.06 s
0.53/1.38	c INFO: features took 0.14 CPU seconds
0.63/1.41	c INFO: running scip-2.0.1-clp@0 for 45 with 1799 remaining (b = 0.68)
50.16/50.91	c INFO: running clasp-1.3.7@0 for 45 with 1750 remaining (b = 0.36)
97.30/98.07	c INFO: running scip-2.0.1-spx@0 for 45 with 1703 remaining (b = 0.06)
146.73/147.49	c INFO: running clasp-1.3.7@47 for 45 with 1654 remaining (b = 0.01)
192.50/193.19	c INFO: wrote minion input file to HOME/tmpgiGaYz.minion
192.50/193.19	c INFO: running minion-0.12@0 for 45 with 1609 remaining (b = 0.09)
239.92/240.56	c INFO: running wbo1.4a@0 for 45 with 1561 remaining (b = 0.02)
290.98/291.53	c INFO: running scip-2.0.1-clp@48 for 45 with 1511 remaining (b = 0.01)
333.87/334.38	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1468 remaining (b = 0.04)
383.78/381.91	c INFO: running clasp-1.3.7@92 for 136 with 1418 remaining (b = 0.02)
521.41/519.33	c INFO: running scip-2.0.1-spx@48 for 45 with 1281 remaining (b = 0.01)
566.59/564.48	c INFO: running bsolo_pb10-l3@0 for 45 with 1236 remaining (b = 0.02)
614.02/611.80	c INFO: running bsolo_pb10-l1@0 for 91 with 1189 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742057-1338723012/watcher-3742057-1338723012 -o /tmp/evaluation-result-3742057-1338723012/solver-3742057-1338723012 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742057-1338723012.opb -seed 950974203 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.05 2.36 3/184 8767
/proc/meminfo: memFree=31084024/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=15276 CPUtime=0 cores=1,3,5,7
/proc/8767/stat : 8767 (python) D 8765 8767 3958 0 -1 4202496 634 0 0 0 0 0 0 0 20 0 1 0 338427266 15642624 527 33554432000 4194304 5683644 140737090233904 140737090219816 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/8767/statm: 3819 527 312 364 0 261 0

[startup+0.105983 s]
/proc/loadavg: 2.04 2.05 2.36 3/184 8767
/proc/meminfo: memFree=31084024/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=23388 CPUtime=0.03 cores=1,3,5,7
/proc/8767/stat : 8767 (python) D 8765 8767 3958 0 -1 4202496 1440 0 0 0 2 1 0 0 20 0 1 0 338427266 23949312 1185 33554432000 4194304 5683644 140737090233904 140737090164408 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/8767/statm: 5847 1185 441 364 0 729 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23388

[startup+0.200288 s]
/proc/loadavg: 2.04 2.05 2.36 3/184 8767
/proc/meminfo: memFree=31084024/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=83952 CPUtime=0.07 cores=1,3,5,7
/proc/8767/stat : 8767 (python) D 8765 8767 3958 0 -1 4202496 2924 0 0 0 4 3 0 0 20 0 1 0 338427266 85966848 2442 33554432000 4194304 5683644 140737090233904 140737090169832 217410518709 0 0 16781312 2 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/8767/statm: 20988 2442 744 364 0 1616 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 83952

[startup+0.300267 s]
/proc/loadavg: 2.04 2.05 2.36 3/184 8767
/proc/meminfo: memFree=31084024/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=102080 CPUtime=0.11 cores=1,3,5,7
/proc/8767/stat : 8767 (python) D 8765 8767 3958 0 -1 4202496 4203 1013 1 0 8 3 0 0 20 0 1 0 338427266 104529920 2754 33554432000 4194304 5683644 140737090233904 140737090107992 217401355559 0 0 16781312 2 18446744072100588836 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 25520 2754 890 364 0 1730 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 102080

[startup+0.700193 s]
/proc/loadavg: 2.04 2.05 2.36 3/184 8767
/proc/meminfo: memFree=31084024/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=166948 CPUtime=0.22 cores=1,3,5,7
/proc/8767/stat : 8767 (python) R 8765 8767 3958 0 -1 4202496 6561 1013 1 0 15 7 0 0 20 0 1 0 338427266 170954752 4351 33554432000 4194304 5683644 140737090233904 140737090138136 139893897051716 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 41737 4351 1227 364 0 3290 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 166948

[startup+1.50013 s]
/proc/loadavg: 2.04 2.05 2.36 2/185 8772
/proc/meminfo: memFree=31064672/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=359724 CPUtime=0.64 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 11285 1013 1 0 54 10 0 0 20 0 2 0 338427266 368357376 7791 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 89931 7791 1900 364 0 25154 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 359724

[startup+3.10028 s]
/proc/loadavg: 2.04 2.05 2.36 3/188 8775
/proc/meminfo: memFree=30982312/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=359724 CPUtime=0.64 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 11285 1013 1 0 54 10 0 0 20 0 2 0 338427266 368357376 7791 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 89931 7791 1900 364 0 25154 0
[pid=8773] ppid=8767 vsize=283944 CPUtime=0 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 770 0 0 0 0 0 0 0 20 0 1 0 338427407 290758656 6226 33554432000 4194304 5683644 140737090233904 140737090224992 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8773/statm: 70986 6226 341 364 0 6209 0
[pid=8775] ppid=8773 vsize=109000 CPUtime=1.66 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) R 8773 8775 8775 0 -1 4202496 23615 0 0 0 161 5 0 0 20 0 1 0 338427407 111616000 23013 33554432000 4194304 15243407 140735659645264 140735659641576 13277498 0 0 16781312 2 0 0 0 17 3 0 0 0 0 0
/proc/8775/statm: 27250 23013 682 2698 0 24545 0
[pid=8767/tid=8774] ppid=8765 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338427407 368357376 7791 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.3
Current children cumulated vsize (KiB) 752668
heavy processes:

[startup+6.30038 s]
/proc/loadavg: 2.04 2.05 2.35 3/188 8775
/proc/meminfo: memFree=30917404/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=359724 CPUtime=0.64 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 11285 1013 1 0 54 10 0 0 20 0 2 0 338427266 368357376 7791 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 89931 7791 1900 364 0 25154 0
[pid=8773] ppid=8767 vsize=283944 CPUtime=0 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 898 0 0 0 0 0 0 0 20 0 1 0 338427407 290758656 6249 33554432000 4194304 5683644 140737090233904 140737090224992 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8773/statm: 70986 6249 364 364 0 6209 0
[pid=8775] ppid=8773 vsize=160860 CPUtime=4.86 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) R 8773 8775 8775 0 -1 4202496 36754 0 0 0 474 12 0 0 20 0 1 0 338427407 164720640 36152 33554432000 4194304 15243407 140735659645264 140735659641576 4880950 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8775/statm: 40215 36152 686 2698 0 37510 0
[pid=8767/tid=8774] ppid=8765 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338427407 368357376 7791 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 5.5
Current children cumulated vsize (KiB) 804528

[startup+12.7068 s]
/proc/loadavg: 2.11 2.06 2.36 3/188 8775
/proc/meminfo: memFree=30859436/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=359724 CPUtime=0.64 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 11285 1013 1 0 54 10 0 0 20 0 2 0 338427266 368357376 7791 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 89931 7791 1900 364 0 25154 0
[pid=8773] ppid=8767 vsize=283944 CPUtime=0.01 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 909 0 0 0 0 1 0 0 20 0 1 0 338427407 290758656 6249 33554432000 4194304 5683644 140737090233904 140737090224992 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8773/statm: 70986 6249 364 364 0 6209 0
[pid=8775] ppid=8773 vsize=213600 CPUtime=11.26 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) R 8773 8775 8775 0 -1 4202496 50003 0 0 0 1105 21 0 0 20 0 1 0 338427407 218726400 49401 33554432000 4194304 15243407 140735659645264 140735659642184 4508566 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8775/statm: 53400 49401 686 2698 0 50695 0
[pid=8767/tid=8774] ppid=8765 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338427407 368357376 7791 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 11.91
Current children cumulated vsize (KiB) 857268

[startup+25.5003 s]
/proc/loadavg: 2.09 2.06 2.35 3/192 8779
/proc/meminfo: memFree=30627376/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=359724 CPUtime=0.64 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 11285 1013 1 0 54 10 0 0 20 0 2 0 338427266 368357376 7791 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 89931 7791 1900 364 0 25154 0
[pid=8773] ppid=8767 vsize=283944 CPUtime=0.03 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 1017 0 0 0 2 1 0 0 20 0 1 0 338427407 290758656 6254 33554432000 4194304 5683644 140737090233904 140737090224992 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8773/statm: 70986 6254 369 364 0 6209 0
[pid=8775] ppid=8773 vsize=259388 CPUtime=24.06 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) R 8773 8775 8775 0 -1 4202496 61189 0 0 0 2356 50 0 0 20 0 1 0 338427407 265613312 60556 33554432000 4194304 15243407 140735659645264 140735659641352 6392768 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8775/statm: 64847 60556 873 2698 0 62142 0
[pid=8767/tid=8774] ppid=8765 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338427407 368357376 7791 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 24.73
Current children cumulated vsize (KiB) 903056

[startup+51.1003 s]
/proc/loadavg: 2.06 2.05 2.34 3/195 8783
/proc/meminfo: memFree=30466268/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=436020 CPUtime=0.66 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 12255 1013 1 0 56 10 0 0 20 0 3 0 338427266 446484480 7926 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 109005 7926 1903 364 0 44225 0
[pid=8773] ppid=8767 vsize=359724 CPUtime=0.08 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 1172 0 0 0 5 3 0 0 20 0 2 0 338427407 368357376 6289 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8773/statm: 89931 6289 397 364 0 25154 0
[pid=8775] ppid=8773 vsize=284500 CPUtime=49.44 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) T 8773 8775 8775 0 -1 4202496 70983 0 0 0 4865 79 0 0 20 0 1 0 338427407 291328000 66505 33554432000 4194304 15243407 140735659645264 140735659639976 7429337 0 0 16781312 2 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/8775/statm: 71125 66505 898 2698 0 68420 0
[pid=8773/tid=8780] ppid=8767 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8773/task/8780/stat : 8780 (python) S 8767 8767 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338432355 368357376 6289 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8781] ppid=8767 vsize=360240 CPUtime=0 cores=1,3,5,7
/proc/8781/stat : 8781 (python) S 8767 8767 3958 0 -1 4202560 751 0 0 0 0 0 0 0 20 0 1 0 338432358 368885760 6350 33554432000 4194304 5683644 140737090233904 140737090224992 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8781/statm: 90060 6350 333 364 0 25280 0
[pid=8783] ppid=8781 vsize=3528 CPUtime=0.17 cores=1,3,5,7
/proc/8783/stat : 8783 (clasp-1.3.7-x86) R 8781 8783 8783 0 -1 4202496 986 0 0 0 17 0 0 0 20 0 1 0 338432358 3612672 640 33554432000 134512640 136139019 4288327968 4288326832 134608323 0 0 16781312 16386 0 0 0 17 1 0 0 0 0 0
/proc/8783/statm: 882 640 182 398 0 482 0
[pid=8767/tid=8774] ppid=8765 vsize=436020 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 3 0 338427407 446484480 7926 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8782] ppid=8765 vsize=436020 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8782/stat : 8782 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 3 0 338432358 446484480 7926 33554432000 4194304 5683644 140737090233904 139893712323120 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.35
Current children cumulated vsize (KiB) 1444012

[startup+102.301 s]
/proc/loadavg: 2.02 2.04 2.32 3/200 8788
/proc/meminfo: memFree=30308300/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=511812 CPUtime=0.69 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 13215 1013 1 0 58 11 0 0 20 0 4 0 338427266 524095488 7934 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 127953 7934 1905 364 0 63170 0
[pid=8773] ppid=8767 vsize=359724 CPUtime=0.08 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 1172 0 0 0 5 3 0 0 20 0 2 0 338427407 368357376 6289 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8773/statm: 89931 6289 397 364 0 25154 0
[pid=8775] ppid=8773 vsize=284500 CPUtime=49.44 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) T 8773 8775 8775 0 -1 4202496 70983 0 0 0 4865 79 0 0 20 0 1 0 338427407 291328000 66505 33554432000 4194304 15243407 140735659645264 140735659639976 7429337 0 0 16781312 2 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/8775/statm: 71125 66505 898 2698 0 68420 0
[pid=8773/tid=8780] ppid=8767 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8773/task/8780/stat : 8780 (python) S 8767 8767 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338432355 368357376 6289 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8781] ppid=8767 vsize=360240 CPUtime=0.07 cores=1,3,5,7
/proc/8781/stat : 8781 (python) S 8767 8767 3958 0 -1 4202560 1089 0 0 0 4 3 0 0 20 0 2 0 338432358 368885760 6402 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8781/statm: 90060 6402 384 364 0 25280 0
[pid=8783] ppid=8781 vsize=13968 CPUtime=47.1 cores=1,3,5,7
/proc/8783/stat : 8783 (clasp-1.3.7-x86) T 8781 8783 8783 0 -1 4202496 3587 0 0 0 4710 0 0 0 20 0 1 0 338432358 14303232 3241 33554432000 134512640 136139019 4288327968 4288326832 134608352 0 0 16781312 16386 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8783/statm: 3492 3241 182 398 0 3092 0
[pid=8781/tid=8785] ppid=8767 vsize=360240 CPUtime=0 cores=1,3,5,7
/proc/8781/task/8785/stat : 8785 (python) S 8767 8767 3958 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338437071 368885760 6402 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8786] ppid=8767 vsize=436032 CPUtime=0 cores=1,3,5,7
/proc/8786/stat : 8786 (python) S 8767 8767 3958 0 -1 4202560 927 0 0 0 0 0 0 0 20 0 1 0 338437073 446496768 6382 33554432000 4194304 5683644 140737090233904 140737090224992 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8786/statm: 109008 6382 359 364 0 44225 0
[pid=8788] ppid=8786 vsize=154792 CPUtime=4.21 cores=1,3,5,7
/proc/8788/stat : 8788 (scip-2.0.1.linu) R 8786 8788 8788 0 -1 4202496 35450 0 0 0 409 12 0 0 20 0 1 0 338437073 158507008 34836 33554432000 4194304 13684479 140733800760176 140733800756488 4880912 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8788/statm: 38698 34836 639 2317 0 36376 0
[pid=8767/tid=8774] ppid=8765 vsize=511812 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 4 0 338427407 524095488 7934 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8782] ppid=8765 vsize=511812 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/8908/stat : 8908 (bsolo_pb10) T 8906 8908 8908 0 -1 4202496 22915 0 0 0 4712 14 0 0 20 0 1 0 338483715 101998592 22456 33554432000 134512640 137138936 4293509040 4293507968 134542495 0 0 16781312 16384 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8908/statm: 24902 22456 192 642 0 24258 0
[pid=8906/tid=8916] ppid=8767 vsize=739200 CPUtime=0 cores=1,3,5,7
/proc/8906/task/8916/stat : 8916 (python) S 8767 8767 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338488444 756940800 6939 33554432000 4194304 5683644 140737090233904 139893325947440 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8917] ppid=8767 vsize=814992 CPUtime=0 cores=1,3,5,7
/proc/8917/stat : 8917 (python) S 8767 8767 3958 0 -1 4202560 863 0 0 0 0 0 0 0 20 0 1 0 338488447 834551808 6897 33554432000 4194304 5683644 140737090233904 140737090224992 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8917/statm: 203748 6897 336 364 0 138950 0
[pid=8919] ppid=8917 vsize=12976 CPUtime=0.29 cores=1,3,5,7
/proc/8919/stat : 8919 (bsolo_pb10) R 8917 8919 8919 0 -1 4202496 1148 0 0 0 29 0 0 0 20 0 1 0 338488447 13287424 783 33554432000 134512640 137138936 4287006544 4286932620 136570369 0 0 16781312 16384 0 0 0 17 1 0 0 0 0 0
/proc/8919/statm: 3244 783 184 642 0 2600 0
[pid=8767/tid=8774] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 32 1013 0 0 0 0 0 0 20 0 9 0 338427407 912150528 8482 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8767/tid=8782] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8782/stat : 8782 (python) S 8765 8767 3958 0 -1 4202560 30 1013 0 0 0 0 0 0 20 0 9 0 338432358 912150528 8482 33554432000 4194304 5683644 140737090233904 139893712323120 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8767/tid=8787] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8787/stat : 8787 (python) S 8765 8767 3958 0 -1 4202560 25 1013 0 0 0 0 0 0 20 0 9 0 338437073 912150528 8482 33554432000 4194304 5683644 140737090233904 139893701833264 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8799] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8799/stat : 8799 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338446586 912150528 8482 33554432000 4194304 5683644 140737090233904 139893691343408 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8804] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8804/stat : 8804 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338451322 912150528 8482 33554432000 4194304 5683644 140737090233904 139893680853552 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8830] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8830/stat : 8830 (python) S 8765 8767 3958 0 -1 4202560 20 1013 0 0 0 0 0 0 20 0 9 0 338460704 912150528 8482 33554432000 4194304 5683644 140737090233904 139893325947440 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8767/tid=8907] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8907/stat : 8907 (python) S 8765 8767 3958 0 -1 4202560 22 1013 0 0 0 0 0 0 20 0 9 0 338483715 912150528 8482 33554432000 4194304 5683644 140737090233904 139893315457584 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8918] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8918/stat : 8918 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338488447 912150528 8482 33554432000 4194304 5683644 140737090233904 139893304967728 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 614.33
Current children cumulated vsize (KiB) 15872840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+612.101 s]
/proc/loadavg: 1.95 2.00 2.17 3/234 8919
/proc/meminfo: memFree=29535304/32873648 swapFree=7628/7628
[pid=8767] ppid=8765 vsize=890772 CPUtime=1.46 cores=1,3,5,7
/proc/8767/stat : 8767 (python) S 8765 8767 3958 0 -1 4202496 18332 1013 1 0 133 13 0 0 20 0 9 0 338427266 912150528 8482 33554432000 4194304 5683644 140737090233904 140737090228736 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8767/statm: 222693 8482 1915 364 0 157895 0
[pid=8773] ppid=8767 vsize=359724 CPUtime=0.16 cores=1,3,5,7
/proc/8773/stat : 8773 (python) S 8767 8767 3958 0 -1 4202560 1208 0 0 0 9 7 0 0 20 0 2 0 338427407 368357376 6290 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8773/statm: 89931 6290 398 364 0 25154 0
[pid=8775] ppid=8773 vsize=285112 CPUtime=92.25 cores=1,3,5,7
/proc/8775/stat : 8775 (scip-2.0.1.linu) T 8773 8775 8775 0 -1 4202496 109240 0 0 0 9134 91 0 0 20 0 1 0 338427407 291954688 68634 33554432000 4194304 15243407 140735659645264 140735659639976 6958445 0 0 16781312 2 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8775/statm: 71278 68634 955 2698 0 68573 0
[pid=8773/tid=8780] ppid=8767 vsize=359724 CPUtime=0 cores=1,3,5,7
/proc/8773/task/8780/stat : 8780 (python) S 8767 8767 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338432355 368357376 6290 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8781] ppid=8767 vsize=360240 CPUtime=0.41 cores=1,3,5,7
/proc/8781/stat : 8781 (python) S 8767 8767 3958 0 -1 4202560 1177 0 0 0 24 17 0 0 20 0 2 0 338432358 368885760 6402 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8781/statm: 90060 6402 384 364 0 25280 0
[pid=8783] ppid=8781 vsize=28992 CPUtime=229.58 cores=1,3,5,7
/proc/8783/stat : 8783 (clasp-1.3.7-x86) T 8781 8783 8783 0 -1 4202496 7455 0 0 0 22957 1 0 0 20 0 1 0 338432358 29687808 6978 33554432000 134512640 136139019 4288327968 4288326832 134608192 0 0 16781312 16386 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8783/statm: 7248 6978 182 398 0 6848 0
[pid=8781/tid=8785] ppid=8767 vsize=360240 CPUtime=0 cores=1,3,5,7
/proc/8781/task/8785/stat : 8785 (python) S 8767 8767 3958 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338437071 368885760 6402 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8786] ppid=8767 vsize=436032 CPUtime=0.16 cores=1,3,5,7
/proc/8786/stat : 8786 (python) S 8767 8767 3958 0 -1 4202560 1157 0 0 0 8 8 0 0 20 0 2 0 338437073 446496768 6408 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8786/statm: 109008 6408 384 364 0 44225 0
[pid=8788] ppid=8786 vsize=257244 CPUtime=94.48 cores=1,3,5,7
/proc/8788/stat : 8788 (scip-2.0.1.linu) T 8786 8788 8788 0 -1 4202496 66997 0 0 0 9396 52 0 0 20 0 1 0 338437073 263417856 61013 33554432000 4194304 13684479 140733800760176 140733800756264 11876362 0 0 16781312 2 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8788/statm: 64311 61013 775 2317 0 61989 0
[pid=8786/tid=8793] ppid=8767 vsize=436032 CPUtime=0 cores=1,3,5,7
/proc/8786/task/8793/stat : 8793 (python) S 8767 8767 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338442013 446496768 6408 33554432000 4194304 5683644 140737090233904 139893712323120 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8798] ppid=8767 vsize=511824 CPUtime=0.08 cores=1,3,5,7
/proc/8798/stat : 8798 (python) S 8767 8767 3958 0 -1 4202560 1138 0 0 0 5 3 0 0 20 0 2 0 338446586 524107776 6414 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8798/statm: 127956 6414 384 364 0 63170 0
[pid=8800] ppid=8798 vsize=85288 CPUtime=47.31 cores=1,3,5,7
/proc/8800/stat : 8800 (minion) T 8798 8800 8800 0 -1 4202496 7732 0 0 0 4730 1 0 0 20 0 1 0 338446586 87334912 14010 33554432000 134512640 165565024 4288758144 4288755452 142765078 0 0 16781312 8396802 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8800/statm: 21322 14010 336 7582 0 13737 0
[pid=8798/tid=8802] ppid=8767 vsize=511824 CPUtime=0 cores=1,3,5,7
/proc/8798/task/8802/stat : 8802 (python) S 8767 8767 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338451320 524107776 6414 33554432000 4194304 5683644 140737090233904 139893701833264 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8803] ppid=8767 vsize=587616 CPUtime=0.08 cores=1,3,5,7
/proc/8803/stat : 8803 (python) S 8767 8767 3958 0 -1 4202560 1136 0 0 0 5 3 0 0 20 0 2 0 338451322 601718784 6420 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8803/statm: 146904 6420 384 364 0 82115 0
[pid=8805] ppid=8803 vsize=114840 CPUtime=50.91 cores=1,3,5,7
/proc/8805/stat : 8805 (wbo1.4a) T 8803 8805 8805 0 -1 4202496 28623 0 0 0 5043 48 0 0 20 0 1 0 338451323 117596160 28268 33554432000 134512640 135751879 4291346784 4291344960 134616492 0 0 16781312 3 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8805/statm: 28710 28268 143 303 0 28405 0
[pid=8803/tid=8827] ppid=8767 vsize=587616 CPUtime=0 cores=1,3,5,7
/proc/8803/task/8827/stat : 8827 (python) S 8767 8767 3958 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338456416 601718784 6420 33554432000 4194304 5683644 140737090233904 139893691343408 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8829] ppid=8767 vsize=663408 CPUtime=0.08 cores=1,3,5,7
/proc/8829/stat : 8829 (python) S 8767 8767 3958 0 -1 4202560 1151 0 0 0 4 4 0 0 20 0 2 0 338460704 679329792 6426 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8829/statm: 165852 6426 384 364 0 101060 0
[pid=8831] ppid=8829 vsize=9624972 CPUtime=49.75 cores=1,3,5,7
/proc/8831/stat : 8831 (java) T 8829 8831 8831 0 -1 4202496 13552 0 1 0 4949 26 0 0 20 0 19 0 338460704 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 140733534705456 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8831/statm: 2406243 179815 2266 9 0 2396937 0
[pid=8831/tid=8832] ppid=8829 vsize=9624972 CPUtime=47.05 cores=1,3,5,7
/proc/8831/task/8832/stat : 8832 (java) T 8829 8831 8831 0 -1 4202560 3087 0 1 0 4696 9 0 0 20 0 19 0 338460705 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888233356400 139888105664351 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8833] ppid=8829 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/8831/task/8833/stat : 8833 (java) T 8829 8831 8831 0 -1 4202560 40 0 0 0 12 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888077392040 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8834] ppid=8829 vsize=9624972 CPUtime=0.15 cores=1,3,5,7
/proc/8831/task/8834/stat : 8834 (java) T 8829 8831 8831 0 -1 4202560 108 0 0 0 13 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888076339496 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8831/tid=8835] ppid=8829 vsize=9624972 CPUtime=0.2 cores=1,3,5,7
/proc/8831/task/8835/stat : 8835 (java) T 8829 8831 8831 0 -1 4202560 119 0 0 0 17 3 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888075286952 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8836] ppid=8829 vsize=9624972 CPUtime=0.17 cores=1,3,5,7
/proc/8831/task/8836/stat : 8836 (java) T 8829 8831 8831 0 -1 4202560 111 0 0 0 15 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888074234408 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8831/tid=8837] ppid=8829 vsize=9624972 CPUtime=0.16 cores=1,3,5,7
/proc/8831/task/8837/stat : 8837 (java) T 8829 8831 8831 0 -1 4202560 64 0 0 0 14 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888073181864 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8838] ppid=8829 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/8831/task/8838/stat : 8838 (java) T 8829 8831 8831 0 -1 4202560 100 0 0 0 12 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888072129320 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8839] ppid=8829 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/8831/task/8839/stat : 8839 (java) T 8829 8831 8831 0 -1 4202560 43 0 0 0 12 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888071076776 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8840] ppid=8829 vsize=9624972 CPUtime=0.15 cores=1,3,5,7
/proc/8831/task/8840/stat : 8840 (java) T 8829 8831 8831 0 -1 4202560 48 0 0 0 13 2 0 0 20 0 19 0 338460706 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888070024232 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8841] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8841/stat : 8841 (java) T 8829 8831 8831 0 -1 4202560 335 0 0 0 0 0 0 0 20 0 19 0 338460707 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888057612392 217413892009 0 0 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8831/tid=8842] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8842/stat : 8842 (java) T 8829 8831 8831 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338460708 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888056558712 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8843] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8843/stat : 8843 (java) T 8829 8831 8831 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338460708 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888055506056 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8844] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8844/stat : 8844 (java) T 8829 8831 8831 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338460710 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888054454800 217413900064 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8845] ppid=8829 vsize=9624972 CPUtime=0.73 cores=1,3,5,7
/proc/8831/task/8845/stat : 8845 (java) T 8829 8831 8831 0 -1 4202560 3781 0 0 0 73 0 0 0 20 0 19 0 338460710 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888053402168 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8846] ppid=8829 vsize=9624972 CPUtime=0.57 cores=1,3,5,7
/proc/8831/task/8846/stat : 8846 (java) T 8829 8831 8831 0 -1 4202560 4297 0 0 0 57 0 0 0 20 0 19 0 338460710 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888052349624 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8847] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8847/stat : 8847 (java) T 8829 8831 8831 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338460710 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888051297272 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8831/tid=8848] ppid=8829 vsize=9624972 CPUtime=0.01 cores=1,3,5,7
/proc/8831/task/8848/stat : 8848 (java) T 8829 8831 8831 0 -1 4202560 3 0 0 0 0 1 0 0 20 0 19 0 338460710 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888050244936 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8831/tid=8849] ppid=8829 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8831/task/8849/stat : 8849 (java) T 8829 8831 8831 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 338460743 9855971328 179815 33554432000 1073741824 1073778376 140733534714320 139888049189672 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8829/tid=8850] ppid=8767 vsize=663408 CPUtime=0 cores=1,3,5,7
/proc/8829/task/8850/stat : 8850 (python) S 8767 8767 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338465455 679329792 6426 33554432000 4194304 5683644 140737090233904 139893680853552 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8906] ppid=8767 vsize=739200 CPUtime=0.07 cores=1,3,5,7
/proc/8906/stat : 8906 (python) S 8767 8767 3958 0 -1 4202560 1178 0 0 0 3 4 0 0 20 0 2 0 338483715 756940800 6939 33554432000 4194304 5683644 140737090233904 140737090225552 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8906/statm: 184800 6939 384 364 0 120005 0
[pid=8908] ppid=8906 vsize=99608 CPUtime=47.26 cores=1,3,5,7
/proc/8908/stat : 8908 (bsolo_pb10) T 8906 8908 8908 0 -1 4202496 22915 0 0 0 4712 14 0 0 20 0 1 0 338483715 101998592 22456 33554432000 134512640 137138936 4293509040 4293507968 134542495 0 0 16781312 16384 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8908/statm: 24902 22456 192 642 0 24258 0
[pid=8906/tid=8916] ppid=8767 vsize=739200 CPUtime=0 cores=1,3,5,7
/proc/8906/task/8916/stat : 8916 (python) S 8767 8767 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338488444 756940800 6939 33554432000 4194304 5683644 140737090233904 139893325947440 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8917] ppid=8767 vsize=814992 CPUtime=0 cores=1,3,5,7
/proc/8917/stat : 8917 (python) S 8767 8767 3958 0 -1 4202560 863 0 0 0 0 0 0 0 20 0 1 0 338488447 834551808 6897 33554432000 4194304 5683644 140737090233904 140737090224992 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8917/statm: 203748 6897 336 364 0 138950 0
[pid=8919] ppid=8917 vsize=12976 CPUtime=0.29 cores=1,3,5,7
/proc/8919/stat : 8919 (bsolo_pb10) R 8917 8919 8919 0 -1 4202496 1148 0 0 0 29 0 0 0 20 0 1 0 338488447 13287424 783 33554432000 134512640 137138936 4287006544 4286932620 136570369 0 0 16781312 16384 0 0 0 17 1 0 0 0 0 0
/proc/8919/statm: 3244 783 184 642 0 2600 0
[pid=8767/tid=8774] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8774/stat : 8774 (python) S 8765 8767 3958 0 -1 4202560 32 1013 0 0 0 0 0 0 20 0 9 0 338427407 912150528 8482 33554432000 4194304 5683644 140737090233904 139893722812976 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8767/tid=8782] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8782/stat : 8782 (python) S 8765 8767 3958 0 -1 4202560 30 1013 0 0 0 0 0 0 20 0 9 0 338432358 912150528 8482 33554432000 4194304 5683644 140737090233904 139893712323120 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8767/tid=8787] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8787/stat : 8787 (python) S 8765 8767 3958 0 -1 4202560 25 1013 0 0 0 0 0 0 20 0 9 0 338437073 912150528 8482 33554432000 4194304 5683644 140737090233904 139893701833264 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8799] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8799/stat : 8799 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338446586 912150528 8482 33554432000 4194304 5683644 140737090233904 139893691343408 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8804] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8804/stat : 8804 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338451322 912150528 8482 33554432000 4194304 5683644 140737090233904 139893680853552 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8830] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8830/stat : 8830 (python) S 8765 8767 3958 0 -1 4202560 20 1013 0 0 0 0 0 0 20 0 9 0 338460704 912150528 8482 33554432000 4194304 5683644 140737090233904 139893325947440 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8767/tid=8907] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8907/stat : 8907 (python) S 8765 8767 3958 0 -1 4202560 22 1013 0 0 0 0 0 0 20 0 9 0 338483715 912150528 8482 33554432000 4194304 5683644 140737090233904 139893315457584 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8767/tid=8918] ppid=8765 vsize=890772 CPUtime=0 cores=1,3,5,7
/proc/8767/task/8918/stat : 8918 (python) S 8765 8767 3958 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338488447 912150528 8482 33554432000 4194304 5683644 140737090233904 139893304967728 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 614.33
Current children cumulated vsize (KiB) 15872840

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8767 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=335796
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=132979
# CPU time returned by wait4() is 1.46878
# while last known CPU time is 614.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 612.163
CPU time (s): 614.33
CPU user time (s): 611.41
CPU system time (s): 2.92
CPU usage (%): 100.354
Max. virtual memory (cumulated for all children) (KiB): 15872840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.3358
system time used= 0.132979
maximum resident set size= 33928
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19345
page faults= 1
swaps= 0
block input operations= 0
block output operations= 1496
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2109
involuntary context switches= 18

runsolver used 2.6616 second user time and 6.13507 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-03 13:30:12
IDJOB=3742057
IDBENCH=90128
IDSOLVER=2327
FILE ID=node122/3742057-1338723012
RUNJOBID= node122-1338713392-3975
PBS_JOBID= 14636732
Free space on /tmp= 71088 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K89.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742057-1338723012/watcher-3742057-1338723012 -o /tmp/evaluation-result-3742057-1338723012/solver-3742057-1338723012 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742057-1338723012.opb -seed 950974203 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 30c9df0e6d94fba856558f98ad1383d9
RANDOM SEED=950974203

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31084288 kB
Buffers:          202932 kB
Cached:           373704 kB
SwapCached:         1804 kB
Active:           920140 kB
Inactive:          38116 kB
Active(anon):     376980 kB
Inactive(anon):     7052 kB
Active(file):     543160 kB
Inactive(file):    31064 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67100164 kB
Dirty:            101992 kB
Writeback:             0 kB
AnonPages:        387768 kB
Mapped:            19468 kB
Shmem:                36 kB
Slab:             688524 kB
SReclaimable:     131212 kB
SUnreclaim:       557312 kB
KernelStack:        1520 kB
PageTables:         6436 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     609244 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70984 MiB
End job on node122 at 2012-06-03 13:40:27