Trace number 3742135

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 617.17 614.864

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K95.opb
MD5SUMf5b402df79463ae0743ac9fe7c0d237d
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark389.31
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6460
Total number of constraints6652
Number of constraints which are clauses6557
Number of constraints which are cardinality constraints (but not clauses)95
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint95
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 96
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.49/1.30	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.49/1.30	c INFO: solving HOME/instance-3742135-1338723589.opb
0.49/1.37	c INFO: parsing took 0.07 s
0.70/1.50	c INFO: features took 0.13 CPU seconds
0.70/1.53	c INFO: running scip-2.0.1-clp@0 for 45 with 1799 remaining (b = 0.68)
49.22/50.04	c INFO: running clasp-1.3.7@0 for 45 with 1751 remaining (b = 0.36)
96.36/97.19	c INFO: running scip-2.0.1-spx@0 for 45 with 1704 remaining (b = 0.06)
146.14/146.81	c INFO: running clasp-1.3.7@47 for 45 with 1655 remaining (b = 0.01)
191.92/192.54	c INFO: wrote minion input file to HOME/tmp0UuOPB.minion
191.92/192.54	c INFO: running minion-0.12@0 for 45 with 1610 remaining (b = 0.09)
239.35/239.93	c INFO: running wbo1.4a@0 for 45 with 1562 remaining (b = 0.02)
289.20/289.77	c INFO: running scip-2.0.1-clp@47 for 45 with 1513 remaining (b = 0.01)
335.88/336.35	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1466 remaining (b = 0.03)
385.95/383.91	c INFO: running clasp-1.3.7@92 for 136 with 1417 remaining (b = 0.02)
523.55/521.31	c INFO: running scip-2.0.1-spx@49 for 45 with 1279 remaining (b = 0.01)
568.71/566.47	c INFO: running bsolo_pb10-l3@0 for 45 with 1234 remaining (b = 0.02)
616.29/613.91	c INFO: running bsolo_pb10-l1@0 for 91 with 1187 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742135-1338723589/watcher-3742135-1338723589 -o /tmp/evaluation-result-3742135-1338723589/solver-3742135-1338723589 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742135-1338723589.opb -seed 1783151643 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.06 2.28 3/218 7373
/proc/meminfo: memFree=29595968/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=15276 CPUtime=0 cores=0,2,4,6
/proc/7373/stat : 7373 (python) D 7371 7373 2614 0 -1 4202496 633 0 0 0 0 0 0 0 20 0 1 0 338483927 15642624 526 33554432000 4194304 5683644 140734688491600 140734688473272 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 3819 526 311 364 0 261 0

[startup+0.078441 s]
/proc/loadavg: 2.02 2.06 2.28 3/218 7373
/proc/meminfo: memFree=29595968/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=16736 CPUtime=0.02 cores=0,2,4,6
/proc/7373/stat : 7373 (python) D 7371 7373 2614 0 -1 4202496 1275 0 0 0 1 1 0 0 20 0 1 0 338483927 17137664 1058 33554432000 4194304 5683644 140734688491600 140734688477016 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 4184 1058 426 364 0 626 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16736

[startup+0.100313 s]
/proc/loadavg: 2.02 2.06 2.28 3/218 7373
/proc/meminfo: memFree=29595968/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=19088 CPUtime=0.03 cores=0,2,4,6
/proc/7373/stat : 7373 (python) R 7371 7373 2614 0 -1 4202496 1391 0 0 0 1 2 0 0 20 0 1 0 338483927 19546112 1145 33554432000 4194304 5683644 140734688491600 140734688422104 240564801428 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 4772 1146 430 364 0 696 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 19088

[startup+0.300246 s]
/proc/loadavg: 2.02 2.06 2.28 3/218 7373
/proc/meminfo: memFree=29595968/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=96896 CPUtime=0.12 cores=0,2,4,6
/proc/7373/stat : 7373 (python) D 7371 7373 2614 0 -1 4202496 3900 1013 1 0 8 4 0 0 20 0 1 0 338483927 99221504 2647 33554432000 4194304 5683644 140734688491600 140734688409624 240565173941 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 24224 2647 822 364 0 1715 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 96896

[startup+0.700226 s]
/proc/loadavg: 2.02 2.06 2.28 3/218 7373
/proc/meminfo: memFree=29595968/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=122348 CPUtime=0.24 cores=0,2,4,6
/proc/7373/stat : 7373 (python) D 7371 7373 2614 0 -1 4202496 5963 1013 1 0 15 9 0 0 20 0 1 0 338483927 125284352 3841 33554432000 4194304 5683644 140734688491600 140734688416488 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 30587 3841 1015 364 0 2830 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 122348

[startup+1.50025 s]
/proc/loadavg: 2.02 2.06 2.28 2/219 7378
/proc/meminfo: memFree=29581444/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=284052 CPUtime=0.7 cores=0,2,4,6
/proc/7373/stat : 7373 (python) R 7371 7373 2614 0 -1 4202496 11090 1013 1 0 53 17 0 0 20 0 1 0 338483927 290869248 7775 33554432000 4194304 5683644 140734688491600 140734688483496 139913203680451 0 0 16781312 33554434 0 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 71013 7775 1857 364 0 6242 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 284052

[startup+3.10034 s]
/proc/loadavg: 2.02 2.06 2.28 3/222 7381
/proc/meminfo: memFree=29512352/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=359856 CPUtime=0.72 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 11366 1013 1 0 55 17 0 0 20 0 2 0 338483927 368492544 7825 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 89964 7825 1901 364 0 25187 0
[pid=7379] ppid=7373 vsize=284076 CPUtime=0 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 773 0 0 0 0 0 0 0 20 0 1 0 338484081 290893824 6259 33554432000 4194304 5683644 140734688491600 140734688482688 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 71019 6259 341 364 0 6242 0
[pid=7381] ppid=7379 vsize=100168 CPUtime=1.55 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) R 7379 7381 7381 0 -1 4202496 22048 0 0 0 150 5 0 0 20 0 1 0 338484081 102572032 21447 33554432000 4194304 15243407 140733443542704 140733443539000 4557487 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 25042 21447 682 2698 0 22337 0
[pid=7373/tid=7380] ppid=7371 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338484081 368492544 7825 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 744100
heavy processes:

[startup+6.30034 s]
/proc/loadavg: 2.02 2.06 2.28 3/222 7381
/proc/meminfo: memFree=29441956/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=359856 CPUtime=0.72 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 11366 1013 1 0 55 17 0 0 20 0 2 0 338483927 368492544 7825 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 89964 7825 1901 364 0 25187 0
[pid=7379] ppid=7373 vsize=284076 CPUtime=0 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 895 0 0 0 0 0 0 0 20 0 1 0 338484081 290893824 6282 33554432000 4194304 5683644 140734688491600 140734688482688 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 71019 6282 364 364 0 6242 0
[pid=7381] ppid=7379 vsize=159420 CPUtime=4.76 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) R 7379 7381 7381 0 -1 4202496 36772 0 0 0 463 13 0 0 20 0 1 0 338484081 163246080 36171 33554432000 4194304 15243407 140733443542704 140733443539016 4880915 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 39855 36171 686 2698 0 37150 0
[pid=7373/tid=7380] ppid=7371 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338484081 368492544 7825 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 5.48
Current children cumulated vsize (KiB) 803352

[startup+12.7004 s]
/proc/loadavg: 2.01 2.06 2.28 3/223 7384
/proc/meminfo: memFree=29384676/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=359856 CPUtime=0.72 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 11366 1013 1 0 55 17 0 0 20 0 2 0 338483927 368492544 7825 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 89964 7825 1901 364 0 25187 0
[pid=7379] ppid=7373 vsize=284076 CPUtime=0.01 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 899 0 0 0 0 1 0 0 20 0 1 0 338484081 290893824 6282 33554432000 4194304 5683644 140734688491600 140734688482688 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 71019 6282 364 364 0 6242 0
[pid=7381] ppid=7379 vsize=209416 CPUtime=11.15 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) R 7379 7381 7381 0 -1 4202496 49255 0 0 0 1094 21 0 0 20 0 1 0 338484081 214441984 48654 33554432000 4194304 15243407 140733443542704 140733443539000 4875771 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/7381/statm: 52354 48654 686 2698 0 49649 0
[pid=7373/tid=7380] ppid=7371 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338484081 368492544 7825 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 853348

[startup+25.5004 s]
/proc/loadavg: 2.08 2.07 2.28 3/223 7384
/proc/meminfo: memFree=29312276/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=359856 CPUtime=0.72 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 11366 1013 1 0 55 17 0 0 20 0 2 0 338483927 368492544 7825 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 89964 7825 1901 364 0 25187 0
[pid=7379] ppid=7373 vsize=284076 CPUtime=0.03 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 1006 0 0 0 1 2 0 0 20 0 1 0 338484081 290893824 6287 33554432000 4194304 5683644 140734688491600 140734688482688 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 71019 6287 369 364 0 6242 0
[pid=7381] ppid=7379 vsize=279040 CPUtime=23.95 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) R 7379 7381 7381 0 -1 4202496 66236 0 0 0 2351 44 0 0 20 0 1 0 338484081 285736960 65608 33554432000 4194304 15243407 140733443542704 140733443538792 13277498 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 69760 65608 874 2698 0 67055 0
[pid=7373/tid=7380] ppid=7371 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 2 0 338484081 368492544 7825 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 24.7
Current children cumulated vsize (KiB) 922972

[startup+51.1004 s]
/proc/loadavg: 2.05 2.06 2.27 3/227 7388
/proc/meminfo: memFree=29280196/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=435648 CPUtime=0.74 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 12260 1013 1 0 57 17 0 0 20 0 3 0 338483927 446103552 7850 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7373/statm: 108912 7850 1904 364 0 44132 0
[pid=7379] ppid=7373 vsize=359856 CPUtime=0.07 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 1161 0 0 0 3 4 0 0 20 0 2 0 338484081 368492544 6322 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 89964 6322 397 364 0 25187 0
[pid=7381] ppid=7379 vsize=305208 CPUtime=48.46 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) T 7379 7381 7381 0 -1 4202496 72100 0 0 0 4763 83 0 0 20 0 1 0 338484081 312532992 71983 33554432000 4194304 15243407 140733443542704 140733443537416 7426970 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 76302 71983 899 2698 0 73597 0
[pid=7379/tid=7385] ppid=7373 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7379/task/7385/stat : 7385 (python) S 7373 7373 2614 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338488929 368492544 6322 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7386] ppid=7373 vsize=359868 CPUtime=0 cores=0,2,4,6
/proc/7386/stat : 7386 (python) S 7373 7373 2614 0 -1 4202560 761 0 0 0 0 0 0 0 20 0 1 0 338488932 368504832 6276 33554432000 4194304 5683644 140734688491600 140734688482688 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7386/statm: 89967 6276 336 364 0 25187 0
[pid=7388] ppid=7386 vsize=4620 CPUtime=1.05 cores=0,2,4,6
/proc/7388/stat : 7388 (clasp-1.3.7-x86) R 7386 7388 7388 0 -1 4202496 1236 0 0 0 105 0 0 0 20 0 1 0 338488932 4730880 884 33554432000 134512640 136139019 4291592288 4291591264 134883391 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/7388/statm: 1155 884 182 398 0 755 0
[pid=7373/tid=7380] ppid=7371 vsize=435648 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 3 0 338484081 446103552 7850 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7387] ppid=7371 vsize=435648 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7387/stat : 7387 (python) S 7371 7373 2614 0 -1 4202560 20 1013 0 0 0 0 0 0 20 0 3 0 338488932 446103552 7850 33554432000 4194304 5683644 140734688491600 139913186701872 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 50.32
Current children cumulated vsize (KiB) 1465200

[startup+102.307 s]
/proc/loadavg: 2.02 2.05 2.25 3/230 7392
/proc/meminfo: memFree=29112212/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=511440 CPUtime=0.77 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 13198 1013 1 0 60 17 0 0 20 0 4 0 338483927 523714560 7858 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7373/statm: 127860 7858 1906 364 0 63077 0
[pid=7379] ppid=7373 vsize=359856 CPUtime=0.07 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 1161 0 0 0 3 4 0 0 20 0 2 0 338484081 368492544 6322 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 89964 6322 397 364 0 25187 0
[pid=7381] ppid=7379 vsize=305208 CPUtime=48.46 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) T 7379 7381 7381 0 -1 4202496 72100 0 0 0 4763 83 0 0 20 0 1 0 338484081 312532992 71983 33554432000 4194304 15243407 140733443542704 140733443537416 7426970 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 76302 71983 899 2698 0 73597 0
[pid=7379/tid=7385] ppid=7373 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7379/task/7385/stat : 7385 (python) S 7373 7373 2614 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338488929 368492544 6322 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7386] ppid=7373 vsize=359868 CPUtime=0.07 cores=0,2,4,6
/proc/7386/stat : 7386 (python) S 7373 7373 2614 0 -1 4202560 1077 0 0 0 4 3 0 0 20 0 2 0 338488932 368504832 6325 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7386/statm: 89967 6325 384 364 0 25187 0
[pid=7388] ppid=7386 vsize=17296 CPUtime=47.1 cores=0,2,4,6
/proc/7388/stat : 7388 (clasp-1.3.7-x86) T 7386 7388 7388 0 -1 4202496 4436 0 0 0 4710 0 0 0 20 0 1 0 338488932 17711104 4084 33554432000 134512640 136139019 4291592288 4291590912 134599813 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/7388/statm: 4324 4084 182 398 0 3924 0
[pid=7386/tid=7389] ppid=7373 vsize=359868 CPUtime=0 cores=0,2,4,6
/proc/7386/task/7389/stat : 7389 (python) S 7373 7373 2614 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338493644 368504832 6325 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7390] ppid=7373 vsize=435660 CPUtime=0 cores=0,2,4,6
/proc/7390/stat : 7390 (python) S 7373 7373 2614 0 -1 4202560 921 0 0 0 0 0 0 0 20 0 1 0 338493647 446115840 6305 33554432000 4194304 5683644 140734688491600 140734688482688 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/7390/statm: 108915 6305 359 364 0 44132 0
[pid=7392] ppid=7390 vsize=162848 CPUtime=5.1 cores=0,2,4,6
/proc/7392/stat : 7392 (scip-2.0.1.linu) R 7390 7392 7392 0 -1 4202496 37846 0 0 0 496 14 0 0 20 0 1 0 338493647 166756352 37231 33554432000 4194304 13684479 140737007350528 140737007345912 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/7392/statm: 40712 37231 639 2317 0 38390 0
[pid=7373/tid=7380] ppid=7371 vsize=511440 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 27 1013 0 0 0 0 0 0 20 0 4 0 338484081 523714560 7858 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7387] ppid=7371 vsize=511440 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=7465/tid=7487] ppid=7373 vsize=663540 CPUtime=0 cores=0,2,4,6
/proc/7465/task/7487/stat : 7487 (python) S 7373 7373 2614 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338522316 679464960 6459 33554432000 4194304 5683644 140734688491600 139913155232304 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=7518] ppid=7373 vsize=739332 CPUtime=0.02 cores=0,2,4,6
/proc/7518/stat : 7518 (python) S 7373 7373 2614 0 -1 4202560 982 0 0 0 1 1 0 0 20 0 1 0 338540575 757075968 6439 33554432000 4194304 5683644 140734688491600 140734688482688 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/7518/statm: 184833 6439 359 364 0 120038 0
[pid=7520] ppid=7518 vsize=62208 CPUtime=15.81 cores=0,2,4,6
/proc/7520/stat : 7520 (bsolo_pb10) R 7518 7520 7520 0 -1 4202496 13581 0 0 0 1577 4 0 0 20 0 1 0 338540575 63700992 13107 33554432000 134512640 137138936 4293159776 4293158892 136570369 0 0 16781312 16384 0 0 0 17 2 0 0 0 0 0
/proc/7520/statm: 15552 13107 192 642 0 14908 0
[pid=7373/tid=7380] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 32 1013 0 0 0 0 0 0 20 0 8 0 338484081 834674688 8000 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7387] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7387/stat : 7387 (python) S 7371 7373 2614 0 -1 4202560 29 1013 0 0 0 0 0 0 20 0 8 0 338488932 834674688 8000 33554432000 4194304 5683644 140734688491600 139913186701872 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7391] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7391/stat : 7391 (python) S 7371 7373 2614 0 -1 4202560 25 1013 0 0 0 0 0 0 20 0 8 0 338493647 834674688 8000 33554432000 4194304 5683644 140734688491600 139913176212016 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7373/tid=7399] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7399/stat : 7399 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 8 0 338503182 834674688 8000 33554432000 4194304 5683644 140734688491600 139913165722160 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7454] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7454/stat : 7454 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 8 0 338507921 834674688 8000 33554432000 4194304 5683644 140734688491600 139913155232304 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7466] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7466/stat : 7466 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 8 0 338517563 834674688 8000 33554432000 4194304 5683644 140734688491600 139913144742448 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=7373/tid=7519] ppid=7371 vsize=815112 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7519/stat : 7519 (python) S 7371 7373 2614 0 -1 4202560 22 1013 0 0 0 0 0 0 20 0 8 0 338540575 834674688 8000 33554432000 4194304 5683644 140734688491600 139913134252592 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 584.63
Current children cumulated vsize (KiB) 14988940



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+614.801 s]
/proc/loadavg: 2.00 2.01 2.14 4/269 7528
/proc/meminfo: memFree=26668008/32873844 swapFree=7116/7116
[pid=7373] ppid=7371 vsize=890904 CPUtime=1.56 cores=0,2,4,6
/proc/7373/stat : 7373 (python) S 7371 7373 2614 0 -1 4202496 18169 1013 1 0 137 19 0 0 20 0 9 0 338483927 912285696 8516 33554432000 4194304 5683644 140734688491600 140734688486432 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/7373/statm: 222726 8516 1916 364 0 157928 0
[pid=7379] ppid=7373 vsize=359856 CPUtime=0.15 cores=0,2,4,6
/proc/7379/stat : 7379 (python) S 7373 7373 2614 0 -1 4202560 1195 0 0 0 8 7 0 0 20 0 2 0 338484081 368492544 6323 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7379/statm: 89964 6323 398 364 0 25187 0
[pid=7381] ppid=7379 vsize=306224 CPUtime=95.01 cores=0,2,4,6
/proc/7381/stat : 7381 (scip-2.0.1.linu) T 7379 7381 7381 0 -1 4202496 87445 0 0 0 9409 92 0 0 20 0 1 0 338484081 313573376 74148 33554432000 4194304 15243407 140733443542704 140733443537416 8135333 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/7381/statm: 76556 74148 947 2698 0 73851 0
[pid=7379/tid=7385] ppid=7373 vsize=359856 CPUtime=0 cores=0,2,4,6
/proc/7379/task/7385/stat : 7385 (python) S 7373 7373 2614 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338488929 368492544 6323 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7386] ppid=7373 vsize=359868 CPUtime=0.39 cores=0,2,4,6
/proc/7386/stat : 7386 (python) S 7373 7373 2614 0 -1 4202560 1173 0 0 0 22 17 0 0 20 0 2 0 338488932 368504832 6325 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7386/statm: 89967 6325 384 364 0 25187 0
[pid=7388] ppid=7386 vsize=37104 CPUtime=229.56 cores=0,2,4,6
/proc/7388/stat : 7388 (clasp-1.3.7-x86) T 7386 7388 7388 0 -1 4202496 9388 0 0 0 22955 1 0 0 20 0 1 0 338488932 37994496 9026 33554432000 134512640 136139019 4291592288 4291591152 134608547 0 0 16781312 16386 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/7388/statm: 9276 9026 182 398 0 8876 0
[pid=7386/tid=7389] ppid=7373 vsize=359868 CPUtime=0 cores=0,2,4,6
/proc/7386/task/7389/stat : 7389 (python) S 7373 7373 2614 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338493644 368504832 6325 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7390] ppid=7373 vsize=435660 CPUtime=0.18 cores=0,2,4,6
/proc/7390/stat : 7390 (python) S 7373 7373 2614 0 -1 4202560 1149 0 0 0 10 8 0 0 20 0 2 0 338493647 446115840 6331 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7390/statm: 108915 6331 384 364 0 44132 0
[pid=7392] ppid=7390 vsize=277196 CPUtime=94.71 cores=0,2,4,6
/proc/7392/stat : 7392 (scip-2.0.1.linu) T 7390 7392 7392 0 -1 4202496 72731 0 0 0 9428 43 0 0 20 0 1 0 338493647 283848704 67160 33554432000 4194304 13684479 140737007350528 140737007345560 7095927 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/7392/statm: 69299 67160 765 2317 0 66977 0
[pid=7390/tid=7393] ppid=7373 vsize=435660 CPUtime=0 cores=0,2,4,6
/proc/7390/task/7393/stat : 7393 (python) S 7373 7373 2614 0 -1 4202560 51 0 0 0 0 0 0 0 20 0 2 0 338498606 446115840 6331 33554432000 4194304 5683644 140734688491600 139913186701872 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=7398] ppid=7373 vsize=511956 CPUtime=0.08 cores=0,2,4,6
/proc/7398/stat : 7398 (python) S 7373 7373 2614 0 -1 4202560 1130 0 0 0 4 4 0 0 20 0 2 0 338503182 524242944 6447 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7398/statm: 127989 6447 384 364 0 63203 0
[pid=7400] ppid=7398 vsize=88116 CPUtime=47.34 cores=0,2,4,6
/proc/7400/stat : 7400 (minion) T 7398 7400 7400 0 -1 4202496 8400 0 0 0 4732 2 0 0 20 0 1 0 338503182 90230784 14725 33554432000 134512640 165565024 4292509888 4292507136 142765104 0 0 16781312 8396802 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/7400/statm: 22029 14725 336 7582 0 14444 0
[pid=7398/tid=7452] ppid=7373 vsize=511956 CPUtime=0 cores=0,2,4,6
/proc/7398/task/7452/stat : 7452 (python) S 7373 7373 2614 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338507918 524242944 6447 33554432000 4194304 5683644 140734688491600 139913176212016 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=7453] ppid=7373 vsize=587748 CPUtime=0.07 cores=0,2,4,6
/proc/7453/stat : 7453 (python) S 7373 7373 2614 0 -1 4202560 1128 0 0 0 4 3 0 0 20 0 2 0 338507921 601853952 6453 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/7453/statm: 146937 6453 384 364 0 82148 0
[pid=7455] ppid=7453 vsize=120048 CPUtime=49.79 cores=0,2,4,6
/proc/7455/stat : 7455 (wbo1.4a) T 7453 7455 7455 0 -1 4202496 29905 0 0 0 4920 59 0 0 20 0 1 0 338507921 122929152 29544 33554432000 134512640 135751879 4289196000 4289193612 134517408 0 0 16781312 3 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/7455/statm: 30012 29544 143 303 0 29707 0
[pid=7453/tid=7460] ppid=7373 vsize=587748 CPUtime=0 cores=0,2,4,6
/proc/7453/task/7460/stat : 7460 (python) S 7373 7373 2614 0 -1 4202560 51 0 0 0 0 0 0 0 20 0 2 0 338512902 601853952 6453 33554432000 4194304 5683644 140734688491600 139913165722160 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7465] ppid=7373 vsize=663540 CPUtime=0.08 cores=0,2,4,6
/proc/7465/stat : 7465 (python) S 7373 7373 2614 0 -1 4202560 1144 0 0 0 4 4 0 0 20 0 2 0 338517563 679464960 6459 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7465/statm: 165885 6459 384 364 0 101093 0
[pid=7467] ppid=7465 vsize=9624972 CPUtime=49.9 cores=0,2,4,6
/proc/7467/stat : 7467 (java) T 7465 7467 7467 0 -1 4202496 18148 0 1 0 4962 28 0 0 20 0 19 0 338517563 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140733668110464 240568533053 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7467/statm: 2406243 229898 2267 9 0 2396937 0
[pid=7467/tid=7468] ppid=7465 vsize=9624972 CPUtime=46.99 cores=0,2,4,6
/proc/7467/task/7468/stat : 7468 (java) T 7465 7467 7467 0 -1 4202560 2857 0 1 0 4686 13 0 0 20 0 19 0 338517564 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302779690176 140302640379380 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7469] ppid=7465 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/7467/task/7469/stat : 7469 (java) T 7465 7467 7467 0 -1 4202560 38 0 0 0 11 2 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302623079080 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7470] ppid=7465 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/7467/task/7470/stat : 7470 (java) T 7465 7467 7467 0 -1 4202560 48 0 0 0 11 2 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302622026536 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7471] ppid=7465 vsize=9624972 CPUtime=0.14 cores=0,2,4,6
/proc/7467/task/7471/stat : 7471 (java) T 7465 7467 7467 0 -1 4202560 33 0 0 0 12 2 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302620973992 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=7467/tid=7472] ppid=7465 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/7467/task/7472/stat : 7472 (java) T 7465 7467 7467 0 -1 4202560 32 0 0 0 11 0 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302619921448 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7473] ppid=7465 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/7467/task/7473/stat : 7473 (java) T 7465 7467 7467 0 -1 4202560 34 0 0 0 9 2 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302618867880 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7474] ppid=7465 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/7467/task/7474/stat : 7474 (java) T 7465 7467 7467 0 -1 4202560 23 0 0 0 9 1 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302617815336 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7475] ppid=7465 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/7467/task/7475/stat : 7475 (java) T 7465 7467 7467 0 -1 4202560 28 0 0 0 11 0 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302616762792 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=7467/tid=7476] ppid=7465 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/7467/task/7476/stat : 7476 (java) T 7465 7467 7467 0 -1 4202560 49 0 0 0 10 2 0 0 20 0 19 0 338517566 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302615710248 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7477] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7477/stat : 7477 (java) T 7465 7467 7467 0 -1 4202560 590 0 0 0 0 0 0 0 20 0 19 0 338517567 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302603512424 240568547241 0 0 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=7467/tid=7478] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7478/stat : 7478 (java) T 7465 7467 7467 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338517567 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302602458744 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7479] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7479/stat : 7479 (java) T 7465 7467 7467 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338517567 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302601406088 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7480] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7480/stat : 7480 (java) T 7465 7467 7467 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338517570 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302600354832 240568555296 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7481] ppid=7465 vsize=9624972 CPUtime=0.76 cores=0,2,4,6
/proc/7467/task/7481/stat : 7481 (java) T 7465 7467 7467 0 -1 4202560 4912 0 0 0 74 2 0 0 20 0 19 0 338517570 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302599301176 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7482] ppid=7465 vsize=9624972 CPUtime=0.9 cores=0,2,4,6
/proc/7467/task/7482/stat : 7482 (java) T 7465 7467 7467 0 -1 4202560 8079 0 0 0 89 1 0 0 20 0 19 0 338517570 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302598248632 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7483] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7483/stat : 7483 (java) T 7465 7467 7467 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338517570 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302597196280 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=7467/tid=7484] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7484/stat : 7484 (java) T 7465 7467 7467 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338517570 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302596143944 240568547241 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=7467/tid=7485] ppid=7465 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/7467/task/7485/stat : 7485 (java) T 7465 7467 7467 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 338517604 9855971328 229898 33554432000 1073741824 1073778376 140733668119328 140302595089704 240568547241 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=7465/tid=7487] ppid=7373 vsize=663540 CPUtime=0 cores=0,2,4,6
/proc/7465/task/7487/stat : 7487 (python) S 7373 7373 2614 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338522316 679464960 6459 33554432000 4194304 5683644 140734688491600 139913155232304 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=7518] ppid=7373 vsize=739332 CPUtime=0.08 cores=0,2,4,6
/proc/7518/stat : 7518 (python) S 7373 7373 2614 0 -1 4202560 1157 0 0 0 5 3 0 0 20 0 2 0 338540575 757075968 6465 33554432000 4194304 5683644 140734688491600 140734688483248 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/7518/statm: 184833 6465 384 364 0 120038 0
[pid=7520] ppid=7518 vsize=110628 CPUtime=47.4 cores=0,2,4,6
/proc/7520/stat : 7520 (bsolo_pb10) T 7518 7520 7520 0 -1 4202496 25711 0 0 0 4731 9 0 0 20 0 1 0 338540575 113283072 25237 33554432000 134512640 137138936 4293159776 4293158704 134542339 0 0 16781312 16384 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/7520/statm: 27657 25237 192 642 0 27013 0
[pid=7518/tid=7525] ppid=7373 vsize=739332 CPUtime=0 cores=0,2,4,6
/proc/7518/task/7525/stat : 7525 (python) S 7373 7373 2614 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 338545317 757075968 6465 33554432000 4194304 5683644 140734688491600 139913144742448 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=7526] ppid=7373 vsize=815124 CPUtime=0 cores=0,2,4,6
/proc/7526/stat : 7526 (python) S 7373 7373 2614 0 -1 4202560 849 0 0 0 0 0 0 0 20 0 1 0 338545319 834686976 6422 33554432000 4194304 5683644 140734688491600 140734688482688 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/7526/statm: 203781 6422 336 364 0 138983 0
[pid=7528] ppid=7526 vsize=13068 CPUtime=0.87 cores=0,2,4,6
/proc/7528/stat : 7528 (bsolo_pb10) R 7526 7528 7528 0 -1 4202496 1195 0 0 0 87 0 0 0 20 0 1 0 338545320 13381632 826 33554432000 134512640 137138936 4290817808 4290738720 136504016 0 0 16781312 16384 0 0 0 17 0 0 0 0 0 0
/proc/7528/statm: 3267 826 184 642 0 2623 0
[pid=7373/tid=7380] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7380/stat : 7380 (python) S 7371 7373 2614 0 -1 4202560 32 1013 0 0 0 0 0 0 20 0 9 0 338484081 912285696 8516 33554432000 4194304 5683644 140734688491600 139913197191728 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7387] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7387/stat : 7387 (python) S 7371 7373 2614 0 -1 4202560 29 1013 0 0 0 0 0 0 20 0 9 0 338488932 912285696 8516 33554432000 4194304 5683644 140734688491600 139913186701872 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7391] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7391/stat : 7391 (python) S 7371 7373 2614 0 -1 4202560 25 1013 0 0 0 0 0 0 20 0 9 0 338493647 912285696 8516 33554432000 4194304 5683644 140734688491600 139913176212016 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=7373/tid=7399] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7399/stat : 7399 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338503182 912285696 8516 33554432000 4194304 5683644 140734688491600 139913165722160 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7454] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7454/stat : 7454 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338507921 912285696 8516 33554432000 4194304 5683644 140734688491600 139913155232304 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=7373/tid=7466] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7466/stat : 7466 (python) S 7371 7373 2614 0 -1 4202560 21 1013 0 0 0 0 0 0 20 0 9 0 338517563 912285696 8516 33554432000 4194304 5683644 140734688491600 139913144742448 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=7373/tid=7519] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7519/stat : 7519 (python) S 7371 7373 2614 0 -1 4202560 22 1013 0 0 0 0 0 0 20 0 9 0 338540575 912285696 8516 33554432000 4194304 5683644 140734688491600 139913134252592 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=7373/tid=7527] ppid=7371 vsize=890904 CPUtime=0 cores=0,2,4,6
/proc/7373/task/7527/stat : 7527 (python) S 7371 7373 2614 0 -1 4202560 19 1013 0 0 0 0 0 0 20 0 9 0 338545319 912285696 8516 33554432000 4194304 5683644 140734688491600 139912653300272 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 617.17
Current children cumulated vsize (KiB) 15941344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7373 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=384789
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=198969
# CPU time returned by wait4() is 1.58376
# while last known CPU time is 617.17
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 614.864
CPU time (s): 617.17
CPU user time (s): 614.18
CPU system time (s): 2.99
CPU usage (%): 100.375
Max. virtual memory (cumulated for all children) (KiB): 15941344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.38479
system time used= 0.198969
maximum resident set size= 34064
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19705
page faults= 1
swaps= 0
block input operations= 0
block output operations= 1568
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2083
involuntary context switches= 22

runsolver used 2.6006 second user time and 6.42602 second system time

The end

Launcher Data 

Begin job on node146 at 2012-06-03 13:39:49
IDJOB=3742135
IDBENCH=90134
IDSOLVER=2327
FILE ID=node146/3742135-1338723589
RUNJOBID= node146-1338713700-2630
PBS_JOBID= 14636739
Free space on /tmp= 70808 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K95.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742135-1338723589/watcher-3742135-1338723589 -o /tmp/evaluation-result-3742135-1338723589/solver-3742135-1338723589 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742135-1338723589.opb -seed 1783151643 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f5b402df79463ae0743ac9fe7c0d237d
RANDOM SEED=1783151643

node146.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29596596 kB
Buffers:          283336 kB
Cached:           613560 kB
SwapCached:         1792 kB
Active:          2140196 kB
Inactive:         304020 kB
Active(anon):    1547872 kB
Inactive(anon):     2320 kB
Active(file):     592324 kB
Inactive(file):   301700 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67099888 kB
Dirty:            102140 kB
Writeback:             8 kB
AnonPages:       1553952 kB
Mapped:            32880 kB
Shmem:                84 kB
Slab:             685312 kB
SReclaimable:     121352 kB
SUnreclaim:       563960 kB
KernelStack:        1776 kB
PageTables:        11320 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    2368836 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    720896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70708 MiB
End job on node146 at 2012-06-03 13:50:07