Trace number 3742486

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 288.15 286.465

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K138.opb
MD5SUMb6be79d7c894904bfb5f7c9acfb80f53
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables16422
Total number of constraints16700
Number of constraints which are clauses16562
Number of constraints which are cardinality constraints (but not clauses)138
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint138
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 139
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.42/1.42	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.42/1.42	c INFO: solving HOME/instance-3742486-1338724980.opb
0.52/1.60	c INFO: parsing took 0.18 s
0.52/1.92	c INFO: features took 0.32 CPU seconds
0.52/1.95	c INFO: running scip-2.0.1-clp@0 for 45 with 1799 remaining (b = 0.60)
49.98/50.91	c INFO: running clasp-1.3.7@0 for 45 with 1750 remaining (b = 0.44)
97.13/98.07	c INFO: running scip-2.0.1-spx@0 for 45 with 1703 remaining (b = 0.05)
146.99/147.80	c INFO: running scip-2.0.1-clp@48 for 45 with 1654 remaining (b = 0.01)
192.54/193.37	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1609 remaining (b = 0.04)
242.77/241.11	c INFO: running clasp-1.3.7@47 for 45 with 1559 remaining (b = 0.01)
287.95/286.27	c INFO: running sat4j-pb-v20101225@0 for 45 with 1514 remaining (b = 0.15)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742486-1338724980/watcher-3742486-1338724980 -o /tmp/evaluation-result-3742486-1338724980/solver-3742486-1338724980 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742486-1338724980.opb -seed 1459711663 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.02 2.07 3/188 8061
/proc/meminfo: memFree=30006592/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=15276 CPUtime=0 cores=1,3,5,7
/proc/8061/stat : 8061 (python) D 8059 8061 2614 0 -1 4202496 671 0 0 0 0 0 0 0 20 0 1 0 338623097 15642624 559 33554432000 4194304 5683644 140734160375248 140734160343192 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 1 0 0 0 0 0
/proc/8061/statm: 3819 559 324 364 0 261 0

[startup+0.0787701 s]
/proc/loadavg: 2.01 2.02 2.07 3/188 8061
/proc/meminfo: memFree=30006592/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=16728 CPUtime=0.02 cores=1,3,5,7
/proc/8061/stat : 8061 (python) D 8059 8061 2614 0 -1 4202496 1282 0 0 0 1 1 0 0 20 0 1 0 338623097 17129472 1061 33554432000 4194304 5683644 140734160375248 140734160328968 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 1 0 0 0 0 0
/proc/8061/statm: 4182 1061 426 364 0 624 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 16728

[startup+0.100266 s]
/proc/loadavg: 2.01 2.02 2.07 3/188 8061
/proc/meminfo: memFree=30006592/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=19080 CPUtime=0.03 cores=1,3,5,7
/proc/8061/stat : 8061 (python) R 8059 8061 2614 0 -1 4202496 1393 0 0 0 2 1 0 0 20 0 1 0 338623097 19537920 1148 33554432000 4194304 5683644 140734160375248 140734160305752 4620212 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8061/statm: 4770 1148 430 364 0 694 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 19080

[startup+0.300212 s]
/proc/loadavg: 2.01 2.02 2.07 3/188 8061
/proc/meminfo: memFree=30006592/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=96912 CPUtime=0.12 cores=1,3,5,7
/proc/8061/stat : 8061 (python) D 8059 8061 2614 0 -1 4202496 3957 1007 1 0 8 4 0 0 20 0 1 0 338623097 99237888 2652 33554432000 4194304 5683644 140734160375248 140734160243608 240565175184 0 0 16781312 2 18446744072100609316 0 0 17 1 0 0 0 0 0
/proc/8061/statm: 24228 2652 823 364 0 1719 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 96912

[startup+0.700196 s]
/proc/loadavg: 2.01 2.02 2.07 3/188 8061
/proc/meminfo: memFree=30006592/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=136264 CPUtime=0.22 cores=1,3,5,7
/proc/8061/stat : 8061 (python) R 8059 8061 2614 0 -1 4202496 6233 1007 1 0 14 8 0 0 20 0 1 0 338623097 139534336 4072 33554432000 4194304 5683644 140734160375248 140734160280968 240556010740 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8061/statm: 34586 4076 1095 364 0 2952 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 136264

[startup+1.50025 s]
/proc/loadavg: 2.01 2.02 2.07 3/189 8066
/proc/meminfo: memFree=29984372/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=284868 CPUtime=0.52 cores=1,3,5,7
/proc/8061/stat : 8061 (python) R 8059 8061 2614 0 -1 4202496 10896 1007 1 0 37 15 0 0 20 0 1 0 338623097 291704832 7930 33554432000 4194304 5683644 140734160375248 140734160368744 240564846464 0 0 16781312 2 0 0 0 17 1 0 0 16 0 0
/proc/8061/statm: 71217 7930 1811 364 0 6446 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 284868

[startup+3.10051 s]
/proc/loadavg: 2.09 2.04 2.07 3/192 8069
/proc/meminfo: memFree=29880056/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=364568 CPUtime=0.98 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 13308 1007 1 0 82 16 0 0 20 0 2 0 338623097 373317632 8997 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 16 0 0
/proc/8061/statm: 91142 8997 1894 364 0 26365 0
[pid=8067] ppid=8061 vsize=288788 CPUtime=0 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 766 0 0 0 0 0 0 0 20 0 1 0 338623293 295718912 7437 33554432000 4194304 5683644 140734160375248 140734160366336 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 5 0 0 0 0 0
/proc/8067/statm: 72197 7437 340 364 0 7420 0
[pid=8069] ppid=8067 vsize=137784 CPUtime=1.14 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) R 8067 8069 8069 0 -1 4202496 31660 0 0 0 104 10 0 0 20 0 1 0 338623293 141090816 30948 33554432000 4194304 15243407 140735881463232 140735881458616 4880912 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 34446 30948 682 2698 0 31741 0
[pid=8061/tid=8068] ppid=8059 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 2 0 338623293 373317632 8997 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.12
Current children cumulated vsize (KiB) 791140
heavy processes:

[startup+6.30039 s]
/proc/loadavg: 2.09 2.04 2.07 3/192 8069
/proc/meminfo: memFree=29758348/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=364568 CPUtime=0.98 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 13308 1007 1 0 82 16 0 0 20 0 2 0 338623097 373317632 8997 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 16 0 0
/proc/8061/statm: 91142 8997 1894 364 0 26365 0
[pid=8067] ppid=8061 vsize=288788 CPUtime=0 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 885 0 0 0 0 0 0 0 20 0 1 0 338623293 295718912 7460 33554432000 4194304 5683644 140734160375248 140734160366336 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 72197 7460 363 364 0 7420 0
[pid=8069] ppid=8067 vsize=212440 CPUtime=4.33 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) R 8067 8069 8069 0 -1 4202496 49040 0 0 0 419 14 0 0 20 0 1 0 338623293 217538560 48328 33554432000 4194304 15243407 140735881463232 140735881458616 4880933 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 53110 48328 682 2698 0 50405 0
[pid=8061/tid=8068] ppid=8059 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 2 0 338623293 373317632 8997 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 5.31
Current children cumulated vsize (KiB) 865796

[startup+12.7006 s]
/proc/loadavg: 2.07 2.04 2.07 3/192 8069
/proc/meminfo: memFree=29652880/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=364568 CPUtime=0.98 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 13308 1007 1 0 82 16 0 0 20 0 2 0 338623097 373317632 8997 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 16 0 0
/proc/8061/statm: 91142 8997 1894 364 0 26365 0
[pid=8067] ppid=8061 vsize=288788 CPUtime=0.01 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 890 0 0 0 1 0 0 0 20 0 1 0 338623293 295718912 7460 33554432000 4194304 5683644 140734160375248 140734160366336 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 72197 7460 363 364 0 7420 0
[pid=8069] ppid=8067 vsize=277472 CPUtime=10.72 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) R 8067 8069 8069 0 -1 4202496 64005 0 0 0 1056 16 0 0 20 0 1 0 338623293 284131328 63293 33554432000 4194304 15243407 140735881463232 140735881458616 4866000 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 69368 63293 682 2698 0 66663 0
[pid=8061/tid=8068] ppid=8059 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 2 0 338623293 373317632 8997 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 11.71
Current children cumulated vsize (KiB) 930828

[startup+25.5004 s]
/proc/loadavg: 2.06 2.04 2.07 3/192 8069
/proc/meminfo: memFree=29476632/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=364568 CPUtime=0.98 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 13308 1007 1 0 82 16 0 0 20 0 2 0 338623097 373317632 8997 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 16 0 0
/proc/8061/statm: 91142 8997 1894 364 0 26365 0
[pid=8067] ppid=8061 vsize=288788 CPUtime=0.03 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 996 0 0 0 2 1 0 0 20 0 1 0 338623293 295718912 7465 33554432000 4194304 5683644 140734160375248 140734160366336 240565191080 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 72197 7465 368 364 0 7420 0
[pid=8069] ppid=8067 vsize=396136 CPUtime=23.53 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) R 8067 8069 8069 0 -1 4202496 93429 0 0 0 2323 30 0 0 20 0 1 0 338623293 405643264 92717 33554432000 4194304 15243407 140735881463232 140735881459544 4519924 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 99034 92717 686 2698 0 96329 0
[pid=8061/tid=8068] ppid=8059 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 2 0 338623293 373317632 8997 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 24.54
Current children cumulated vsize (KiB) 1049492

[startup+51.1076 s]
/proc/loadavg: 2.04 2.03 2.07 3/217 8094
/proc/meminfo: memFree=28661080/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=440360 CPUtime=1 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 14213 1007 1 0 84 16 0 0 20 0 3 0 338623097 450928640 9014 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 16 0 0
/proc/8061/statm: 110090 9014 1905 364 0 45310 0
[pid=8067] ppid=8061 vsize=364568 CPUtime=0.09 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 1155 0 0 0 5 4 0 0 20 0 2 0 338623293 373317632 7500 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 91142 7500 396 364 0 26365 0
[pid=8069] ppid=8067 vsize=518860 CPUtime=48.91 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) T 8067 8069 8069 0 -1 4202496 124146 0 0 0 4847 44 0 0 20 0 1 0 338623293 531312640 123434 33554432000 4194304 15243407 140735881463232 140735881459544 4880933 0 0 16781312 2 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 129715 123434 686 2698 0 127010 0
[pid=8067/tid=8091] ppid=8061 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8067/task/8091/stat : 8091 (python) S 8061 8061 2614 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338628187 373317632 7500 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8092] ppid=8061 vsize=364580 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (python) S 8061 8061 2614 0 -1 4202560 751 0 0 0 0 0 0 0 20 0 1 0 338628189 373329920 7435 33554432000 4194304 5683644 140734160375248 140734160366336 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 7 0 0 0 0 0
/proc/8092/statm: 91145 7435 332 364 0 26365 0
[pid=8094] ppid=8092 vsize=6696 CPUtime=0.17 cores=1,3,5,7
/proc/8094/stat : 8094 (clasp-1.3.7-x86) R 8092 8094 8094 0 -1 4202496 1918 0 0 0 17 0 0 0 20 0 1 0 338628190 6856704 1411 33554432000 134512640 136139019 4289694240 4289693072 134832200 0 0 16781312 16386 0 0 0 17 3 0 0 0 0 0
/proc/8094/statm: 1674 1411 182 398 0 1274 0
[pid=8061/tid=8068] ppid=8059 vsize=440360 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 3 0 338623293 450928640 9014 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8061/tid=8093] ppid=8059 vsize=440360 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8093/stat : 8093 (python) S 8059 8061 2614 0 -1 4202560 22 1007 0 0 0 0 0 0 20 0 3 0 338628190 450928640 9014 33554432000 4194304 5683644 140734160375248 140083819934256 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.17
Current children cumulated vsize (KiB) 1695064

[startup+102.301 s]
/proc/loadavg: 2.06 2.04 2.07 3/222 8099
/proc/meminfo: memFree=27330400/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=516152 CPUtime=1.02 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 15140 1007 1 0 86 16 0 0 20 0 4 0 338623097 528539648 9022 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 16 0 0
/proc/8061/statm: 129038 9022 1907 364 0 64255 0
[pid=8067] ppid=8061 vsize=364568 CPUtime=0.09 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 1155 0 0 0 5 4 0 0 20 0 2 0 338623293 373317632 7500 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 91142 7500 396 364 0 26365 0
[pid=8069] ppid=8067 vsize=518860 CPUtime=48.91 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) T 8067 8069 8069 0 -1 4202496 124146 0 0 0 4847 44 0 0 20 0 1 0 338623293 531312640 123434 33554432000 4194304 15243407 140735881463232 140735881459544 4880933 0 0 16781312 2 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 129715 123434 686 2698 0 127010 0
[pid=8067/tid=8091] ppid=8061 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8067/task/8091/stat : 8091 (python) S 8061 8061 2614 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338628187 373317632 7500 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8092] ppid=8061 vsize=364580 CPUtime=0.07 cores=1,3,5,7
/proc/8092/stat : 8092 (python) S 8061 8061 2614 0 -1 4202560 1091 0 0 0 4 3 0 0 20 0 2 0 338628189 373329920 7487 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8092/statm: 91145 7487 383 364 0 26365 0
[pid=8094] ppid=8092 vsize=19364 CPUtime=47.11 cores=1,3,5,7
/proc/8094/stat : 8094 (clasp-1.3.7-x86) T 8092 8094 8094 0 -1 4202496 5078 0 0 0 4710 1 0 0 20 0 1 0 338628190 19828736 4571 33554432000 134512640 136139019 4289694240 4289693216 134883787 0 0 16781312 16386 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/8094/statm: 4841 4571 182 398 0 4441 0
[pid=8092/tid=8096] ppid=8061 vsize=364580 CPUtime=0 cores=1,3,5,7
/proc/8092/task/8096/stat : 8096 (python) S 8061 8061 2614 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338632903 373329920 7487 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8097] ppid=8061 vsize=440372 CPUtime=0 cores=1,3,5,7
/proc/8097/stat : 8097 (python) S 8061 8061 2614 0 -1 4202560 920 0 0 0 0 0 0 0 20 0 1 0 338632905 450940928 7467 33554432000 4194304 5683644 140734160375248 140734160366336 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 1 0 0 0 0 0
/proc/8097/statm: 110093 7467 358 364 0 45310 0
[pid=8099] ppid=8097 vsize=212676 CPUtime=4.2 cores=1,3,5,7
/proc/8099/stat : 8099 (scip-2.0.1.linu) R 8097 8099 8099 0 -1 4202496 49375 0 0 0 408 12 0 0 20 0 1 0 338632906 217780224 48651 33554432000 4194304 13684479 140734396407904 140734396403288 4880921 0 0 16781312 2 0 0 0 17 3 0 0 0 0 0
/proc/8099/statm: 53169 48651 635 2317 0 50847 0
[pid=8061/tid=8068] ppid=8059 vsize=516152 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 27 1007 0 0 0 0 0 0 20 0 4 0 338623293 528539648 9022 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8061/tid=8093] ppid=8059 vsize=516152 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

[pid=8204/tid=8216] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8216/stat : 8216 (java) S 8202 8204 8204 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 338651730 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619916932104 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8217] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8217/stat : 8217 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619915880592 240568555296 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8218] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8218/stat : 8218 (java) S 8202 8204 8204 0 -1 4202560 360 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619914828728 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8219] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8219/stat : 8219 (java) S 8202 8204 8204 0 -1 4202560 510 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619041205048 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8204/tid=8220] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8220/stat : 8220 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619040152440 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8204/tid=8221] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8221/stat : 8221 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619039099848 240568547241 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8061/tid=8068] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 31 1007 0 0 0 0 0 0 20 0 6 0 338623293 683761664 9546 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8061/tid=8093] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8093/stat : 8093 (python) S 8059 8061 2614 0 -1 4202560 28 1007 0 0 0 0 0 0 20 0 6 0 338628190 683761664 9546 33554432000 4194304 5683644 140734160375248 140083819934256 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8098] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8098/stat : 8098 (python) S 8059 8061 2614 0 -1 4202560 21 1007 0 0 0 0 0 0 20 0 6 0 338632906 683761664 9546 33554432000 4194304 5683644 140734160375248 140083809444400 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8175] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8175/stat : 8175 (python) S 8059 8061 2614 0 -1 4202560 21 1007 0 0 0 0 0 0 20 0 6 0 338642436 683761664 9546 33554432000 4194304 5683644 140734160375248 140083798954544 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8203] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8203/stat : 8203 (python) S 8059 8061 2614 0 -1 4202560 19 1007 0 0 0 0 0 0 20 0 6 0 338651725 683761664 9546 33554432000 4194304 5683644 140734160375248 140083579576880 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 288.15
Current children cumulated vsize (KiB) 23418352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+286.401 s]
/proc/loadavg: 1.98 2.00 2.05 4/243 8221
/proc/meminfo: memFree=26883596/32873844 swapFree=7116/7116
[pid=8061] ppid=8059 vsize=667736 CPUtime=1.12 cores=1,3,5,7
/proc/8061/stat : 8061 (python) S 8059 8061 2614 0 -1 4202496 17105 1007 1 0 95 17 0 0 20 0 6 0 338623097 683761664 9546 33554432000 4194304 5683644 140734160375248 140734160370080 240568558861 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 16 0 0
/proc/8061/statm: 166934 9546 1911 364 0 102145 0
[pid=8067] ppid=8061 vsize=364568 CPUtime=0.16 cores=1,3,5,7
/proc/8067/stat : 8067 (python) S 8061 8061 2614 0 -1 4202560 1192 0 0 0 10 6 0 0 20 0 2 0 338623293 373317632 7501 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8067/statm: 91142 7501 397 364 0 26365 0
[pid=8069] ppid=8067 vsize=733864 CPUtime=94.44 cores=1,3,5,7
/proc/8069/stat : 8069 (scip-2.0.1.linu) T 8067 8069 8069 0 -1 4202496 177846 0 0 0 9371 73 0 0 20 0 1 0 338623293 751476736 178590 33554432000 4194304 15243407 140735881463232 140735881459544 4865666 0 0 16781312 2 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8069/statm: 183466 178590 686 2698 0 180761 0
[pid=8067/tid=8091] ppid=8061 vsize=364568 CPUtime=0 cores=1,3,5,7
/proc/8067/task/8091/stat : 8091 (python) S 8061 8061 2614 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338628187 373317632 7501 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8092] ppid=8061 vsize=364580 CPUtime=0.16 cores=1,3,5,7
/proc/8092/stat : 8092 (python) S 8061 8061 2614 0 -1 4202560 1154 0 0 0 9 7 0 0 20 0 2 0 338628189 373329920 7487 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/8092/statm: 91145 7487 383 364 0 26365 0
[pid=8094] ppid=8092 vsize=28972 CPUtime=92.24 cores=1,3,5,7
/proc/8094/stat : 8094 (clasp-1.3.7-x86) T 8092 8094 8094 0 -1 4202496 7508 0 0 0 9222 2 0 0 20 0 1 0 338628190 29667328 6989 33554432000 134512640 136139019 4289694240 4289693172 134632473 0 0 16781312 16386 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/8094/statm: 7243 6989 182 398 0 6843 0
[pid=8092/tid=8096] ppid=8061 vsize=364580 CPUtime=0 cores=1,3,5,7
/proc/8092/task/8096/stat : 8096 (python) S 8061 8061 2614 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338632903 373329920 7487 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8097] ppid=8061 vsize=440372 CPUtime=0.09 cores=1,3,5,7
/proc/8097/stat : 8097 (python) S 8061 8061 2614 0 -1 4202560 1120 0 0 0 5 4 0 0 20 0 2 0 338632905 450940928 7493 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8097/statm: 110093 7493 383 364 0 45310 0
[pid=8099] ppid=8097 vsize=526760 CPUtime=49.68 cores=1,3,5,7
/proc/8099/stat : 8099 (scip-2.0.1.linu) T 8097 8099 8099 0 -1 4202496 126163 0 0 0 4917 51 0 0 20 0 1 0 338632906 539402240 125439 33554432000 4194304 13684479 140734396407904 140734396404216 5110576 0 0 16781312 2 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/8099/statm: 131690 125439 639 2317 0 129368 0
[pid=8097/tid=8169] ppid=8061 vsize=440372 CPUtime=0 cores=1,3,5,7
/proc/8097/task/8169/stat : 8169 (python) S 8061 8061 2614 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338637876 450940928 7493 33554432000 4194304 5683644 140734160375248 140083819934256 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8174] ppid=8061 vsize=516164 CPUtime=0.08 cores=1,3,5,7
/proc/8174/stat : 8174 (python) S 8061 8061 2614 0 -1 4202560 1128 0 0 0 5 3 0 0 20 0 2 0 338642435 528551936 7499 33554432000 4194304 5683644 140734160375248 140734160366896 240568558861 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8174/statm: 129041 7499 383 364 0 64255 0
[pid=8176] ppid=8174 vsize=9624972 CPUtime=50.05 cores=1,3,5,7
/proc/8176/stat : 8176 (java) T 8174 8176 8176 0 -1 4202496 16703 0 1 0 4954 51 0 0 20 0 19 0 338642436 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140737325603136 240568533053 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8176/statm: 2406243 438000 2269 9 0 2396937 0
[pid=8176/tid=8177] ppid=8174 vsize=9624972 CPUtime=47.25 cores=1,3,5,7
/proc/8176/task/8177/stat : 8177 (java) T 8174 8176 8176 0 -1 4202560 3236 0 1 0 4696 29 0 0 20 0 19 0 338642437 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632959192032 140632816324811 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8178] ppid=8174 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/8176/task/8178/stat : 8178 (java) T 8174 8176 8176 0 -1 4202560 60 0 0 0 11 3 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632937294888 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8179] ppid=8174 vsize=9624972 CPUtime=0.1 cores=1,3,5,7
/proc/8176/task/8179/stat : 8179 (java) T 8174 8176 8176 0 -1 4202560 40 0 0 0 8 2 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632936242088 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8180] ppid=8174 vsize=9624972 CPUtime=0.09 cores=1,3,5,7
/proc/8176/task/8180/stat : 8180 (java) T 8174 8176 8176 0 -1 4202560 45 0 0 0 6 3 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632935189288 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8181] ppid=8174 vsize=9624972 CPUtime=0.08 cores=1,3,5,7
/proc/8176/task/8181/stat : 8181 (java) T 8174 8176 8176 0 -1 4202560 39 0 0 0 7 1 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632934136488 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8176/tid=8182] ppid=8174 vsize=9624972 CPUtime=0.11 cores=1,3,5,7
/proc/8176/task/8182/stat : 8182 (java) T 8174 8176 8176 0 -1 4202560 41 0 0 0 8 3 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632597195304 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8183] ppid=8174 vsize=9624972 CPUtime=0.11 cores=1,3,5,7
/proc/8176/task/8183/stat : 8183 (java) T 8174 8176 8176 0 -1 4202560 53 0 0 0 8 3 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632596142504 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8184] ppid=8174 vsize=9624972 CPUtime=0.08 cores=1,3,5,7
/proc/8176/task/8184/stat : 8184 (java) T 8174 8176 8176 0 -1 4202560 46 0 0 0 7 1 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632595089704 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8176/tid=8185] ppid=8174 vsize=9624972 CPUtime=0.07 cores=1,3,5,7
/proc/8176/task/8185/stat : 8185 (java) T 8174 8176 8176 0 -1 4202560 39 0 0 0 5 2 0 0 20 0 19 0 338642438 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632594036904 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8176/tid=8186] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8186/stat : 8186 (java) T 8174 8176 8176 0 -1 4202560 1223 0 0 0 0 0 0 0 20 0 19 0 338642439 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632581839848 240568547241 0 0 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8176/tid=8187] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8187/stat : 8187 (java) T 8174 8176 8176 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338642440 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632580785912 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8188] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8188/stat : 8188 (java) T 8174 8176 8176 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338642440 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632579733000 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8189] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8189/stat : 8189 (java) T 8174 8176 8176 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338642443 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632578681488 240568555296 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8190] ppid=8174 vsize=9624972 CPUtime=0.91 cores=1,3,5,7
/proc/8176/task/8190/stat : 8190 (java) T 8174 8176 8176 0 -1 4202560 5924 0 0 0 89 2 0 0 20 0 19 0 338642443 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632577628600 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8191] ppid=8174 vsize=9624972 CPUtime=0.81 cores=1,3,5,7
/proc/8176/task/8191/stat : 8191 (java) T 8174 8176 8176 0 -1 4202560 4540 0 0 0 80 1 0 0 20 0 19 0 338642443 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632576575800 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8192] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8192/stat : 8192 (java) T 8174 8176 8176 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338642443 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632575523192 240568546364 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8176/tid=8193] ppid=8174 vsize=9624972 CPUtime=0.01 cores=1,3,5,7
/proc/8176/task/8193/stat : 8193 (java) T 8174 8176 8176 0 -1 4202560 3 0 0 0 1 0 0 0 20 0 19 0 338642443 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632574470600 240568547241 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=8176/tid=8194] ppid=8174 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/8176/task/8194/stat : 8194 (java) T 8174 8176 8176 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 338642495 9855971328 438000 33554432000 1073741824 1073778376 140737325612000 140632573417128 240568547241 0 4 0 16800975 18446744071579387992 0 0 -1 3 0 0 0 0 0
[pid=8174/tid=8199] ppid=8061 vsize=516164 CPUtime=0 cores=1,3,5,7
/proc/8174/task/8199/stat : 8199 (python) S 8061 8061 2614 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338647206 528551936 7499 33554432000 4194304 5683644 140734160375248 140083809444400 240568555296 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8202] ppid=8061 vsize=591956 CPUtime=0 cores=1,3,5,7
/proc/8202/stat : 8202 (python) S 8061 8061 2614 0 -1 4202560 855 0 0 0 0 0 0 0 20 0 1 0 338651725 606162944 7456 33554432000 4194304 5683644 140734160375248 140734160366336 240565191139 0 0 16781312 33554946 18446744071580425449 0 0 17 5 0 0 0 0 0
/proc/8202/statm: 147989 7456 335 364 0 83200 0
[pid=8204] ppid=8202 vsize=9558408 CPUtime=0.13 cores=1,3,5,7
/proc/8204/stat : 8204 (java) S 8202 8204 8204 0 -1 4202496 4704 0 1 0 12 1 0 0 20 0 18 0 338651726 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140733450073424 240568533053 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/8204/statm: 2389602 6153 2148 9 0 2380296 0
[pid=8204/tid=8205] ppid=8202 vsize=9558408 CPUtime=0.09 cores=1,3,5,7
/proc/8204/task/8205/stat : 8205 (java) R 8202 8204 8204 0 -1 4202560 2416 0 1 0 8 1 0 0 20 0 18 0 338651727 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620095249328 140619930517930 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0
[pid=8204/tid=8206] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8206/stat : 8206 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620056742440 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8207] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8207/stat : 8207 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620055689640 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8204/tid=8208] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8208/stat : 8208 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620054636840 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=8204/tid=8209] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8209/stat : 8209 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620053584040 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8204/tid=8210] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8210/stat : 8210 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620052532264 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8211] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8211/stat : 8211 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620051479464 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8204/tid=8212] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8212/stat : 8212 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620050426664 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8213] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8213/stat : 8213 (java) S 8202 8204 8204 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 18 0 338651728 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140620049373864 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8214] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8214/stat : 8214 (java) S 8202 8204 8204 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 338651729 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619919038952 240568547241 0 0 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8215] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8215/stat : 8215 (java) S 8202 8204 8204 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 18 0 338651730 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619917985016 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8216] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8216/stat : 8216 (java) S 8202 8204 8204 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 338651730 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619916932104 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8217] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8217/stat : 8217 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619915880592 240568555296 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8218] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8218/stat : 8218 (java) S 8202 8204 8204 0 -1 4202560 360 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619914828728 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=8204/tid=8219] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8219/stat : 8219 (java) S 8202 8204 8204 0 -1 4202560 510 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619041205048 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8204/tid=8220] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8220/stat : 8220 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619040152440 240568546364 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8204/tid=8221] ppid=8202 vsize=9558408 CPUtime=0 cores=1,3,5,7
/proc/8204/task/8221/stat : 8221 (java) S 8202 8204 8204 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338651733 9787809792 6153 33554432000 1073741824 1073778376 140733450082288 140619039099848 240568547241 0 4 0 16800975 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8061/tid=8068] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8068/stat : 8068 (python) S 8059 8061 2614 0 -1 4202560 31 1007 0 0 0 0 0 0 20 0 6 0 338623293 683761664 9546 33554432000 4194304 5683644 140734160375248 140083830424112 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=8061/tid=8093] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8093/stat : 8093 (python) S 8059 8061 2614 0 -1 4202560 28 1007 0 0 0 0 0 0 20 0 6 0 338628190 683761664 9546 33554432000 4194304 5683644 140734160375248 140083819934256 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8098] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8098/stat : 8098 (python) S 8059 8061 2614 0 -1 4202560 21 1007 0 0 0 0 0 0 20 0 6 0 338632906 683761664 9546 33554432000 4194304 5683644 140734160375248 140083809444400 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8175] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8175/stat : 8175 (python) S 8059 8061 2614 0 -1 4202560 21 1007 0 0 0 0 0 0 20 0 6 0 338642436 683761664 9546 33554432000 4194304 5683644 140734160375248 140083798954544 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=8061/tid=8203] ppid=8059 vsize=667736 CPUtime=0 cores=1,3,5,7
/proc/8061/task/8203/stat : 8203 (python) S 8059 8061 2614 0 -1 4202560 19 1007 0 0 0 0 0 0 20 0 6 0 338651725 683761664 9546 33554432000 4194304 5683644 140734160375248 140083579576880 240568555296 0 0 16781312 33554434 18446744071579510697 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 288.15
Current children cumulated vsize (KiB) 23418352

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8061 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=958854
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=179972
# CPU time returned by wait4() is 1.13883
# while last known CPU time is 288.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 286.465
CPU time (s): 288.15
CPU user time (s): 286
CPU system time (s): 2.15
CPU usage (%): 100.588
Max. virtual memory (cumulated for all children) (KiB): 23418352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.958854
system time used= 0.179972
maximum resident set size= 38184
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18112
page faults= 1
swaps= 0
block input operations= 0
block output operations= 448
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2060
involuntary context switches= 13

runsolver used 1.06984 second user time and 2.71659 second system time

The end

Launcher Data 

Begin job on node146 at 2012-06-03 14:03:00
IDJOB=3742486
IDBENCH=90190
IDSOLVER=2327
FILE ID=node146/3742486-1338724980
RUNJOBID= node146-1338713700-2631
PBS_JOBID= 14636739
Free space on /tmp= 70808 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K138.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742486-1338724980/watcher-3742486-1338724980 -o /tmp/evaluation-result-3742486-1338724980/solver-3742486-1338724980 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742486-1338724980.opb -seed 1459711663 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b6be79d7c894904bfb5f7c9acfb80f53
RANDOM SEED=1459711663

node146.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.034
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30006336 kB
Buffers:          290644 kB
Cached:           615468 kB
SwapCached:         1792 kB
Active:          1735048 kB
Inactive:         304612 kB
Active(anon):    1134384 kB
Inactive(anon):     1712 kB
Active(file):     600664 kB
Inactive(file):   302900 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67099888 kB
Dirty:            102660 kB
Writeback:            20 kB
AnonPages:       1139992 kB
Mapped:            21176 kB
Shmem:                48 kB
Slab:             682496 kB
SReclaimable:     121212 kB
SUnreclaim:       561284 kB
KernelStack:        1544 kB
PageTables:         8452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1445764 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70708 MiB
End job on node146 at 2012-06-03 14:07:50