Trace number 3742304

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 339.69 336.761

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K196.opb
MD5SUMbcce2e1d61aa4147a6a5a8b58d6d164e
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables23324
Total number of constraints23718
Number of constraints which are clauses23522
Number of constraints which are cardinality constraints (but not clauses)196
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint196
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 197
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.50/1.20	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.50/1.20	c INFO: solving HOME/instance-3742304-1338724429.opb
0.70/1.45	c INFO: parsing took 0.25 s
1.20/1.96	c INFO: features took 0.50 CPU seconds
1.69/2.45	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.58)
49.93/50.65	c INFO: running clasp-1.3.7@0 for 45 with 1750 remaining (b = 0.46)
97.21/97.81	c INFO: running scip-2.0.1-clp@0 for 45 with 1703 remaining (b = 0.08)
147.05/147.61	c INFO: running scip-2.0.1-clp@49 for 45 with 1654 remaining (b = 0.01)
192.39/192.90	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1609 remaining (b = 0.04)
242.62/240.69	c INFO: running clasp-1.3.7@47 for 45 with 1559 remaining (b = 0.01)
290.10/288.00	c INFO: wrote minion input file to HOME/tmpnTWLVE.minion
290.10/288.00	c INFO: running minion-0.12@0 for 45 with 1514 remaining (b = 0.17)
338.06/335.97	c INFO: running sat4j-pb-v20101225@0 for 45 with 1464 remaining (b = 0.05)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742304-1338724429/watcher-3742304-1338724429 -o /tmp/evaluation-result-3742304-1338724429/solver-3742304-1338724429 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742304-1338724429.opb -seed 159981115 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.01 2.25 2/187 6818
/proc/meminfo: memFree=26281444/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=15308 CPUtime=0 cores=0,2,4,6
/proc/6818/stat : 6818 (python) R 6816 6818 3621 0 -1 4202496 663 0 0 0 0 0 0 0 20 0 1 0 338567471 15675392 556 33554432000 4194304 5683644 140734653965536 140734653951448 213419640096 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6818/statm: 3819 557 323 364 0 261 0

[startup+0.067841 s]
/proc/loadavg: 1.93 2.01 2.25 2/187 6818
/proc/meminfo: memFree=26281444/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=16596 CPUtime=0.01 cores=0,2,4,6
/proc/6818/stat : 6818 (python) D 6816 6818 3621 0 -1 4202496 1242 0 0 0 1 0 0 0 20 0 1 0 338567471 16994304 1031 33554432000 4194304 5683644 140734653965536 140734653929560 213419639696 0 0 16781312 2 18446744072100609316 0 0 17 0 0 0 0 0 0
/proc/6818/statm: 4149 1031 422 364 0 591 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16596

[startup+0.100234 s]
/proc/loadavg: 1.93 2.01 2.25 2/187 6818
/proc/meminfo: memFree=26281444/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=19088 CPUtime=0.03 cores=0,2,4,6
/proc/6818/stat : 6818 (python) R 6816 6818 3621 0 -1 4202496 1399 0 0 0 2 1 0 0 20 0 1 0 338567471 19546112 1153 33554432000 4194304 5683644 140734653965536 140734653896040 4331853 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6818/statm: 4772 1153 430 364 0 696 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 19088

[startup+0.300362 s]
/proc/loadavg: 1.93 2.01 2.25 2/187 6818
/proc/meminfo: memFree=26281444/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=102056 CPUtime=0.13 cores=0,2,4,6
/proc/6818/stat : 6818 (python) D 6816 6818 3621 0 -1 4202496 4126 1010 1 0 9 4 0 0 20 0 1 0 338567471 104505344 2727 33554432000 4194304 5683644 140734653965536 140734653820232 213419639696 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 25514 2727 876 364 0 1724 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 102056

[startup+0.700267 s]
/proc/loadavg: 1.93 2.01 2.25 2/187 6818
/proc/meminfo: memFree=26281444/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=162444 CPUtime=0.28 cores=0,2,4,6
/proc/6818/stat : 6818 (python) D 6816 6818 3621 0 -1 4202496 6470 1010 1 0 17 11 0 0 20 0 1 0 338567471 166342656 4277 33554432000 4194304 5683644 140734653965536 140734653838056 213419639696 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 40611 4277 1192 364 0 3256 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 162444

[startup+1.50023 s]
/proc/loadavg: 1.93 2.01 2.25 2/188 6823
/proc/meminfo: memFree=26246576/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=291484 CPUtime=0.8 cores=0,2,4,6
/proc/6818/stat : 6818 (python) R 6816 6818 3621 0 -1 4202496 14178 1010 1 0 61 19 0 0 20 0 1 0 338567471 298479616 9619 33554432000 4194304 5683644 140734653965536 140734653879608 213427185433 0 0 16781312 33554434 0 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 72871 9619 1846 364 0 8100 0
Current children cumulated CPU time (s) 0.8
Current children cumulated vsize (KiB) 291484

[startup+3.10036 s]
/proc/loadavg: 2.09 2.04 2.26 4/191 6826
/proc/meminfo: memFree=26148096/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=367844 CPUtime=1.29 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 14604 1010 1 0 110 19 0 0 20 0 2 0 338567471 376672256 9815 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 91961 9815 1894 364 0 27184 0
[pid=6824] ppid=6818 vsize=292064 CPUtime=0 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 752 0 0 0 0 0 0 0 20 0 1 0 338567670 299073536 8255 33554432000 4194304 5683644 140734653965536 140734653956624 213419655592 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/6824/statm: 73016 8255 340 364 0 8239 0
[pid=6826] ppid=6824 vsize=156452 CPUtime=1.09 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) R 6824 6826 6826 0 -1 4202496 36223 0 0 0 102 7 0 0 20 0 1 0 338567670 160206848 35504 33554432000 4194304 13684479 140735612790016 140735612785400 4880943 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 39113 35504 622 2317 0 36791 0
[pid=6818/tid=6825] ppid=6816 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338567670 376672256 9815 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 2.38
Current children cumulated vsize (KiB) 816360
heavy processes:

[startup+6.30043 s]
/proc/loadavg: 2.09 2.04 2.26 3/192 6827
/proc/meminfo: memFree=25987012/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=367844 CPUtime=1.29 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 14604 1010 1 0 110 19 0 0 20 0 2 0 338567471 376672256 9815 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 91961 9815 1894 364 0 27184 0
[pid=6824] ppid=6818 vsize=292064 CPUtime=0 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 890 0 0 0 0 0 0 0 20 0 1 0 338567670 299073536 8277 33554432000 4194304 5683644 140734653965536 140734653956624 213419655592 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 73016 8277 362 364 0 8239 0
[pid=6826] ppid=6824 vsize=231168 CPUtime=4.29 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) R 6824 6826 6826 0 -1 4202496 53663 0 0 0 420 9 0 0 20 0 1 0 338567670 236716032 52944 33554432000 4194304 13684479 140735612790016 140735612785400 4880923 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 57792 52944 622 2317 0 55470 0
[pid=6818/tid=6825] ppid=6816 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338567670 376672256 9815 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 5.58
Current children cumulated vsize (KiB) 891076

[startup+12.7004 s]
/proc/loadavg: 2.08 2.04 2.26 3/192 6827
/proc/meminfo: memFree=25878692/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=367844 CPUtime=1.29 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 14604 1010 1 0 110 19 0 0 20 0 2 0 338567471 376672256 9815 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 91961 9815 1894 364 0 27184 0
[pid=6824] ppid=6818 vsize=292064 CPUtime=0.01 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 894 0 0 0 1 0 0 0 20 0 1 0 338567670 299073536 8277 33554432000 4194304 5683644 140734653965536 140734653956624 213419655592 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 73016 8277 362 364 0 8239 0
[pid=6826] ppid=6824 vsize=288008 CPUtime=10.69 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) R 6824 6826 6826 0 -1 4202496 67334 0 0 0 1057 12 0 0 20 0 1 0 338567670 294920192 66615 33554432000 4194304 13684479 140735612790016 140735612785400 4880912 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 72002 66615 622 2317 0 69680 0
[pid=6818/tid=6825] ppid=6816 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338567670 376672256 9815 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 11.99
Current children cumulated vsize (KiB) 947916

[startup+25.507 s]
/proc/loadavg: 2.07 2.04 2.25 3/192 6828
/proc/meminfo: memFree=25684764/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=367844 CPUtime=1.29 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 14604 1010 1 0 110 19 0 0 20 0 2 0 338567471 376672256 9815 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 91961 9815 1894 364 0 27184 0
[pid=6824] ppid=6818 vsize=292064 CPUtime=0.03 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 906 0 0 0 2 1 0 0 20 0 1 0 338567670 299073536 8278 33554432000 4194304 5683644 140734653965536 140734653956624 213419655592 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 73016 8278 363 364 0 8239 0
[pid=6826] ppid=6824 vsize=388404 CPUtime=23.49 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) R 6824 6826 6826 0 -1 4202496 92519 0 0 0 2330 19 0 0 20 0 1 0 338567670 397725696 91046 33554432000 4194304 13684479 140735612790016 140735612785400 4880923 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/6826/statm: 97101 91046 635 2317 0 94779 0
[pid=6818/tid=6825] ppid=6816 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338567670 376672256 9815 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 24.81
Current children cumulated vsize (KiB) 1048312

[startup+51.1004 s]
/proc/loadavg: 2.04 2.03 2.24 4/217 6853
/proc/meminfo: memFree=25215540/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=443636 CPUtime=1.31 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 15547 1010 1 0 112 19 0 0 20 0 3 0 338567471 454283264 9832 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/6818/statm: 110909 9832 1905 364 0 46129 0
[pid=6824] ppid=6818 vsize=367844 CPUtime=0.08 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 1155 0 0 0 5 3 0 0 20 0 2 0 338567670 376672256 8318 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 91961 8318 396 364 0 27184 0
[pid=6826] ppid=6824 vsize=570872 CPUtime=48.6 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) T 6824 6826 6826 0 -1 4202496 137929 0 0 0 4829 31 0 0 20 0 1 0 338567670 584572928 136456 33554432000 4194304 13684479 140735612790016 140735612786312 5688624 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 142718 136456 639 2317 0 140396 0
[pid=6824/tid=6850] ppid=6818 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6824/task/6850/stat : 6850 (python) S 6818 6818 3621 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338572534 376672256 8318 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6851] ppid=6818 vsize=367856 CPUtime=0 cores=0,2,4,6
/proc/6851/stat : 6851 (python) S 6818 6818 3621 0 -1 4202560 753 0 0 0 0 0 0 0 20 0 1 0 338572536 376684544 8253 33554432000 4194304 5683644 140734653965536 140734653956624 213419655651 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/6851/statm: 91964 8253 332 364 0 27184 0
[pid=6853] ppid=6851 vsize=8776 CPUtime=0.44 cores=0,2,4,6
/proc/6853/stat : 6853 (clasp-1.3.7-x86) R 6851 6853 6853 0 -1 4202496 2556 0 0 0 44 0 0 0 20 0 1 0 338572536 8986624 1937 33554432000 134512640 136139019 4286790304 4286789168 134608389 0 0 16781312 16386 0 0 0 17 4 0 0 0 0 0
/proc/6853/statm: 2194 1937 182 398 0 1794 0
[pid=6818/tid=6825] ppid=6816 vsize=443636 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 3 0 338567670 454283264 9832 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6818/tid=6852] ppid=6816 vsize=443636 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6852/stat : 6852 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 3 0 338572536 454283264 9832 33554432000 4194304 5683644 140734653965536 140118397379120 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.43
Current children cumulated vsize (KiB) 1758984

[startup+102.301 s]
/proc/loadavg: 1.98 2.02 2.23 3/222 6858
/proc/meminfo: memFree=23010892/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=519428 CPUtime=1.35 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 16508 1010 1 0 115 20 0 0 20 0 4 0 338567471 531894272 9840 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6818/statm: 129857 9840 1907 364 0 65074 0
[pid=6824] ppid=6818 vsize=367844 CPUtime=0.08 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 1155 0 0 0 5 3 0 0 20 0 2 0 338567670 376672256 8318 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 91961 8318 396 364 0 27184 0
[pid=6826] ppid=6824 vsize=570872 CPUtime=48.6 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) T 6824 6826 6826 0 -1 4202496 137929 0 0 0 4829 31 0 0 20 0 1 0 338567670 584572928 136456 33554432000 4194304 13684479 140735612790016 140735612786312 5688624 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 142718 136456 639 2317 0 140396 0
[pid=6824/tid=6850] ppid=6818 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6824/task/6850/stat : 6850 (python) S 6818 6818 3621 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338572534 376672256 8318 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6851] ppid=6818 vsize=367856 CPUtime=0.08 cores=0,2,4,6
/proc/6851/stat : 6851 (python) S 6818 6818 3621 0 -1 4202560 1089 0 0 0 4 4 0 0 20 0 2 0 338572536 376684544 8305 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6851/statm: 91964 8305 383 364 0 27184 0
[pid=6853] ppid=6851 vsize=12208 CPUtime=47.12 cores=0,2,4,6
/proc/6853/stat : 6853 (clasp-1.3.7-x86) T 6851 6853 6853 0 -1 4202496 3420 0 0 0 4712 0 0 0 20 0 1 0 338572536 12500992 2801 33554432000 134512640 136139019 4286790304 4286789280 134883785 0 0 16781312 16386 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/6853/statm: 3052 2801 182 398 0 2652 0
[pid=6851/tid=6855] ppid=6818 vsize=367856 CPUtime=0 cores=0,2,4,6
/proc/6851/task/6855/stat : 6855 (python) S 6818 6818 3621 0 -1 4202560 53 0 0 0 0 0 0 0 20 0 2 0 338577250 376684544 8305 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6856] ppid=6818 vsize=443648 CPUtime=0 cores=0,2,4,6
/proc/6856/stat : 6856 (python) S 6818 6818 3621 0 -1 4202560 929 0 0 0 0 0 0 0 20 0 1 0 338577253 454295552 8285 33554432000 4194304 5683644 140734653965536 140734653956624 213419655651 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6856/statm: 110912 8285 358 364 0 46129 0
[pid=6858] ppid=6856 vsize=233412 CPUtime=4.46 cores=0,2,4,6
/proc/6858/stat : 6858 (scip-2.0.1.linu) R 6856 6858 6858 0 -1 4202496 54050 0 0 0 437 9 0 0 20 0 1 0 338577253 239013888 53330 33554432000 4194304 15243407 140736728550592 140736728545976 4880923 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6858/statm: 58353 53330 669 2698 0 55648 0
[pid=6818/tid=6825] ppid=6816 vsize=519428 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 4 0 338567670 531894272 9840 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6818/tid=6852] ppid=6816 vsize=519428 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=6818/tid=6852] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6852/stat : 6852 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 7 0 338572536 764727296 9864 33554432000 4194304 5683644 140734653965536 140118397379120 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6818/tid=6857] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6857/stat : 6857 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338577253 764727296 9864 33554432000 4194304 5683644 140734653965536 140118386889264 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6818/tid=6885] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6885/stat : 6885 (python) S 6816 6818 3621 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 7 0 338586761 764727296 9864 33554432000 4194304 5683644 140734653965536 140118376399408 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6818/tid=6960] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6960/stat : 6960 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338596272 764727296 9864 33554432000 4194304 5683644 140734653965536 140118365909552 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6818/tid=6969] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6969/stat : 6969 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338601068 764727296 9864 33554432000 4194304 5683644 140734653965536 140118355419696 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 339.69
Current children cumulated vsize (KiB) 24850300

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+336.701 s]
/proc/loadavg: 2.06 2.05 2.18 5/247 6988
/proc/meminfo: memFree=22215764/32873844 swapFree=6608/6608
[pid=6818] ppid=6816 vsize=746804 CPUtime=3.62 cores=0,2,4,6
/proc/6818/stat : 6818 (python) S 6816 6818 3621 0 -1 4202496 19520 1010 1 0 341 21 0 0 20 0 7 0 338567471 764727296 9864 33554432000 4194304 5683644 140734653965536 140734653960368 213423023373 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6818/statm: 186701 9864 1913 364 0 121909 0
[pid=6824] ppid=6818 vsize=367844 CPUtime=0.08 cores=0,2,4,6
/proc/6824/stat : 6824 (python) S 6818 6818 3621 0 -1 4202560 1155 0 0 0 5 3 0 0 20 0 2 0 338567670 376672256 8318 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6824/statm: 91961 8318 396 364 0 27184 0
[pid=6826] ppid=6824 vsize=570872 CPUtime=48.6 cores=0,2,4,6
/proc/6826/stat : 6826 (scip-2.0.1.linu) T 6824 6826 6826 0 -1 4202496 137929 0 0 0 4829 31 0 0 20 0 1 0 338567670 584572928 137562 33554432000 4194304 13684479 140735612790016 140735612786312 5688624 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6826/statm: 142718 137562 639 2317 0 140396 0
[pid=6824/tid=6850] ppid=6818 vsize=367844 CPUtime=0 cores=0,2,4,6
/proc/6824/task/6850/stat : 6850 (python) S 6818 6818 3621 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338572534 376672256 8318 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6851] ppid=6818 vsize=367856 CPUtime=0.17 cores=0,2,4,6
/proc/6851/stat : 6851 (python) S 6818 6818 3621 0 -1 4202560 1152 0 0 0 9 8 0 0 20 0 2 0 338572536 376684544 8305 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6851/statm: 91964 8305 383 364 0 27184 0
[pid=6853] ppid=6851 vsize=14316 CPUtime=92.25 cores=0,2,4,6
/proc/6853/stat : 6853 (clasp-1.3.7-x86) T 6851 6853 6853 0 -1 4202496 3933 0 0 0 9225 0 0 0 20 0 1 0 338572536 14659584 3314 33554432000 134512640 136139019 4286790304 4286789280 134883787 0 0 16781312 16386 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/6853/statm: 3579 3314 182 398 0 3179 0
[pid=6851/tid=6855] ppid=6818 vsize=367856 CPUtime=0 cores=0,2,4,6
/proc/6851/task/6855/stat : 6855 (python) S 6818 6818 3621 0 -1 4202560 53 0 0 0 0 0 0 0 20 0 2 0 338577250 376684544 8305 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6856] ppid=6818 vsize=443648 CPUtime=0.15 cores=0,2,4,6
/proc/6856/stat : 6856 (python) S 6818 6818 3621 0 -1 4202560 1169 0 0 0 8 7 0 0 20 0 2 0 338577253 454295552 8311 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6856/statm: 110912 8311 383 364 0 46129 0
[pid=6858] ppid=6856 vsize=844380 CPUtime=94.97 cores=0,2,4,6
/proc/6858/stat : 6858 (scip-2.0.1.linu) T 6856 6858 6858 0 -1 4202496 204713 0 0 0 9432 65 0 0 20 0 1 0 338577253 864645120 203710 33554432000 4194304 15243407 140736728550592 140736728546680 6392692 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/6858/statm: 211095 203710 885 2698 0 208390 0
[pid=6856/tid=6862] ppid=6818 vsize=443648 CPUtime=0 cores=0,2,4,6
/proc/6856/task/6862/stat : 6862 (python) S 6818 6818 3621 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338582230 454295552 8311 33554432000 4194304 5683644 140734653965536 140118397379120 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6884] ppid=6818 vsize=519440 CPUtime=0.07 cores=0,2,4,6
/proc/6884/stat : 6884 (python) S 6818 6818 3621 0 -1 4202560 1131 0 0 0 4 3 0 0 20 0 2 0 338586761 531906560 8317 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6884/statm: 129860 8317 383 364 0 65074 0
[pid=6886] ppid=6884 vsize=9624972 CPUtime=50.22 cores=0,2,4,6
/proc/6886/stat : 6886 (java) T 6884 6886 6886 0 -1 4202496 22636 0 1 0 4965 57 0 0 20 0 19 0 338586761 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140733681838384 213422997565 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6886/statm: 2406243 531840 2268 9 0 2396937 0
[pid=6886/tid=6887] ppid=6884 vsize=9624972 CPUtime=47.37 cores=0,2,4,6
/proc/6886/task/6887/stat : 6887 (java) T 6884 6886 6886 0 -1 4202560 3886 0 1 0 4699 38 0 0 20 0 19 0 338586762 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623831649216 140623689478882 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6888] ppid=6884 vsize=9624972 CPUtime=0.08 cores=0,2,4,6
/proc/6886/task/6888/stat : 6888 (java) T 6884 6886 6886 0 -1 4202560 49 0 0 0 6 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623809751336 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6889] ppid=6884 vsize=9624972 CPUtime=0.06 cores=0,2,4,6
/proc/6886/task/6889/stat : 6889 (java) T 6884 6886 6886 0 -1 4202560 34 0 0 0 6 0 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623808698536 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6890] ppid=6884 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/6886/task/6890/stat : 6890 (java) T 6884 6886 6886 0 -1 4202560 41 0 0 0 7 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623807646248 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6891] ppid=6884 vsize=9624972 CPUtime=0.07 cores=0,2,4,6
/proc/6886/task/6891/stat : 6891 (java) T 6884 6886 6886 0 -1 4202560 34 0 0 0 5 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623470389672 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6892] ppid=6884 vsize=9624972 CPUtime=0.07 cores=0,2,4,6
/proc/6886/task/6892/stat : 6892 (java) T 6884 6886 6886 0 -1 4202560 30 0 0 0 5 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623469337384 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6886/tid=6893] ppid=6884 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/6886/task/6893/stat : 6893 (java) T 6884 6886 6886 0 -1 4202560 41 0 0 0 7 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623468284584 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6886/tid=6894] ppid=6884 vsize=9624972 CPUtime=0.06 cores=0,2,4,6
/proc/6886/task/6894/stat : 6894 (java) T 6884 6886 6886 0 -1 4202560 28 0 0 0 4 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623467232296 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6886/tid=6895] ppid=6884 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/6886/task/6895/stat : 6895 (java) T 6884 6886 6886 0 -1 4202560 59 0 0 0 7 2 0 0 20 0 19 0 338586763 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623466179496 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6896] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6896/stat : 6896 (java) T 6884 6886 6886 0 -1 4202560 945 0 0 0 0 0 0 0 20 0 19 0 338586764 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623453980904 213423011753 0 0 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6886/tid=6897] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6897/stat : 6897 (java) T 6884 6886 6886 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338586764 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623452926968 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6898] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6898/stat : 6898 (java) T 6884 6886 6886 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338586764 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623451874568 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6899] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6899/stat : 6899 (java) T 6884 6886 6886 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338586767 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623450823056 213423019808 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6900] ppid=6884 vsize=9624972 CPUtime=1.03 cores=0,2,4,6
/proc/6886/task/6900/stat : 6900 (java) T 6884 6886 6886 0 -1 4202560 5972 0 0 0 101 2 0 0 20 0 19 0 338586767 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623449770680 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6901] ppid=6884 vsize=9624972 CPUtime=0.93 cores=0,2,4,6
/proc/6886/task/6901/stat : 6901 (java) T 6884 6886 6886 0 -1 4202560 10099 0 0 0 91 2 0 0 20 0 19 0 338586767 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623448717880 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6902] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6902/stat : 6902 (java) T 6884 6886 6886 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338586767 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623447665784 213423010876 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6903] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6903/stat : 6903 (java) T 6884 6886 6886 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338586767 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623446613192 213423011753 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6886/tid=6908] ppid=6884 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6886/task/6908/stat : 6908 (java) T 6884 6886 6886 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 338586827 9855971328 531840 33554432000 1073741824 1073778376 140733681847248 140623445529512 213423011753 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6884/tid=6954] ppid=6818 vsize=519440 CPUtime=0 cores=0,2,4,6
/proc/6884/task/6954/stat : 6954 (python) S 6818 6818 3621 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338591538 531906560 8317 33554432000 4194304 5683644 140734653965536 140118386889264 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6959] ppid=6818 vsize=595232 CPUtime=0.08 cores=0,2,4,6
/proc/6959/stat : 6959 (python) S 6818 6818 3621 0 -1 4202560 1164 0 0 0 5 3 0 0 20 0 2 0 338596272 609517568 8323 33554432000 4194304 5683644 140734653965536 140734653957184 213423023373 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6959/statm: 148808 8323 383 364 0 84019 0
[pid=6961] ppid=6959 vsize=458940 CPUtime=47.92 cores=0,2,4,6
/proc/6961/stat : 6961 (minion) T 6959 6961 6961 0 -1 4202496 102950 0 0 0 4778 14 0 0 20 0 1 0 338596272 469954560 107325 33554432000 134512640 165565024 4291466496 4291463728 159737071 0 0 16781312 8396802 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/6961/statm: 114735 107325 336 7582 0 107150 0
[pid=6959/tid=6967] ppid=6818 vsize=595232 CPUtime=0 cores=0,2,4,6
/proc/6959/task/6967/stat : 6967 (python) S 6818 6818 3621 0 -1 4202560 52 0 0 0 0 0 0 0 20 0 2 0 338601066 609517568 8323 33554432000 4194304 5683644 140734653965536 140118376399408 213423019808 0 0 16781312 33554946 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6968] ppid=6818 vsize=671024 CPUtime=0 cores=0,2,4,6
/proc/6968/stat : 6968 (python) S 6818 6818 3621 0 -1 4202560 870 0 0 0 0 0 0 0 20 0 1 0 338601068 687128576 8280 33554432000 4194304 5683644 140734653965536 140734653956624 213419655651 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/6968/statm: 167756 8280 335 364 0 102964 0
[pid=6970] ppid=6968 vsize=9624972 CPUtime=1.56 cores=0,2,4,6
/proc/6970/stat : 6970 (java) S 6968 6970 6970 0 -1 4202496 9475 0 1 0 151 5 0 0 20 0 19 0 338601069 9855971328 42000 33554432000 1073741824 1073778376 140734217922176 140734217913312 213422997565 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6970/statm: 2406243 42000 2262 9 0 2396937 0
[pid=6970/tid=6971] ppid=6968 vsize=9624972 CPUtime=0.68 cores=0,2,4,6
/proc/6970/task/6971/stat : 6971 (java) R 6968 6970 6970 0 -1 4202560 2548 0 1 0 64 4 0 0 20 0 19 0 338601070 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139812057381808 139811997148749 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6972] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6972/stat : 6972 (java) S 6968 6970 6970 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811996125992 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6970/tid=6973] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6973/stat : 6973 (java) S 6968 6970 6970 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811995073192 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6974] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6974/stat : 6974 (java) S 6968 6970 6970 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811994020904 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6970/tid=6975] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6975/stat : 6975 (java) S 6968 6970 6970 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811992968104 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6970/tid=6976] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6976/stat : 6976 (java) S 6968 6970 6970 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811991914792 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6970/tid=6977] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6977/stat : 6977 (java) S 6968 6970 6970 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811895326888 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6978] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6978/stat : 6978 (java) S 6968 6970 6970 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811894274600 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6970/tid=6979] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6979/stat : 6979 (java) S 6968 6970 6970 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338601071 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811893221800 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6980] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6980/stat : 6980 (java) S 6968 6970 6970 0 -1 4202560 73 0 0 0 0 0 0 0 20 0 19 0 338601072 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811881024232 213423011753 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6970/tid=6981] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6981/stat : 6981 (java) S 6968 6970 6970 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338601073 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811879970296 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6970/tid=6982] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6982/stat : 6982 (java) S 6968 6970 6970 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338601073 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811878917896 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6970/tid=6983] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6983/stat : 6983 (java) S 6968 6970 6970 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338601075 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811877866384 213423019808 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6970/tid=6984] ppid=6968 vsize=9624972 CPUtime=0.41 cores=0,2,4,6
/proc/6970/task/6984/stat : 6984 (java) R 6968 6970 6970 0 -1 4202560 2597 0 0 0 41 0 0 0 20 0 19 0 338601075 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811876800384 139812065130069 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0
[pid=6970/tid=6985] ppid=6968 vsize=9624972 CPUtime=0.39 cores=0,2,4,6
/proc/6970/task/6985/stat : 6985 (java) R 6968 6970 6970 0 -1 4202560 2814 0 0 0 39 0 0 0 20 0 19 0 338601075 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811875760184 213423022517 0 4 0 16800975 0 0 0 -1 4 0 0 0 0 0
[pid=6970/tid=6986] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6986/stat : 6986 (java) S 6968 6970 6970 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338601075 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811874708088 213423010876 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6987] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6987/stat : 6987 (java) S 6968 6970 6970 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338601075 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811873655496 213423011753 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6970/tid=6988] ppid=6968 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6970/task/6988/stat : 6988 (java) S 6968 6970 6970 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 338601135 9855971328 42001 33554432000 1073741824 1073778376 140734217922176 139811872601512 213423011753 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6818/tid=6825] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6825/stat : 6825 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 7 0 338567670 764727296 9864 33554432000 4194304 5683644 140734653965536 140118407868976 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6818/tid=6852] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6852/stat : 6852 (python) S 6816 6818 3621 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 7 0 338572536 764727296 9864 33554432000 4194304 5683644 140734653965536 140118397379120 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6818/tid=6857] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6857/stat : 6857 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338577253 764727296 9864 33554432000 4194304 5683644 140734653965536 140118386889264 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6818/tid=6885] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6885/stat : 6885 (python) S 6816 6818 3621 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 7 0 338586761 764727296 9864 33554432000 4194304 5683644 140734653965536 140118376399408 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6818/tid=6960] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6960/stat : 6960 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338596272 764727296 9864 33554432000 4194304 5683644 140734653965536 140118365909552 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6818/tid=6969] ppid=6816 vsize=746804 CPUtime=0 cores=0,2,4,6
/proc/6818/task/6969/stat : 6969 (python) S 6816 6818 3621 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 7 0 338601068 764727296 9864 33554432000 4194304 5683644 140734653965536 140118355419696 213423019808 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 339.69
Current children cumulated vsize (KiB) 24850300

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6818 and gives
#  childrusage.ru_utime.tv_sec=3
#  childrusage.ru_utime.tv_usec=419480
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=220966
# CPU time returned by wait4() is 3.64045
# while last known CPU time is 339.69
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 336.761
CPU time (s): 339.69
CPU user time (s): 337.52
CPU system time (s): 2.17
CPU usage (%): 100.87
Max. virtual memory (cumulated for all children) (KiB): 24850300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.41948
system time used= 0.220966
maximum resident set size= 40468
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20530
page faults= 1
swaps= 0
block input operations= 0
block output operations= 4704
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2063
involuntary context switches= 17

runsolver used 1.48177 second user time and 2.92556 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-03 13:53:45
IDJOB=3742304
IDBENCH=90154
IDSOLVER=2327
FILE ID=node140/3742304-1338724429
RUNJOBID= node140-1338713222-3637
PBS_JOBID= 14636725
Free space on /tmp= 70524 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K196.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742304-1338724429/watcher-3742304-1338724429 -o /tmp/evaluation-result-3742304-1338724429/solver-3742304-1338724429 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742304-1338724429.opb -seed 159981115 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bcce2e1d61aa4147a6a5a8b58d6d164e
RANDOM SEED=159981115

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26281584 kB
Buffers:          483592 kB
Cached:          4127652 kB
SwapCached:         1620 kB
Active:          2702728 kB
Inactive:        2952108 kB
Active(anon):    1034600 kB
Inactive(anon):    11328 kB
Active(file):    1668128 kB
Inactive(file):  2940780 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:            103316 kB
Writeback:             0 kB
AnonPages:       1048532 kB
Mapped:            22780 kB
Shmem:                56 kB
Slab:             792520 kB
SReclaimable:     233152 kB
SUnreclaim:       559368 kB
KernelStack:        1536 kB
PageTables:         8476 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1355924 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70420 MiB
End job on node140 at 2012-06-03 13:59:25