Trace number 3742291

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 286.02 283.763

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K176.opb
MD5SUM3f678424628fecb2a53891618f9bde8f
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables20944
Total number of constraints21298
Number of constraints which are clauses21122
Number of constraints which are cardinality constraints (but not clauses)176
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint176
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 177
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.39/1.25	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.39/1.25	c INFO: solving HOME/instance-3742291-1338724413.opb
0.58/1.47	c INFO: parsing took 0.22 s
1.08/1.91	c INFO: features took 0.43 CPU seconds
1.08/1.94	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.59)
47.61/48.45	c INFO: running clasp-1.3.7@0 for 45 with 1752 remaining (b = 0.45)
94.86/95.60	c INFO: running scip-2.0.1-clp@0 for 45 with 1705 remaining (b = 0.08)
144.22/144.90	c INFO: running scip-2.0.1-clp@48 for 45 with 1656 remaining (b = 0.01)
189.67/190.37	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1611 remaining (b = 0.04)
239.99/238.13	c INFO: running clasp-1.3.7@47 for 45 with 1562 remaining (b = 0.01)
285.17/283.27	c INFO: running sat4j-pb-v20101225@0 for 45 with 1516 remaining (b = 0.16)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742291-1338724413/watcher-3742291-1338724413 -o /tmp/evaluation-result-3742291-1338724413/solver-3742291-1338724413 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742291-1338724413.opb -seed 1630958437 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.02 2.06 2/218 2595
/proc/meminfo: memFree=24366548/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=15276 CPUtime=0 cores=0,2,4,6
/proc/2595/stat : 2595 (python) R 2593 2595 27000 0 -1 4202496 673 0 0 0 0 0 0 0 20 0 1 0 338568823 15642624 560 33554432000 4194304 5683644 140734912118304 140734912086248 219513963408 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 3819 560 324 364 0 261 0

[startup+0.037364 s]
/proc/loadavg: 2.04 2.02 2.06 2/218 2595
/proc/meminfo: memFree=24366548/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=15972 CPUtime=0 cores=0,2,4,6
/proc/2595/stat : 2595 (python) D 2593 2595 27000 0 -1 4202496 976 0 0 0 0 0 0 0 20 0 1 0 338568823 16355328 820 33554432000 4194304 5683644 140734912118304 140734912088488 219513963408 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 3993 820 367 364 0 435 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15972

[startup+0.100297 s]
/proc/loadavg: 2.04 2.02 2.06 2/218 2595
/proc/meminfo: memFree=24366548/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=19084 CPUtime=0.02 cores=0,2,4,6
/proc/2595/stat : 2595 (python) R 2593 2595 27000 0 -1 4202496 1396 0 0 0 2 0 0 0 20 0 1 0 338568823 19542016 1150 33554432000 4194304 5683644 140734912118304 140734912048808 4865427 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 4771 1150 430 364 0 695 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19084

[startup+0.300297 s]
/proc/loadavg: 2.04 2.02 2.06 2/218 2595
/proc/meminfo: memFree=24366548/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=96916 CPUtime=0.12 cores=0,2,4,6
/proc/2595/stat : 2595 (python) R 2593 2595 27000 0 -1 4202496 3958 1009 1 0 9 3 0 0 20 0 1 0 338568823 99241984 2653 33554432000 4194304 5683644 140734912118304 140734911990904 219513963408 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 24229 2653 823 364 0 1720 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 96916

[startup+0.70028 s]
/proc/loadavg: 2.04 2.02 2.06 2/218 2595
/proc/meminfo: memFree=24366548/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=138348 CPUtime=0.22 cores=0,2,4,6
/proc/2595/stat : 2595 (python) D 2593 2595 27000 0 -1 4202496 6248 1009 1 0 15 7 0 0 20 0 1 0 338568823 141668352 4085 33554432000 4194304 5683644 140734912118304 140734912018296 219513963408 0 0 16781312 2 18446744072100609316 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 34587 4085 1098 364 0 2953 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 138348

[startup+1.50026 s]
/proc/loadavg: 2.04 2.02 2.06 3/219 2600
/proc/meminfo: memFree=24349816/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=290412 CPUtime=0.68 cores=0,2,4,6
/proc/2595/stat : 2595 (python) R 2593 2595 27000 0 -1 4202496 13748 1009 1 0 56 12 0 0 20 0 1 0 338568823 297381888 9355 33554432000 4194304 5683644 140734912118304 140734912108728 4324486 0 0 16781312 33554434 0 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 72603 9355 1846 364 0 7832 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 290412

[startup+3.10032 s]
/proc/loadavg: 2.04 2.02 2.06 3/222 2603
/proc/meminfo: memFree=24306524/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=366716 CPUtime=1.12 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 14164 1009 1 0 99 13 0 0 20 0 2 0 338568823 375517184 9542 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 91679 9542 1902 364 0 26902 0
[pid=2601] ppid=2595 vsize=290936 CPUtime=0 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 771 0 0 0 0 0 0 0 20 0 1 0 338569017 297918464 7974 33554432000 4194304 5683644 140734912118304 140734912109392 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/2601/statm: 72734 7974 340 364 0 7957 0
[pid=2603] ppid=2601 vsize=157232 CPUtime=1.15 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) R 2601 2603 2603 0 -1 4202496 36979 0 0 0 104 11 0 0 20 0 1 0 338569017 161005568 36016 33554432000 4194304 13684479 140735818898992 140735818894376 4880915 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 39308 36016 635 2317 0 36986 0
[pid=2595/tid=2602] ppid=2593 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 338569017 375517184 9542 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 2.27
Current children cumulated vsize (KiB) 814884
heavy processes:

[startup+6.30038 s]
/proc/loadavg: 2.04 2.02 2.06 3/222 2603
/proc/meminfo: memFree=24129444/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=366716 CPUtime=1.12 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 14164 1009 1 0 99 13 0 0 20 0 2 0 338568823 375517184 9542 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 91679 9542 1902 364 0 26902 0
[pid=2601] ppid=2595 vsize=290936 CPUtime=0 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 896 0 0 0 0 0 0 0 20 0 1 0 338569017 297918464 7997 33554432000 4194304 5683644 140734912118304 140734912109392 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 72734 7997 363 364 0 7957 0
[pid=2603] ppid=2601 vsize=222288 CPUtime=4.34 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) R 2601 2603 2603 0 -1 4202496 52237 0 0 0 420 14 0 0 20 0 1 0 338569017 227622912 51274 33554432000 4194304 13684479 140735818898992 140735818894376 4880923 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 55572 51274 635 2317 0 53250 0
[pid=2595/tid=2602] ppid=2593 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 338569017 375517184 9542 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 5.46
Current children cumulated vsize (KiB) 879940

[startup+12.7004 s]
/proc/loadavg: 2.03 2.02 2.06 3/225 2606
/proc/meminfo: memFree=24042380/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=366716 CPUtime=1.12 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 14164 1009 1 0 99 13 0 0 20 0 2 0 338568823 375517184 9542 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 91679 9542 1902 364 0 26902 0
[pid=2601] ppid=2595 vsize=290936 CPUtime=0.01 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 899 0 0 0 1 0 0 0 20 0 1 0 338569017 297918464 7997 33554432000 4194304 5683644 140734912118304 140734912109392 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 72734 7997 363 364 0 7957 0
[pid=2603] ppid=2601 vsize=307092 CPUtime=10.74 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) R 2601 2603 2603 0 -1 4202496 72269 0 0 0 1057 17 0 0 20 0 1 0 338569017 314462208 71306 33554432000 4194304 13684479 140735818898992 140735818894376 4880933 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 76773 71306 635 2317 0 74451 0
[pid=2595/tid=2602] ppid=2593 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 338569017 375517184 9542 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 11.87
Current children cumulated vsize (KiB) 964744

[startup+25.5004 s]
/proc/loadavg: 2.02 2.02 2.06 3/225 2606
/proc/meminfo: memFree=23942196/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=366716 CPUtime=1.12 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 14164 1009 1 0 99 13 0 0 20 0 2 0 338568823 375517184 9542 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2595/statm: 91679 9542 1902 364 0 26902 0
[pid=2601] ppid=2595 vsize=290936 CPUtime=0.03 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 1003 0 0 0 2 1 0 0 20 0 1 0 338569017 297918464 8002 33554432000 4194304 5683644 140734912118304 140734912109392 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 72734 8002 368 364 0 7957 0
[pid=2603] ppid=2601 vsize=369140 CPUtime=23.54 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) R 2601 2603 2603 0 -1 4202496 87390 0 0 0 2333 21 0 0 20 0 1 0 338569017 377999360 86427 33554432000 4194304 13684479 140735818898992 140735818895304 5110617 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 92285 86427 635 2317 0 89963 0
[pid=2595/tid=2602] ppid=2593 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 2 0 338569017 375517184 9542 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 24.69
Current children cumulated vsize (KiB) 1026792

[startup+51.1004 s]
/proc/loadavg: 2.02 2.02 2.06 3/229 2610
/proc/meminfo: memFree=23668520/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=442508 CPUtime=1.15 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 15091 1009 1 0 102 13 0 0 20 0 3 0 338568823 453128192 10059 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/2595/statm: 110627 10059 1905 364 0 45847 0
[pid=2601] ppid=2595 vsize=366716 CPUtime=0.07 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 1156 0 0 0 4 3 0 0 20 0 2 0 338569017 375517184 8037 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 91679 8037 396 364 0 26902 0
[pid=2603] ppid=2601 vsize=582388 CPUtime=46.45 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) T 2601 2603 2603 0 -1 4202496 140527 0 0 0 4604 41 0 0 20 0 1 0 338569017 596365312 139564 33554432000 4194304 13684479 140735818898992 140735818895304 4880933 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 145597 139564 639 2317 0 143275 0
[pid=2601/tid=2607] ppid=2595 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2601/task/2607/stat : 2607 (python) S 2595 2595 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338573666 375517184 8037 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2608] ppid=2595 vsize=366728 CPUtime=0 cores=0,2,4,6
/proc/2608/stat : 2608 (python) S 2595 2595 27000 0 -1 4202560 779 0 0 0 0 0 0 0 20 0 1 0 338573668 375529472 7975 33554432000 4194304 5683644 140734912118304 140734912109392 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/2608/statm: 91682 7975 335 364 0 26902 0
[pid=2610] ppid=2608 vsize=8056 CPUtime=2.63 cores=0,2,4,6
/proc/2610/stat : 2610 (clasp-1.3.7-x86) R 2608 2610 2610 0 -1 4202496 2350 0 0 0 263 0 0 0 20 0 1 0 338573668 8249344 1772 33554432000 134512640 136139019 4293692272 4293691248 134883494 0 0 16781312 16386 0 0 0 17 2 0 0 0 0 0
/proc/2610/statm: 2014 1772 182 398 0 1614 0
[pid=2595/tid=2602] ppid=2593 vsize=442508 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 3 0 338569017 453128192 10059 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2595/tid=2609] ppid=2593 vsize=442508 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2609/stat : 2609 (python) S 2593 2595 27000 0 -1 4202560 19 1009 0 0 0 0 0 0 20 0 3 0 338573668 453128192 10059 33554432000 4194304 5683644 140734912118304 140211489071664 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 50.3
Current children cumulated vsize (KiB) 1766396

[startup+102.307 s]
/proc/loadavg: 2.05 2.03 2.06 3/191 2665
/proc/meminfo: memFree=25614916/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=518300 CPUtime=1.17 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 15980 1009 1 0 104 13 0 0 20 0 4 0 338568823 530739200 10067 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/2595/statm: 129575 10067 1907 364 0 64792 0
[pid=2601] ppid=2595 vsize=366716 CPUtime=0.07 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 1156 0 0 0 4 3 0 0 20 0 2 0 338569017 375517184 8037 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 91679 8037 396 364 0 26902 0
[pid=2603] ppid=2601 vsize=582388 CPUtime=46.45 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) T 2601 2603 2603 0 -1 4202496 140527 0 0 0 4604 41 0 0 20 0 1 0 338569017 596365312 139564 33554432000 4194304 13684479 140735818898992 140735818895304 4880933 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 145597 139564 639 2317 0 143275 0
[pid=2601/tid=2607] ppid=2595 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2601/task/2607/stat : 2607 (python) S 2595 2595 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338573666 375517184 8037 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2608] ppid=2595 vsize=366728 CPUtime=0.07 cores=0,2,4,6
/proc/2608/stat : 2608 (python) S 2595 2595 27000 0 -1 4202560 1107 0 0 0 4 3 0 0 20 0 2 0 338573668 375529472 8024 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/2608/statm: 91682 8024 383 364 0 26902 0
[pid=2610] ppid=2608 vsize=15680 CPUtime=47.1 cores=0,2,4,6
/proc/2610/stat : 2610 (clasp-1.3.7-x86) T 2608 2610 2610 0 -1 4202496 4219 0 0 0 4710 0 0 0 20 0 1 0 338573668 16056320 3641 33554432000 134512640 136139019 4293692272 4293691024 134871304 0 0 16781312 16386 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/2610/statm: 3920 3641 182 398 0 3520 0
[pid=2608/tid=2662] ppid=2595 vsize=366728 CPUtime=0 cores=0,2,4,6
/proc/2608/task/2662/stat : 2662 (python) S 2595 2595 27000 0 -1 4202560 54 0 0 0 0 0 0 0 20 0 2 0 338578381 375529472 8024 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2663] ppid=2595 vsize=442520 CPUtime=0 cores=0,2,4,6
/proc/2663/stat : 2663 (python) S 2595 2595 27000 0 -1 4202560 927 0 0 0 0 0 0 0 20 0 1 0 338578383 453140480 8512 33554432000 4194304 5683644 140734912118304 140734912109392 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/2663/statm: 110630 8512 358 364 0 45847 0
[pid=2665] ppid=2663 vsize=266688 CPUtime=6.68 cores=0,2,4,6
/proc/2665/stat : 2665 (scip-2.0.1.linu) R 2663 2665 2665 0 -1 4202496 62957 0 0 0 654 14 0 0 20 0 1 0 338578384 273088512 61488 33554432000 4194304 15243407 140736920908784 140736920904168 4880915 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/2665/statm: 66672 61488 682 2698 0 63967 0
[pid=2595/tid=2602] ppid=2593 vsize=518300 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 4 0 338569017 530739200 10067 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2595/tid=2609] ppid=2593 vsize=518300 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=2722/tid=2734] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2734/stat : 2734 (java) S 2720 2722 2722 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 338597154 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940753401608 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2735] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2735/stat : 2735 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940752350096 219517343520 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2736] ppid=2720 vsize=9558408 CPUtime=0.18 cores=0,2,4,6
/proc/2722/task/2736/stat : 2736 (java) R 2720 2722 2722 0 -1 4202560 2571 0 0 0 18 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940751273816 139941139265364 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2737] ppid=2720 vsize=9558408 CPUtime=0.15 cores=0,2,4,6
/proc/2722/task/2737/stat : 2737 (java) R 2720 2722 2722 0 -1 4202560 2242 0 0 0 15 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940750221016 139941135485874 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0
[pid=2722/tid=2738] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2738/stat : 2738 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940749191800 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2722/tid=2739] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2739/stat : 2739 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940748139208 219517335465 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2595/tid=2602] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 6 0 338569017 685961216 10083 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2595/tid=2609] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2609/stat : 2609 (python) S 2593 2595 27000 0 -1 4202560 23 1009 0 0 0 0 0 0 20 0 6 0 338573668 685961216 10083 33554432000 4194304 5683644 140734912118304 140211489071664 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2595/tid=2664] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2664/stat : 2664 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338578384 685961216 10083 33554432000 4194304 5683644 140734912118304 140211478581808 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2595/tid=2676] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2676/stat : 2676 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338587861 685961216 10083 33554432000 4194304 5683644 140734912118304 140211468091952 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2595/tid=2721] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2721/stat : 2721 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338597150 685961216 10083 33554432000 4194304 5683644 140734912118304 140211457602096 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 286.02
Current children cumulated vsize (KiB) 23578748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+283.701 s]
/proc/loadavg: 2.06 2.04 2.06 5/264 2739
/proc/meminfo: memFree=20861868/32873648 swapFree=7120/7120
[pid=2595] ppid=2593 vsize=669884 CPUtime=1.27 cores=0,2,4,6
/proc/2595/stat : 2595 (python) S 2593 2595 27000 0 -1 4202496 17887 1009 1 0 113 14 0 0 20 0 6 0 338568823 685961216 10083 33554432000 4194304 5683644 140734912118304 140734912113136 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/2595/statm: 167471 10083 1911 364 0 102682 0
[pid=2601] ppid=2595 vsize=366716 CPUtime=0.07 cores=0,2,4,6
/proc/2601/stat : 2601 (python) S 2595 2595 27000 0 -1 4202560 1156 0 0 0 4 3 0 0 20 0 2 0 338569017 375517184 8037 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2601/statm: 91679 8037 396 364 0 26902 0
[pid=2603] ppid=2601 vsize=582388 CPUtime=46.45 cores=0,2,4,6
/proc/2603/stat : 2603 (scip-2.0.1.linu) T 2601 2603 2603 0 -1 4202496 140527 0 0 0 4604 41 0 0 20 0 1 0 338569017 596365312 142119 33554432000 4194304 13684479 140735818898992 140735818895304 4880933 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/2603/statm: 145597 142119 639 2317 0 143275 0
[pid=2601/tid=2607] ppid=2595 vsize=366716 CPUtime=0 cores=0,2,4,6
/proc/2601/task/2607/stat : 2607 (python) S 2595 2595 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338573666 375517184 8037 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2608] ppid=2595 vsize=366728 CPUtime=0.14 cores=0,2,4,6
/proc/2608/stat : 2608 (python) S 2595 2595 27000 0 -1 4202560 1164 0 0 0 8 6 0 0 20 0 2 0 338573668 375529472 8024 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2608/statm: 91682 8024 383 364 0 26902 0
[pid=2610] ppid=2608 vsize=15680 CPUtime=92.21 cores=0,2,4,6
/proc/2610/stat : 2610 (clasp-1.3.7-x86) T 2608 2610 2610 0 -1 4202496 4252 0 0 0 9221 0 0 0 20 0 1 0 338573668 16056320 3674 33554432000 134512640 136139019 4293692272 4293691024 134871229 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/2610/statm: 3920 3674 182 398 0 3520 0
[pid=2608/tid=2662] ppid=2595 vsize=366728 CPUtime=0 cores=0,2,4,6
/proc/2608/task/2662/stat : 2662 (python) S 2595 2595 27000 0 -1 4202560 54 0 0 0 0 0 0 0 20 0 2 0 338578381 375529472 8024 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2663] ppid=2595 vsize=442520 CPUtime=0.17 cores=0,2,4,6
/proc/2663/stat : 2663 (python) S 2595 2595 27000 0 -1 4202560 1161 0 0 0 9 8 0 0 20 0 2 0 338578383 453140480 8537 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/2663/statm: 110630 8537 383 364 0 45847 0
[pid=2665] ppid=2663 vsize=839036 CPUtime=94.69 cores=0,2,4,6
/proc/2665/stat : 2665 (scip-2.0.1.linu) T 2663 2665 2665 0 -1 4202496 205065 0 0 0 9406 63 0 0 20 0 1 0 338578384 859172864 203596 33554432000 4194304 15243407 140736920908784 140736920905096 6144658 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/2665/statm: 209759 203596 686 2698 0 207054 0
[pid=2663/tid=2670] ppid=2595 vsize=442520 CPUtime=0 cores=0,2,4,6
/proc/2663/task/2670/stat : 2670 (python) S 2595 2595 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 338583311 453140480 8537 33554432000 4194304 5683644 140734912118304 140211489071664 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2675] ppid=2595 vsize=518312 CPUtime=0.08 cores=0,2,4,6
/proc/2675/stat : 2675 (python) S 2595 2595 27000 0 -1 4202560 1149 0 0 0 4 4 0 0 20 0 2 0 338587860 530751488 8544 33554432000 4194304 5683644 140734912118304 140734912109952 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2675/statm: 129578 8544 383 364 0 64792 0
[pid=2677] ppid=2675 vsize=9624972 CPUtime=50.17 cores=0,2,4,6
/proc/2677/stat : 2677 (java) T 2675 2677 2677 0 -1 4202496 17265 0 1 0 4968 49 0 0 20 0 19 0 338587861 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140734984917760 219517321277 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/2677/statm: 2406243 527458 2267 9 0 2396937 0
[pid=2677/tid=2678] ppid=2675 vsize=9624972 CPUtime=47.38 cores=0,2,4,6
/proc/2677/task/2678/stat : 2678 (java) T 2675 2677 2677 0 -1 4202560 3759 0 1 0 4706 32 0 0 20 0 19 0 338587862 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682164607952 140682006811184 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2679] ppid=2675 vsize=9624972 CPUtime=0.06 cores=0,2,4,6
/proc/2677/task/2679/stat : 2679 (java) T 2675 2677 2677 0 -1 4202560 81 0 0 0 6 0 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682126100904 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2677/tid=2680] ppid=2675 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/2677/task/2680/stat : 2680 (java) T 2675 2677 2677 0 -1 4202560 50 0 0 0 8 2 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682125048360 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=2677/tid=2681] ppid=2675 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/2677/task/2681/stat : 2681 (java) T 2675 2677 2677 0 -1 4202560 83 0 0 0 7 2 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682006096040 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2677/tid=2682] ppid=2675 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/2677/task/2682/stat : 2682 (java) T 2675 2677 2677 0 -1 4202560 51 0 0 0 7 2 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682005043496 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2683] ppid=2675 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/2677/task/2683/stat : 2683 (java) T 2675 2677 2677 0 -1 4202560 45 0 0 0 9 0 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682003991464 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2684] ppid=2675 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/2677/task/2684/stat : 2684 (java) T 2675 2677 2677 0 -1 4202560 90 0 0 0 10 2 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682002938920 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=2677/tid=2685] ppid=2675 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/2677/task/2685/stat : 2685 (java) T 2675 2677 2677 0 -1 4202560 94 0 0 0 8 3 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682001885864 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2686] ppid=2675 vsize=9624972 CPUtime=0.08 cores=0,2,4,6
/proc/2677/task/2686/stat : 2686 (java) T 2675 2677 2677 0 -1 4202560 41 0 0 0 8 0 0 0 20 0 19 0 338587863 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140682000833320 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=2677/tid=2687] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2687/stat : 2687 (java) T 2675 2677 2677 0 -1 4202560 945 0 0 0 0 0 0 0 20 0 19 0 338587864 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681518504296 219517335465 0 0 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=2677/tid=2688] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2688/stat : 2688 (java) T 2675 2677 2677 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338587865 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681517450616 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2677/tid=2689] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2689/stat : 2689 (java) T 2675 2677 2677 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 338587865 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681516397448 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2690] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2690/stat : 2690 (java) T 2675 2677 2677 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338587867 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681515346192 219517343520 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2677/tid=2691] ppid=2675 vsize=9624972 CPUtime=0.99 cores=0,2,4,6
/proc/2677/task/2691/stat : 2691 (java) T 2675 2677 2677 0 -1 4202560 5425 0 0 0 99 0 0 0 20 0 19 0 338587867 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681514294072 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=2677/tid=2692] ppid=2675 vsize=9624972 CPUtime=0.9 cores=0,2,4,6
/proc/2677/task/2692/stat : 2692 (java) T 2675 2677 2677 0 -1 4202560 5184 0 0 0 90 0 0 0 20 0 19 0 338587867 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681513241528 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=2677/tid=2693] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2693/stat : 2693 (java) T 2675 2677 2677 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338587867 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681512188664 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=2677/tid=2694] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2694/stat : 2694 (java) T 2675 2677 2677 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338587867 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681511136328 219517335465 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2677/tid=2695] ppid=2675 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/2677/task/2695/stat : 2695 (java) T 2675 2677 2677 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 338587923 9855971328 527458 33554432000 1073741824 1073778376 140734984926624 140681510081576 219517335465 0 4 0 16800975 18446744071579387992 0 0 -1 4 0 0 0 0 0
[pid=2675/tid=2697] ppid=2595 vsize=518312 CPUtime=0 cores=0,2,4,6
/proc/2675/task/2697/stat : 2697 (python) S 2595 2595 27000 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338592633 530751488 8544 33554432000 4194304 5683644 140734912118304 140211478581808 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2720] ppid=2595 vsize=594104 CPUtime=0 cores=0,2,4,6
/proc/2720/stat : 2720 (python) S 2595 2595 27000 0 -1 4202560 856 0 0 0 0 0 0 0 20 0 1 0 338597150 608362496 8501 33554432000 4194304 5683644 140734912118304 140734912109392 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 4 0 0 0 0 0
/proc/2720/statm: 148526 8501 335 364 0 83737 0
[pid=2722] ppid=2720 vsize=9558408 CPUtime=0.77 cores=0,2,4,6
/proc/2722/stat : 2722 (java) S 2720 2722 2722 0 -1 4202496 8667 0 1 0 75 2 0 0 20 0 18 0 338597151 9787809792 19865 33554432000 1073741824 1073778376 140734356867744 140734356858880 219517321277 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/2722/statm: 2389602 19865 2224 9 0 2380296 0
[pid=2722/tid=2723] ppid=2720 vsize=9558408 CPUtime=0.4 cores=0,2,4,6
/proc/2722/task/2723/stat : 2723 (java) R 2720 2722 2722 0 -1 4202560 2446 0 1 0 39 1 0 0 20 0 18 0 338597151 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139941132873664 219517347085 0 4 0 16800975 0 0 0 -1 4 0 0 0 0 0
[pid=2722/tid=2724] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2724/stat : 2724 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139941110983464 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2725] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2725/stat : 2725 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139941109930664 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2722/tid=2726] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2726/stat : 2726 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139941108878376 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2722/tid=2727] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2727/stat : 2727 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940771916712 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2722/tid=2728] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2728/stat : 2728 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940770863400 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2729] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2729/stat : 2729 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940769810600 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2722/tid=2730] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2730/stat : 2730 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940768758312 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2731] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2731/stat : 2731 (java) S 2720 2722 2722 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 18 0 338597152 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940767705512 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2732] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2732/stat : 2732 (java) S 2720 2722 2722 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 338597153 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940755507944 219517335465 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2733] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2733/stat : 2733 (java) S 2720 2722 2722 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 18 0 338597154 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940754454008 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2734] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2734/stat : 2734 (java) S 2720 2722 2722 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 18 0 338597154 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940753401608 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2735] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2735/stat : 2735 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940752350096 219517343520 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2736] ppid=2720 vsize=9558408 CPUtime=0.18 cores=0,2,4,6
/proc/2722/task/2736/stat : 2736 (java) R 2720 2722 2722 0 -1 4202560 2571 0 0 0 18 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940751273816 139941139265364 0 4 0 16800975 0 0 0 -1 0 0 0 0 0 0
[pid=2722/tid=2737] ppid=2720 vsize=9558408 CPUtime=0.15 cores=0,2,4,6
/proc/2722/task/2737/stat : 2737 (java) R 2720 2722 2722 0 -1 4202560 2242 0 0 0 15 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940750221016 139941135485874 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0
[pid=2722/tid=2738] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2738/stat : 2738 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940749191800 219517334588 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=2722/tid=2739] ppid=2720 vsize=9558408 CPUtime=0 cores=0,2,4,6
/proc/2722/task/2739/stat : 2739 (java) S 2720 2722 2722 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 338597156 9787809792 19872 33554432000 1073741824 1073778376 140734356867744 139940748139208 219517335465 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2595/tid=2602] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2602/stat : 2602 (python) S 2593 2595 27000 0 -1 4202560 27 1009 0 0 0 0 0 0 20 0 6 0 338569017 685961216 10083 33554432000 4194304 5683644 140734912118304 140211571315248 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=2595/tid=2609] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2609/stat : 2609 (python) S 2593 2595 27000 0 -1 4202560 23 1009 0 0 0 0 0 0 20 0 6 0 338573668 685961216 10083 33554432000 4194304 5683644 140734912118304 140211489071664 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2595/tid=2664] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2664/stat : 2664 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338578384 685961216 10083 33554432000 4194304 5683644 140734912118304 140211478581808 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=2595/tid=2676] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2676/stat : 2676 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338587861 685961216 10083 33554432000 4194304 5683644 140734912118304 140211468091952 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2595/tid=2721] ppid=2593 vsize=669884 CPUtime=0 cores=0,2,4,6
/proc/2595/task/2721/stat : 2721 (python) S 2593 2595 27000 0 -1 4202560 21 1009 0 0 0 0 0 0 20 0 6 0 338597150 685961216 10083 33554432000 4194304 5683644 140734912118304 140211457602096 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 286.02
Current children cumulated vsize (KiB) 23578748

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2595 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=135827
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=151976
# CPU time returned by wait4() is 1.2878
# while last known CPU time is 286.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 283.763
CPU time (s): 286.02
CPU user time (s): 284.12
CPU system time (s): 1.9
CPU usage (%): 100.796
Max. virtual memory (cumulated for all children) (KiB): 23578748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.13583
system time used= 0.151976
maximum resident set size= 40332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18896
page faults= 1
swaps= 0
block input operations= 0
block output operations= 448
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2068
involuntary context switches= 12

runsolver used 1.06084 second user time and 2.35664 second system time

The end

Launcher Data 

Begin job on node114 at 2012-06-03 13:53:33
IDJOB=3742291
IDBENCH=90147
IDSOLVER=2327
FILE ID=node114/3742291-1338724413
RUNJOBID= node114-1338713908-27016
PBS_JOBID= 14636748
Free space on /tmp= 70040 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K176.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742291-1338724413/watcher-3742291-1338724413 -o /tmp/evaluation-result-3742291-1338724413/solver-3742291-1338724413 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742291-1338724413.opb -seed 1630958437 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3f678424628fecb2a53891618f9bde8f
RANDOM SEED=1630958437

node114.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5451.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        24367340 kB
Buffers:         1039604 kB
Cached:          3821180 kB
SwapCached:         2180 kB
Active:          5711304 kB
Inactive:        1774384 kB
Active(anon):    2609728 kB
Inactive(anon):    10732 kB
Active(file):    3101576 kB
Inactive(file):  1763652 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108856 kB
SwapFree:       67103576 kB
Dirty:            103160 kB
Writeback:             0 kB
AnonPages:       2625356 kB
Mapped:            34824 kB
Shmem:               184 kB
Slab:             870096 kB
SReclaimable:     312264 kB
SUnreclaim:       557832 kB
KernelStack:        1776 kB
PageTables:        13304 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    3416816 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2045952 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69940 MiB
End job on node114 at 2012-06-03 13:58:20