Trace number 3742772

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 1075.11 1071.57

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/
normalized-BeauxArts_K68.opb
MD5SUM506a6fce450974b6f48fc0e3b77d8777
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark15.9726
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables3740
Total number of constraints3878
Number of constraints which are clauses3810
Number of constraints which are cardinality constraints (but not clauses)68
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint68
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 69
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.33/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.33/0.47	c INFO: solving HOME/instance-3742772-1338725524.opb
0.42/0.51	c INFO: parsing took 0.04 s
0.42/0.59	c INFO: features took 0.07 CPU seconds
0.52/0.61	c INFO: running scip-2.0.1-clp@0 for 45 with 1799 remaining (b = 0.72)
47.25/47.38	c INFO: running clasp-1.3.7@0 for 45 with 1753 remaining (b = 0.37)
94.50/94.53	c INFO: running scip-2.0.1-spx@0 for 45 with 1706 remaining (b = 0.07)
145.06/145.05	c INFO: running clasp-1.3.7@47 for 45 with 1656 remaining (b = 0.01)
190.63/190.54	c INFO: wrote minion input file to HOME/tmpGxVgiM.minion
190.63/190.54	c INFO: running minion-0.12@0 for 45 with 1610 remaining (b = 0.10)
237.95/237.82	c INFO: running pbct-0.1.2-linear@0 for 45 with 1563 remaining (b = 0.02)
289.19/289.03	c INFO: running scip-2.0.1-clp@46 for 45 with 1516 remaining (b = 0.01)
334.34/334.18	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1471 remaining (b = 0.04)
384.14/381.68	c INFO: running clasp-1.3.7@92 for 136 with 1421 remaining (b = 0.02)
521.77/519.08	c INFO: running scip-2.0.1-spx@50 for 45 with 1284 remaining (b = 0.01)
567.04/564.23	c INFO: running bsolo_pb10-l2@0 for 45 with 1239 remaining (b = 0.02)
614.79/611.90	c INFO: running scip-2.0.1-spx@95 for 410 with 1192 remaining (b = 0.06)
1026.86/1023.33	c INFO: running bsolo_pb10-l3@0 for 45 with 782 remaining (b = 0.01)
1074.52/1070.99	c INFO: running bsolo_pb10-l1@0 for 91 with 734 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742772-1338725524/watcher-3742772-1338725524 -o /tmp/evaluation-result-3742772-1338725524/solver-3742772-1338725524 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742772-1338725524.opb -seed 869877296 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.02 2.00 3/191 10082
/proc/meminfo: memFree=31058276/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=15380 CPUtime=0 cores=1,3,5,7
/proc/10082/stat : 10082 (python) D 10080 10082 3958 0 -1 4202496 755 0 0 0 0 0 0 0 20 0 1 0 338678473 15749120 629 33554432000 4194304 5683644 140737271023168 140737270967896 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/10082/statm: 3845 629 333 364 0 287 0

[startup+0.0842261 s]
/proc/loadavg: 2.02 2.02 2.00 3/191 10082
/proc/meminfo: memFree=31058276/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=86168 CPUtime=0.05 cores=1,3,5,7
/proc/10082/stat : 10082 (python) D 10080 10082 3958 0 -1 4202496 2966 0 1 0 4 1 0 0 20 0 1 0 338678473 88236032 2476 33554432000 4194304 5683644 140737271023168 140737270958968 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/10082/statm: 21542 2476 773 364 0 1616 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 86168

[startup+0.100183 s]
/proc/loadavg: 2.02 2.02 2.00 3/191 10082
/proc/meminfo: memFree=31058276/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=94456 CPUtime=0.06 cores=1,3,5,7
/proc/10082/stat : 10082 (python) R 10080 10082 3958 0 -1 4202496 3447 1010 1 0 5 1 0 0 20 0 1 0 338678473 96722944 2546 33554432000 4194304 5683644 140737271023168 140737270975640 5177984 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 23614 2546 820 364 0 1620 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 94456

[startup+0.300225 s]
/proc/loadavg: 2.02 2.02 2.00 3/191 10082
/proc/meminfo: memFree=31058276/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=189300 CPUtime=0.24 cores=1,3,5,7
/proc/10082/stat : 10082 (python) D 10080 10082 3958 0 -1 4202496 7187 1010 1 0 19 5 0 0 20 0 1 0 338678473 193843200 4897 33554432000 4194304 5683644 140737271023168 140737270846152 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 47325 4897 1428 364 0 3671 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 189300

[startup+0.700111 s]
/proc/loadavg: 2.02 2.02 2.00 3/191 10082
/proc/meminfo: memFree=31058276/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 358836

[startup+1.50029 s]
/proc/loadavg: 2.02 2.02 2.00 3/195 10090
/proc/meminfo: memFree=30987300/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
[pid=10088] ppid=10082 vsize=283056 CPUtime=0 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 767 0 0 0 0 0 0 0 20 0 1 0 338678535 289849344 6004 33554432000 4194304 5683644 140737271023168 140737271014256 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/10088/statm: 70764 6004 341 364 0 5987 0
[pid=10090] ppid=10088 vsize=72600 CPUtime=0.87 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) R 10088 10090 10090 0 -1 4202496 15266 0 0 0 83 4 0 0 20 0 1 0 338678535 74342400 14664 33554432000 4194304 15243407 140735368546128 140735368542440 13277498 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/10090/statm: 18150 14664 689 2698 0 15445 0
[pid=10082/tid=10089] ppid=10080 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338678535 367448064 7561 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 714492

[startup+3.1003 s]
/proc/loadavg: 2.02 2.02 2.00 3/195 10090
/proc/meminfo: memFree=30964000/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
[pid=10088] ppid=10082 vsize=283056 CPUtime=0 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 768 0 0 0 0 0 0 0 20 0 1 0 338678535 289849344 6004 33554432000 4194304 5683644 140737271023168 140737271014256 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/10088/statm: 70764 6004 341 364 0 5987 0
[pid=10090] ppid=10088 vsize=95564 CPUtime=2.47 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) R 10088 10090 10090 0 -1 4202496 20916 0 0 0 240 7 0 0 20 0 1 0 338678535 97857536 20314 33554432000 4194304 15243407 140735368546128 140735368542440 13277498 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/10090/statm: 23891 20314 693 2698 0 21186 0
[pid=10082/tid=10089] ppid=10080 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338678535 367448064 7561 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 737456

[startup+6.30029 s]
/proc/loadavg: 2.02 2.02 2.00 3/195 10090
/proc/meminfo: memFree=30928536/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
[pid=10088] ppid=10082 vsize=283056 CPUtime=0 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 890 0 0 0 0 0 0 0 20 0 1 0 338678535 289849344 6027 33554432000 4194304 5683644 140737271023168 140737271014256 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/10088/statm: 70764 6027 364 364 0 5987 0
[pid=10090] ppid=10088 vsize=125148 CPUtime=5.67 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) R 10088 10090 10090 0 -1 4202496 28434 0 0 0 556 11 0 0 20 0 1 0 338678535 128151552 27832 33554432000 4194304 15243407 140735368546128 140735368542440 13277498 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/10090/statm: 31287 27832 693 2698 0 28582 0
[pid=10082/tid=10089] ppid=10080 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338678535 367448064 7561 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 767040

[startup+12.7003 s]
/proc/loadavg: 2.02 2.02 2.00 3/195 10090
/proc/meminfo: memFree=30905876/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
[pid=10088] ppid=10082 vsize=283056 CPUtime=0.01 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 985 0 0 0 1 0 0 0 20 0 1 0 338678535 289849344 6032 33554432000 4194304 5683644 140737271023168 140737271014256 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 3 0 0 0 0 0
/proc/10088/statm: 70764 6032 369 364 0 5987 0
[pid=10090] ppid=10088 vsize=145384 CPUtime=12.07 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) R 10088 10090 10090 0 -1 4202496 32832 0 0 0 1177 30 0 0 20 0 1 0 338678535 148873216 32717 33554432000 4194304 15243407 140735368546128 140735368540840 6629288 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0
/proc/10090/statm: 36346 32717 888 2698 0 33641 0
[pid=10082/tid=10089] ppid=10080 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338678535 367448064 7561 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 787276

[startup+25.5065 s]
/proc/loadavg: 2.01 2.02 2.00 3/195 10090
/proc/meminfo: memFree=30905908/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=358836 CPUtime=0.53 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 10882 1010 1 0 44 9 0 0 20 0 2 0 338678473 367448064 7561 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10082/statm: 89709 7561 1892 364 0 24932 0
[pid=10088] ppid=10082 vsize=283056 CPUtime=0.03 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 995 0 0 0 2 1 0 0 20 0 1 0 338678535 289849344 6032 33554432000 4194304 5683644 140737271023168 140737271014256 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 1 0 0 0 0 0
/proc/10088/statm: 70764 6032 369 364 0 5987 0
[pid=10090] ppid=10088 vsize=151644 CPUtime=24.87 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) R 10088 10090 10090 0 -1 4202496 42622 0 0 0 2452 35 0 0 20 0 1 0 338678535 155283456 33029 33554432000 4194304 15243407 140735368546128 140735368540520 13354455 0 0 16781312 2 0 0 0 17 5 0 0 0 0 0
/proc/10090/statm: 37911 33029 949 2698 0 35206 0
[pid=10082/tid=10089] ppid=10080 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 2 0 338678535 367448064 7561 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 793536

[startup+51.1004 s]
/proc/loadavg: 2.01 2.01 2.00 3/203 10099
/proc/meminfo: memFree=30850584/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=435132 CPUtime=0.55 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 11818 1010 1 0 46 9 0 0 20 0 3 0 338678473 445575168 7704 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/10082/statm: 108783 7704 1903 364 0 44003 0
[pid=10088] ppid=10082 vsize=358836 CPUtime=0.07 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 1146 0 0 0 4 3 0 0 20 0 2 0 338678535 367448064 6067 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10088/statm: 89709 6067 397 364 0 24932 0
[pid=10090] ppid=10088 vsize=150928 CPUtime=46.73 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) T 10088 10090 10090 0 -1 4202496 52946 0 0 0 4633 40 0 0 20 0 1 0 338678535 154550272 32773 33554432000 4194304 15243407 140735368546128 140735368540520 8128834 0 0 16781312 2 18446744071579387992 0 0 17 5 0 0 0 0 0
/proc/10090/statm: 37732 32773 949 2698 0 35027 0
[pid=10088/tid=10095] ppid=10082 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10088/task/10095/stat : 10095 (python) S 10082 10082 3958 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338683210 367448064 6067 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10096] ppid=10082 vsize=359352 CPUtime=0 cores=1,3,5,7
/proc/10096/stat : 10096 (python) S 10082 10082 3958 0 -1 4202560 896 0 0 0 0 0 0 0 20 0 1 0 338683212 367976448 6153 33554432000 4194304 5683644 140737271023168 140737271014256 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 1 0 0 0 0 0
/proc/10096/statm: 89838 6153 358 364 0 25058 0
[pid=10098] ppid=10096 vsize=4936 CPUtime=3.7 cores=1,3,5,7
/proc/10098/stat : 10098 (clasp-1.3.7-x86) R 10096 10098 10098 0 -1 4202496 1246 0 0 0 370 0 0 0 20 0 1 0 338683213 5054464 969 33554432000 134512640 136139019 4288179264 4288178240 134882942 0 0 16781312 16386 0 0 0 17 3 0 0 0 0 0
/proc/10098/statm: 1234 969 182 398 0 834 0
[pid=10082/tid=10089] ppid=10080 vsize=435132 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 27 1010 0 0 0 0 0 0 20 0 3 0 338678535 445575168 7704 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10097] ppid=10080 vsize=435132 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10097/stat : 10097 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 3 0 338683213 445575168 7704 33554432000 4194304 5683644 140737271023168 140203425403440 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 1309184

[startup+102.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/208 10104
/proc/meminfo: memFree=30717968/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=510924 CPUtime=0.59 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 12733 1010 1 0 49 10 0 0 20 0 4 0 338678473 523186176 7712 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/10082/statm: 127731 7712 1905 364 0 62948 0
[pid=10088] ppid=10082 vsize=358836 CPUtime=0.07 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 1146 0 0 0 4 3 0 0 20 0 2 0 338678535 367448064 6067 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10088/statm: 89709 6067 397 364 0 24932 0
[pid=10090] ppid=10088 vsize=150928 CPUtime=46.73 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) T 10088 10090 10090 0 -1 4202496 52946 0 0 0 4633 40 0 0 20 0 1 0 338678535 154550272 32773 33554432000 4194304 15243407 140735368546128 140735368540520 8128834 0 0 16781312 2 18446744071579387992 0 0 17 5 0 0 0 0 0
/proc/10090/statm: 37732 32773 949 2698 0 35027 0
[pid=10088/tid=10095] ppid=10082 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10088/task/10095/stat : 10095 (python) S 10082 10082 3958 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338683210 367448064 6067 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10096] ppid=10082 vsize=359352 CPUtime=0.06 cores=1,3,5,7
/proc/10096/stat : 10096 (python) S 10082 10082 3958 0 -1 4202560 1085 0 0 0 3 3 0 0 20 0 2 0 338683212 367976448 6180 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10096/statm: 89838 6180 384 364 0 25058 0
[pid=10098] ppid=10096 vsize=10108 CPUtime=47.1 cores=1,3,5,7
/proc/10098/stat : 10098 (clasp-1.3.7-x86) T 10096 10098 10098 0 -1 4202496 2558 0 0 0 4710 0 0 0 20 0 1 0 338683213 10350592 2279 33554432000 134512640 136139019 4288179264 4288178240 134883787 0 0 16781312 16386 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/10098/statm: 2527 2279 182 398 0 2127 0
[pid=10096/tid=10101] ppid=10082 vsize=359352 CPUtime=0 cores=1,3,5,7
/proc/10096/task/10101/stat : 10101 (python) S 10082 10082 3958 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338687925 367976448 6180 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10102] ppid=10082 vsize=435144 CPUtime=0 cores=1,3,5,7
/proc/10102/stat : 10102 (python) S 10082 10082 3958 0 -1 4202560 922 0 0 0 0 0 0 0 20 0 1 0 338687927 445587456 6160 33554432000 4194304 5683644 140737271023168 140737271014256 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 1 0 0 0 0 0

################
# More data... #
################

[pid=10082/tid=10097] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10097/stat : 10097 (python) S 10080 10082 3958 0 -1 4202560 31 1010 0 0 0 0 0 0 20 0 10 0 338683213 988852224 8268 33554432000 4194304 5683644 140737271023168 140203425403440 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10103] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10103/stat : 10103 (python) S 10080 10082 3958 0 -1 4202560 29 1010 0 0 0 0 0 0 20 0 10 0 338687927 988852224 8268 33554432000 4194304 5683644 140737271023168 140203414913584 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10129] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10129/stat : 10129 (python) S 10080 10082 3958 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 10 0 338697528 988852224 8268 33554432000 4194304 5683644 140737271023168 140203404423728 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10133] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10133/stat : 10133 (python) S 10080 10082 3958 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 10 0 338702257 988852224 8268 33554432000 4194304 5683644 140737271023168 140203393933872 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10137] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10137/stat : 10137 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338711892 988852224 8268 33554432000 4194304 5683644 140737271023168 140203383444016 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=10082/tid=10167] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10167/stat : 10167 (python) S 10080 10082 3958 0 -1 4202560 20 1010 0 0 0 0 0 0 20 0 10 0 338734897 988852224 8268 33554432000 4194304 5683644 140737271023168 140203033354800 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=10082/tid=10207] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10207/stat : 10207 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338780807 988852224 8268 33554432000 4194304 5683644 140737271023168 140203022864944 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=10082/tid=10211] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10211/stat : 10211 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338785573 988852224 8268 33554432000 4194304 5683644 140737271023168 140203012375088 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1075.11
Current children cumulated vsize (KiB) 16611892

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1071.5 s]
/proc/loadavg: 1.17 1.54 1.81 2/224 10212
/proc/meminfo: memFree=29767764/32873648 swapFree=7628/7628
[pid=10082] ppid=10080 vsize=965676 CPUtime=1.16 cores=1,3,5,7
/proc/10082/stat : 10082 (python) S 10080 10082 3958 0 -1 4202496 18697 1010 1 0 104 12 0 0 20 0 10 0 338678473 988852224 8268 33554432000 4194304 5683644 140737271023168 140737271018000 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/10082/statm: 241419 8268 1917 364 0 176618 0
[pid=10088] ppid=10082 vsize=358836 CPUtime=0.14 cores=1,3,5,7
/proc/10088/stat : 10088 (python) S 10082 10082 3958 0 -1 4202560 1178 0 0 0 8 6 0 0 20 0 2 0 338678535 367448064 6068 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10088/statm: 89709 6068 398 364 0 24932 0
[pid=10090] ppid=10088 vsize=149312 CPUtime=91.83 cores=1,3,5,7
/proc/10090/stat : 10090 (scip-2.0.1.linu) T 10088 10090 10090 0 -1 4202496 62232 0 0 0 9134 49 0 0 20 0 1 0 338678535 152895488 33727 33554432000 4194304 15243407 140735368546128 140735368540520 8112861 0 0 16781312 2 18446744071579387992 0 0 17 5 0 0 0 0 0
/proc/10090/statm: 37328 33727 950 2698 0 34623 0
[pid=10088/tid=10095] ppid=10082 vsize=358836 CPUtime=0 cores=1,3,5,7
/proc/10088/task/10095/stat : 10095 (python) S 10082 10082 3958 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338683210 367448064 6068 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10096] ppid=10082 vsize=359352 CPUtime=0.38 cores=1,3,5,7
/proc/10096/stat : 10096 (python) S 10082 10082 3958 0 -1 4202560 1175 0 0 0 22 16 0 0 20 0 2 0 338683212 367976448 6180 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/10096/statm: 89838 6180 384 364 0 25058 0
[pid=10098] ppid=10096 vsize=16484 CPUtime=229.56 cores=1,3,5,7
/proc/10098/stat : 10098 (clasp-1.3.7-x86) T 10096 10098 10098 0 -1 4202496 4246 0 0 0 22956 0 0 0 20 0 1 0 338683213 16879616 3876 33554432000 134512640 136139019 4288179264 4288178128 134608341 0 0 16781312 16386 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/10098/statm: 4121 3876 182 398 0 3721 0
[pid=10096/tid=10101] ppid=10082 vsize=359352 CPUtime=0 cores=1,3,5,7
/proc/10096/task/10101/stat : 10101 (python) S 10082 10082 3958 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 338687925 367976448 6180 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10102] ppid=10082 vsize=435144 CPUtime=0.91 cores=1,3,5,7
/proc/10102/stat : 10102 (python) S 10082 10082 3958 0 -1 4202560 1198 0 0 0 52 39 0 0 20 0 2 0 338687927 445587456 6186 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10102/statm: 108786 6186 384 364 0 44003 0
[pid=10104] ppid=10102 vsize=166616 CPUtime=506.95 cores=1,3,5,7
/proc/10104/stat : 10104 (scip-2.0.1.linu) T 10102 10104 10104 0 -1 4202496 42114 0 0 0 50474 221 0 0 20 0 1 0 338687928 170614784 39649 33554432000 4194304 13684479 140736076185936 140736076179864 7158623 0 0 16781312 2 18446744071579387992 0 0 17 5 0 0 0 0 0
/proc/10104/statm: 41654 39649 815 2317 0 39332 0
[pid=10102/tid=10126] ppid=10082 vsize=435144 CPUtime=0 cores=1,3,5,7
/proc/10102/task/10126/stat : 10126 (python) S 10082 10082 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 338692977 445587456 6186 33554432000 4194304 5683644 140737271023168 140203425403440 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10128] ppid=10082 vsize=510936 CPUtime=0.07 cores=1,3,5,7
/proc/10128/stat : 10128 (python) S 10082 10082 3958 0 -1 4202560 1121 0 0 0 4 3 0 0 20 0 2 0 338697528 523198464 6192 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/10128/statm: 127734 6192 384 364 0 62948 0
[pid=10130] ppid=10128 vsize=81468 CPUtime=47.22 cores=1,3,5,7
/proc/10130/stat : 10130 (minion) T 10128 10130 10130 0 -1 4202496 6427 0 0 0 4721 1 0 0 20 0 1 0 338697528 83423232 13080 33554432000 134512640 165565024 4292918640 4292915888 142765033 0 0 16781312 8396802 18446744071579387992 0 0 17 1 0 0 0 0 0
/proc/10130/statm: 20367 13080 336 7582 0 12782 0
[pid=10128/tid=10131] ppid=10082 vsize=510936 CPUtime=0 cores=1,3,5,7
/proc/10128/task/10131/stat : 10131 (python) S 10082 10082 3958 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 338702254 523198464 6192 33554432000 4194304 5683644 140737271023168 140203414913584 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10132] ppid=10082 vsize=586728 CPUtime=0.08 cores=1,3,5,7
/proc/10132/stat : 10132 (python) S 10082 10082 3958 0 -1 4202560 1120 0 0 0 4 4 0 0 20 0 2 0 338702256 600809472 6198 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10132/statm: 146682 6198 384 364 0 81893 0
[pid=10134] ppid=10132 vsize=51648 CPUtime=51.14 cores=1,3,5,7
/proc/10134/stat : 10134 (pbct-0.1.2-linu) T 10132 10134 10134 0 -1 4202496 12998 0 0 0 4692 422 0 0 20 0 1 0 338702257 52887552 12307 33554432000 134512640 136422188 4294186240 4294183692 135874785 0 0 16781312 16387 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/10134/statm: 12912 12307 214 467 0 12443 0
[pid=10132/tid=10135] ppid=10082 vsize=586728 CPUtime=0 cores=1,3,5,7
/proc/10132/task/10135/stat : 10135 (python) S 10082 10082 3958 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 2 0 338707375 600809472 6198 33554432000 4194304 5683644 140737271023168 140203404423728 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10136] ppid=10082 vsize=662520 CPUtime=0.08 cores=1,3,5,7
/proc/10136/stat : 10136 (python) S 10082 10082 3958 0 -1 4202560 1141 0 0 0 4 4 0 0 20 0 2 0 338711892 678420480 6204 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10136/statm: 165630 6204 384 364 0 100838 0
[pid=10138] ppid=10136 vsize=9624972 CPUtime=49.71 cores=1,3,5,7
/proc/10138/stat : 10138 (java) T 10136 10138 10138 0 -1 4202496 16851 0 1 0 4940 31 0 0 20 0 19 0 338711892 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 140736454547120 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/10138/statm: 2406243 286061 2267 9 0 2396937 0
[pid=10138/tid=10139] ppid=10136 vsize=9624972 CPUtime=47.03 cores=1,3,5,7
/proc/10138/task/10139/stat : 10139 (java) T 10136 10138 10138 0 -1 4202560 3204 0 1 0 4687 16 0 0 20 0 19 0 338711894 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139645028445408 139644900981892 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10140] ppid=10136 vsize=9624972 CPUtime=0.12 cores=1,3,5,7
/proc/10138/task/10140/stat : 10140 (java) T 10136 10138 10138 0 -1 4202560 112 0 0 0 11 1 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644872551208 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10141] ppid=10136 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/10138/task/10141/stat : 10141 (java) T 10136 10138 10138 0 -1 4202560 123 0 0 0 12 2 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644871498408 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10142] ppid=10136 vsize=9624972 CPUtime=0.16 cores=1,3,5,7
/proc/10138/task/10142/stat : 10142 (java) T 10136 10138 10138 0 -1 4202560 46 0 0 0 14 2 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644870446120 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10143] ppid=10136 vsize=9624972 CPUtime=0.15 cores=1,3,5,7
/proc/10138/task/10143/stat : 10143 (java) T 10136 10138 10138 0 -1 4202560 53 0 0 0 13 2 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644869393320 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10144] ppid=10136 vsize=9624972 CPUtime=0.12 cores=1,3,5,7
/proc/10138/task/10144/stat : 10144 (java) T 10136 10138 10138 0 -1 4202560 28 0 0 0 12 0 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644868340008 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10145] ppid=10136 vsize=9624972 CPUtime=0.16 cores=1,3,5,7
/proc/10138/task/10145/stat : 10145 (java) T 10136 10138 10138 0 -1 4202560 150 0 0 0 14 2 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644867287208 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 7 0 0 0 0 0
[pid=10138/tid=10146] ppid=10136 vsize=9624972 CPUtime=0.15 cores=1,3,5,7
/proc/10138/task/10146/stat : 10146 (java) T 10136 10138 10138 0 -1 4202560 125 0 0 0 13 2 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644866234920 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10147] ppid=10136 vsize=9624972 CPUtime=0.14 cores=1,3,5,7
/proc/10138/task/10147/stat : 10147 (java) T 10136 10138 10138 0 -1 4202560 32 0 0 0 14 0 0 0 20 0 19 0 338711895 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644865182120 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10148] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10148/stat : 10148 (java) T 10136 10138 10138 0 -1 4202560 740 0 0 0 0 0 0 0 20 0 19 0 338711896 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644852771560 217413892009 0 0 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=10138/tid=10149] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10149/stat : 10149 (java) T 10136 10138 10138 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 338711896 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644851717624 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10150] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10150/stat : 10150 (java) T 10136 10138 10138 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 338711896 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644850665224 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10151] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10151/stat : 10151 (java) T 10136 10138 10138 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338711899 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644849613712 217413900064 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10152] ppid=10136 vsize=9624972 CPUtime=0.63 cores=1,3,5,7
/proc/10138/task/10152/stat : 10152 (java) T 10136 10138 10138 0 -1 4202560 6953 0 0 0 63 0 0 0 20 0 19 0 338711899 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644848560312 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10153] ppid=10136 vsize=9624972 CPUtime=0.73 cores=1,3,5,7
/proc/10138/task/10153/stat : 10153 (java) T 10136 10138 10138 0 -1 4202560 3861 0 0 0 73 0 0 0 20 0 19 0 338711899 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644847507512 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10154] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10154/stat : 10154 (java) T 10136 10138 10138 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 338711899 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644846455416 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10138/tid=10155] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10155/stat : 10155 (java) T 10136 10138 10138 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 338711899 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644845402824 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 1 0 0 0 0 0
[pid=10138/tid=10156] ppid=10136 vsize=9624972 CPUtime=0 cores=1,3,5,7
/proc/10138/task/10156/stat : 10156 (java) T 10136 10138 10138 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 338711926 9855971328 286061 33554432000 1073741824 1073778376 140736454555984 139644844320168 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 5 0 0 0 0 0
[pid=10136/tid=10161] ppid=10082 vsize=662520 CPUtime=0 cores=1,3,5,7
/proc/10136/task/10161/stat : 10161 (python) S 10082 10082 3958 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 338716640 678420480 6204 33554432000 4194304 5683644 140737271023168 140203393933872 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10166] ppid=10082 vsize=738312 CPUtime=0.07 cores=1,3,5,7
/proc/10166/stat : 10166 (python) S 10082 10082 3958 0 -1 4202560 1157 0 0 0 4 3 0 0 20 0 2 0 338734897 756031488 6210 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10166/statm: 184578 6210 384 364 0 119783 0
[pid=10168] ppid=10166 vsize=108444 CPUtime=47.62 cores=1,3,5,7
/proc/10168/stat : 10168 (bsolo_pb10) T 10166 10168 10168 0 -1 4202496 25010 0 0 0 4746 16 0 0 20 0 1 0 338734898 111046656 24666 33554432000 134512640 137138936 4289549136 4289547680 134607615 0 0 16781312 16384 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/10168/statm: 27111 24666 192 642 0 26467 0
[pid=10166/tid=10169] ppid=10082 vsize=738312 CPUtime=0 cores=1,3,5,7
/proc/10166/task/10169/stat : 10169 (python) S 10082 10082 3958 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 338739662 756031488 6210 33554432000 4194304 5683644 140737271023168 140203383444016 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10206] ppid=10082 vsize=814104 CPUtime=0.07 cores=1,3,5,7
/proc/10206/stat : 10206 (python) S 10082 10082 3958 0 -1 4202560 1214 0 0 0 4 3 0 0 20 0 2 0 338780807 833642496 6729 33554432000 4194304 5683644 140737271023168 140737271014816 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/10206/statm: 203526 6729 390 364 0 138728 0
[pid=10208] ppid=10206 vsize=79164 CPUtime=47.62 cores=1,3,5,7
/proc/10208/stat : 10208 (bsolo_pb10) T 10206 10208 10208 0 -1 4202496 17701 0 0 0 4756 6 0 0 20 0 1 0 338780808 81063936 17356 33554432000 134512640 137138936 4289722368 4289721296 134542516 0 0 16781312 16384 18446744071579387992 0 0 17 3 0 0 0 0 0
/proc/10208/statm: 19791 17356 192 642 0 19147 0
[pid=10206/tid=10209] ppid=10082 vsize=814104 CPUtime=0 cores=1,3,5,7
/proc/10206/task/10209/stat : 10209 (python) S 10082 10082 3958 0 -1 4202560 40 0 0 0 0 0 0 0 20 0 2 0 338785572 833642496 6729 33554432000 4194304 5683644 140737271023168 140203033354800 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=10210] ppid=10082 vsize=889896 CPUtime=0 cores=1,3,5,7
/proc/10210/stat : 10210 (python) S 10082 10082 3958 0 -1 4202560 901 0 0 0 0 0 0 0 20 0 1 0 338785573 911253504 6688 33554432000 4194304 5683644 140737271023168 140737271014256 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 1 0 0 0 0 0
/proc/10210/statm: 222474 6688 343 364 0 157673 0
[pid=10212] ppid=10210 vsize=12280 CPUtime=0.5 cores=1,3,5,7
/proc/10212/stat : 10212 (bsolo_pb10) R 10210 10212 10212 0 -1 4202496 964 0 0 0 50 0 0 0 20 0 1 0 338785573 12574720 616 33554432000 134512640 137138936 4293352112 4293351228 136570369 0 0 16781312 16384 0 0 0 17 3 0 0 0 0 0
/proc/10212/statm: 3070 616 191 642 0 2426 0
[pid=10082/tid=10089] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10089/stat : 10089 (python) S 10080 10082 3958 0 -1 4202560 32 1010 0 0 0 0 0 0 20 0 10 0 338678535 988852224 8268 33554432000 4194304 5683644 140737271023168 140203435893296 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=10082/tid=10097] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10097/stat : 10097 (python) S 10080 10082 3958 0 -1 4202560 31 1010 0 0 0 0 0 0 20 0 10 0 338683213 988852224 8268 33554432000 4194304 5683644 140737271023168 140203425403440 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10103] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10103/stat : 10103 (python) S 10080 10082 3958 0 -1 4202560 29 1010 0 0 0 0 0 0 20 0 10 0 338687927 988852224 8268 33554432000 4194304 5683644 140737271023168 140203414913584 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10129] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10129/stat : 10129 (python) S 10080 10082 3958 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 10 0 338697528 988852224 8268 33554432000 4194304 5683644 140737271023168 140203404423728 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10133] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10133/stat : 10133 (python) S 10080 10082 3958 0 -1 4202560 21 1010 0 0 0 0 0 0 20 0 10 0 338702257 988852224 8268 33554432000 4194304 5683644 140737271023168 140203393933872 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=10082/tid=10137] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10137/stat : 10137 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338711892 988852224 8268 33554432000 4194304 5683644 140737271023168 140203383444016 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=10082/tid=10167] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10167/stat : 10167 (python) S 10080 10082 3958 0 -1 4202560 20 1010 0 0 0 0 0 0 20 0 10 0 338734897 988852224 8268 33554432000 4194304 5683644 140737271023168 140203033354800 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=10082/tid=10207] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10207/stat : 10207 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338780807 988852224 8268 33554432000 4194304 5683644 140737271023168 140203022864944 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=10082/tid=10211] ppid=10080 vsize=965676 CPUtime=0 cores=1,3,5,7
/proc/10082/task/10211/stat : 10211 (python) S 10080 10082 3958 0 -1 4202560 22 1010 0 0 0 0 0 0 20 0 10 0 338785573 988852224 8268 33554432000 4194304 5683644 140737271023168 140203012375088 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1075.11
Current children cumulated vsize (KiB) 16611892

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10082 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=45841
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=125980
# CPU time returned by wait4() is 1.17182
# while last known CPU time is 1075.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1071.57
CPU time (s): 1075.11
CPU user time (s): 1066.75
CPU system time (s): 8.36
CPU usage (%): 100.331
Max. virtual memory (cumulated for all children) (KiB): 16611892

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.04584
system time used= 0.12598
maximum resident set size= 33072
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19707
page faults= 1
swaps= 0
block input operations= 0
block output operations= 1080
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1074
involuntary context switches= 35

runsolver used 5.32119 second user time and 12.4431 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-03 14:12:04
IDJOB=3742772
IDBENCH=90229
IDSOLVER=2327
FILE ID=node122/3742772-1338725524
RUNJOBID= node122-1338713392-3975
PBS_JOBID= 14636732
Free space on /tmp= 71088 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathBA/normalized-BeauxArts_K68.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742772-1338725524/watcher-3742772-1338725524 -o /tmp/evaluation-result-3742772-1338725524/solver-3742772-1338725524 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3742772-1338725524.opb -seed 869877296 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 506a6fce450974b6f48fc0e3b77d8777
RANDOM SEED=869877296

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31059052 kB
Buffers:          216804 kB
Cached:           376848 kB
SwapCached:         1832 kB
Active:           941392 kB
Inactive:          42904 kB
Active(anon):     386000 kB
Inactive(anon):     7100 kB
Active(file):     555392 kB
Inactive(file):    35804 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67100168 kB
Dirty:            102312 kB
Writeback:             0 kB
AnonPages:        396672 kB
Mapped:            24168 kB
Shmem:                64 kB
Slab:             688760 kB
SReclaimable:     131560 kB
SUnreclaim:       557200 kB
KernelStack:        1608 kB
PageTables:         7572 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     722360 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    163840 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71088 MiB
End job on node122 at 2012-06-03 14:29:58