Trace number 3741553

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.18 1800.78

General information on the benchmark

Name/OPT-SMALLINT-LIN/heinz/
normalized-neos-544324.opb
MD5SUM02fa27f3dafb4f59cf08d669298a5bbe
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark15
Best CPU time to get the best result obtained on this benchmark465.377
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables10080
Total number of constraints732
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)732
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint168
Maximum length of a constraint3680
Number of terms in the objective function 10080
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 10080
Number of bits of the sum of numbers in the objective function 14
Biggest number in a constraint 5
Number of bits of the biggest number in a constraint 3
Biggest sum of numbers in a constraint 10080
Number of bits of the biggest sum of numbers14
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741553-1338760140.opb
0.00/0.00	c File size is 15730092 bytes.
1.18/1.26	c Highest Coefficient sum: 10080
1.18/1.26	c Parsing was ok!!
1.18/1.26	c Total parsing time: 1.263 s
1.29/1.32	c Var: 10080 Constr: 732 0/732/0 Lit: 1757280 Watch. Lit: 883712
1.29/1.32	c Obj. Vars: 10080 (100 % of total variables)
117.17/117.25	c Pre-processing Time: 117.237 s
117.17/117.26	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
117.17/117.26	c        0  10080      395   880000 2227   446920  395000      0      0 117.24
117.17/117.26	c Switching off LPR mode.
1800.10/1800.70	c      127  10080      522  1101056 2109   447174  434501    127      1 120.10
1800.10/1800.70	c      278  10080      673  1389891 2065   447476  477952    278      2 120.36
1800.10/1800.70	c      503  10080      898  1920751 2138   447926  525748    503      4 120.98
1800.10/1800.70	c      841  10080     1236  2636003 2132   448602  578323    841      6 121.72
1800.10/1800.70	c     1349  10080     1744  3601955 2065   449618  636156   1349     10 122.64
1800.10/1800.70	c     2112  10080     2507  5136613 2048   451144  699772   2112     16 124.59
1800.10/1800.70	c     3259  10080     3654  7600104 2079   453438  769750   3259     25 128.95
1800.10/1800.70	c     4981  10080     5376 11066338 2058   456882  846726   4981     37 134.36
1800.10/1800.70	c     7565  10080     7960 16617699 2087   462050  931399   7565     51 146.54
1800.10/1800.70	c    11444  10080    11839 26776294 2261   469808  500000  11444     53 212.20
1800.10/1800.70	c    17266  10080    17661 36779408 2082   481452  550001  17266     69 249.12
1800.10/1800.70	c    26003  10080    26398 51357936 1945   498926  605002  26003     89 289.97
1800.10/1800.70	c    39113  10080    39508 72957818 1846   525146  665503  39113    103 376.76
1800.10/1800.70	c    58783  10080    59178 105314748 1779   564486  732054  58783    111 528.66
1800.10/1800.70	c    88293  10080    88688 153777154 1733   623506  805260  88293    111 789.62
1800.10/1800.70	c   132563  10080   132958 226221538 1701   712046  885787 132563    100 1322.66
1800.10/1800.70	c Caught signal: 15
1800.10/1800.70	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.10/1800.70	c   16   172588 116395  1046434   172983 291552211 172588     95 1800.11
1800.10/1800.70	s UNKNOWN
1800.10/1800.70	c Total time: 1800.11 s

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741553-1338760140/watcher-3741553-1338760140 -o /tmp/evaluation-result-3741553-1338760140/solver-3741553-1338760140 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741553-1338760140.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.98 2.00 2.00 3/176 12906
/proc/meminfo: memFree=27549444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=27872 CPUtime=0 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 486 0 0 0 0 0 0 0 20 0 1 0 342139979 28540928 422 33554432000 134512640 135840783 4293392848 4293391824 134525286 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 6968 422 329 325 0 2063 0

[startup+0.059754 s]
/proc/loadavg: 1.98 2.00 2.00 3/176 12906
/proc/meminfo: memFree=27549444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=29484 CPUtime=0.05 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 1053 0 0 0 5 0 0 0 20 0 1 0 342139979 30191616 989 33554432000 134512640 135840783 4293392848 4293359456 10634288 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 7371 989 493 325 0 2466 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 29484

[startup+0.100217 s]
/proc/loadavg: 1.98 2.00 2.00 3/176 12906
/proc/meminfo: memFree=27549444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=30176 CPUtime=0.09 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 1363 0 0 0 9 0 0 0 20 0 1 0 342139979 30900224 1299 33554432000 134512640 135840783 4293392848 4293391840 134525198 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 7544 1299 618 325 0 2639 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 30176

[startup+0.300182 s]
/proc/loadavg: 1.98 2.00 2.00 3/176 12906
/proc/meminfo: memFree=27549444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=25968 CPUtime=0.29 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 2864 0 0 0 29 0 0 0 20 0 1 0 342139979 26591232 2800 33554432000 134512640 135840783 4293392848 4293391840 134525198 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 6492 2800 1232 325 0 1587 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25968

[startup+0.762837 s]
/proc/loadavg: 1.98 2.00 2.00 3/176 12906
/proc/meminfo: memFree=27549444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=34160 CPUtime=0.75 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 6323 0 0 0 74 1 0 0 20 0 1 0 342139979 34979840 6259 33554432000 134512640 135840783 4293392848 4293391840 134525286 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 8540 6259 2636 325 0 3635 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 34160

[startup+1.5003 s]
/proc/loadavg: 1.98 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27507400/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49072 CPUtime=1.49 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 15440 0 0 0 147 2 0 0 20 0 1 0 342139979 50249728 11535 33554432000 134512640 135840783 4293392848 4293270912 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12268 11535 343 325 0 11204 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 49072

[startup+3.10024 s]
/proc/loadavg: 1.98 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27493752/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49072 CPUtime=3.09 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 15440 0 0 0 307 2 0 0 20 0 1 0 342139979 50249728 11535 33554432000 134512640 135840783 4293392848 4293271004 10634288 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12268 11535 343 325 0 11204 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 49072

[startup+6.30016 s]
/proc/loadavg: 1.98 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27483624/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49072 CPUtime=6.29 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 15440 0 0 0 627 2 0 0 20 0 1 0 342139979 50249728 11535 33554432000 134512640 135840783 4293392848 4293270912 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12268 11535 343 325 0 11204 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 49072

[startup+12.7001 s]
/proc/loadavg: 1.98 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27464532/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49368 CPUtime=12.69 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 22358 0 0 0 1265 4 0 0 20 0 1 0 342139979 50552832 11579 33554432000 134512640 135840783 4293392848 4293260648 134540682 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12342 11579 345 325 0 11278 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 49368

[startup+25.5001 s]
/proc/loadavg: 1.98 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27433332/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49368 CPUtime=25.49 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 22358 0 0 0 2545 4 0 0 20 0 1 0 342139979 50552832 11579 33554432000 134512640 135840783 4293392848 4293260648 134540677 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12342 11579 345 325 0 11278 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 49368

[startup+51.1002 s]
/proc/loadavg: 1.99 2.00 2.00 3/177 12907
/proc/meminfo: memFree=27374632/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49368 CPUtime=51.08 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 22358 0 0 0 5104 4 0 0 20 0 1 0 342139979 50552832 11579 33554432000 134512640 135840783 4293392848 4293260648 134540688 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12342 11579 345 325 0 11278 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 49368

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/178 12910
/proc/meminfo: memFree=27317880/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=49368 CPUtime=102.27 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 22358 0 0 0 10223 4 0 0 20 0 1 0 342139979 50552832 11579 33554432000 134512640 135840783 4293392848 4293260648 134540677 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 12342 11579 345 325 0 11278 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 49368

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/177 12910
/proc/meminfo: memFree=27032964/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=265160 CPUtime=162.26 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 76355 0 0 0 16214 12 0 0 20 0 1 0 342139979 271523840 65576 33554432000 134512640 135840783 4293392848 4293392208 134550902 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 66290 65576 348 325 0 65226 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 265160

[startup+222.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/177 12911
/proc/meminfo: memFree=26825620/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=408044 CPUtime=222.24 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 112072 0 0 0 22204 20 0 0 20 0 1 0 342139979 417837056 101280 33554432000 134512640 135840783 4293392848 4293392208 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 102011 101280 348 325 0 100947 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 408044

[startup+282.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/178 12921
/proc/meminfo: memFree=26518848/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=649864 CPUtime=282.21 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 172540 0 0 0 28188 33 0 0 20 0 1 0 342139979 665460736 161745 33554432000 134512640 135840783 4293392848 4293392208 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 162466 161745 348 325 0 161402 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 649864

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/177 12921
/proc/meminfo: memFree=26264936/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=857912 CPUtime=342.2 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 224549 0 0 0 34176 44 0 0 20 0 1 0 342139979 878501888 213754 33554432000 134512640 135840783 4293392848 4293392160 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 214478 213754 348 325 0 213414 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 857912

[startup+402.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 12921
/proc/meminfo: memFree=26066812/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=1016996 CPUtime=402.18 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 264317 0 0 0 40164 54 0 0 20 0 1 0 342139979 1041403904 253520 33554432000 134512640 135840783 4293392848 4293392208 134551071 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 254249 253520 348 325 0 253185 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 1016996

[startup+462.306 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12921
/proc/meminfo: memFree=25830372/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=1201008 CPUtime=462.17 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 310338 0 0 0 46152 65 0 0 20 0 1 0 342139979 1229832192 299539 33554432000 134512640 135840783 4293392848 4293392160 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 300252 299539 348 325 0 299188 0
Current children cumulated CPU time (s) 462.17
Current children cumulated vsize (KiB) 1201008

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12922
/proc/meminfo: memFree=25640432/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=1349792 CPUtime=522.14 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 347527 0 0 0 52140 74 0 0 20 0 1 0 342139979 1382187008 336719 33554432000 134512640 135840783 4293392848 4293392208 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 337448 336719 348 325 0 336384 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 1349792

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12922
/proc/meminfo: memFree=25433008/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=1517004 CPUtime=582.11 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 389352 0 0 0 58128 83 0 0 20 0 1 0 342139979 1553412096 378539 33554432000 134512640 135840783 4293392848 4293372912 134574600 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 379251 378539 348 325 0 378187 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 1517004

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 12949
/proc/meminfo: memFree=24771536/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2044980 CPUtime=822.05 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 521335 0 0 0 82088 117 0 0 20 0 1 0 342139979 2094059520 510517 33554432000 134512640 135840783 4293392848 4293392160 134550910 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 511245 510517 348 325 0 510181 0
Current children cumulated CPU time (s) 822.05
Current children cumulated vsize (KiB) 2044980

[startup+882.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 12950
/proc/meminfo: memFree=24599460/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2186124 CPUtime=882.04 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 556618 0 0 0 88077 127 0 0 20 0 1 0 342139979 2238590976 545793 33554432000 134512640 135840783 4293392848 4293392208 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 546531 545793 348 325 0 545467 0
Current children cumulated CPU time (s) 882.04
Current children cumulated vsize (KiB) 2186124

[startup+942.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12950
/proc/meminfo: memFree=24449200/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2294700 CPUtime=942.01 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 583805 0 0 0 94067 134 0 0 20 0 1 0 342139979 2349772800 572961 33554432000 134512640 135840783 4293392848 4293392208 134550902 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 573675 572961 348 325 0 572611 0
Current children cumulated CPU time (s) 942.01
Current children cumulated vsize (KiB) 2294700

[startup+1002.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12950
/proc/meminfo: memFree=24309852/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2394972 CPUtime=1001.99 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 608887 0 0 0 100059 140 0 0 20 0 1 0 342139979 2452451328 598022 33554432000 134512640 135840783 4293392848 4293392160 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 598743 598022 348 325 0 597679 0
Current children cumulated CPU time (s) 1001.99
Current children cumulated vsize (KiB) 2394972

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12950
/proc/meminfo: memFree=24176208/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2498384 CPUtime=1061.96 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 634763 0 0 0 106049 147 0 0 20 0 1 0 342139979 2558345216 623886 33554432000 134512640 135840783 4293392848 4293392208 134551104 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 624596 623886 348 325 0 623532 0
Current children cumulated CPU time (s) 1061.96
Current children cumulated vsize (KiB) 2498384

[startup+1122.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12951
/proc/meminfo: memFree=24018760/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2622356 CPUtime=1121.94 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 665757 0 0 0 112038 156 0 0 20 0 1 0 342139979 2685292544 654857 33554432000 134512640 135840783 4293392848 4293372736 134586822 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 655589 654857 348 325 0 654525 0
Current children cumulated CPU time (s) 1121.94
Current children cumulated vsize (KiB) 2622356

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12951
/proc/meminfo: memFree=23899252/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2712804 CPUtime=1181.91 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 688385 0 0 0 118028 163 0 0 20 0 1 0 342139979 2777911296 677470 33554432000 134512640 135840783 4293392848 4293392208 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 678201 677470 348 325 0 677137 0
Current children cumulated CPU time (s) 1181.91
Current children cumulated vsize (KiB) 2712804

[startup+1242.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 12951
/proc/meminfo: memFree=23789788/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2789300 CPUtime=1241.88 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 707547 0 0 0 124020 168 0 0 20 0 1 0 342139979 2856243200 696611 33554432000 134512640 135840783 4293392848 4293392208 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 697325 696611 348 325 0 696261 0
Current children cumulated CPU time (s) 1241.88
Current children cumulated vsize (KiB) 2789300

[startup+1302.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 12954
/proc/meminfo: memFree=23687284/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2870044 CPUtime=1301.87 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 727745 0 0 0 130013 174 0 0 20 0 1 0 342139979 2938925056 716801 33554432000 134512640 135840783 4293392848 4293392208 134551063 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 717511 716801 348 325 0 716447 0
Current children cumulated CPU time (s) 1301.87
Current children cumulated vsize (KiB) 2870044

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12954
/proc/meminfo: memFree=23566420/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=2972016 CPUtime=1361.85 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 753247 0 0 0 136002 183 0 0 20 0 1 0 342139979 3043344384 742286 33554432000 134512640 135840783 4293392848 4293392208 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 743004 742286 348 325 0 741940 0
Current children cumulated CPU time (s) 1361.85
Current children cumulated vsize (KiB) 2972016

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12954
/proc/meminfo: memFree=23470728/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3056092 CPUtime=1421.83 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 774257 0 0 0 141995 188 0 0 20 0 1 0 342139979 3129438208 763282 33554432000 134512640 135840783 4293392848 4293392208 134550910 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 764023 763284 348 325 0 762959 0
Current children cumulated CPU time (s) 1421.83
Current children cumulated vsize (KiB) 3056092

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12955
/proc/meminfo: memFree=23347368/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3157976 CPUtime=1481.81 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 799765 0 0 0 147985 196 0 0 20 0 1 0 342139979 3233767424 788773 33554432000 134512640 135840783 4293392848 4293392208 134551312 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 789494 788773 348 325 0 788430 0
Current children cumulated CPU time (s) 1481.81
Current children cumulated vsize (KiB) 3157976

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12955
/proc/meminfo: memFree=23185580/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3295148 CPUtime=1541.79 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 834067 0 0 0 153973 206 0 0 20 0 1 0 342139979 3374231552 823058 33554432000 134512640 135840783 4293392848 4293392208 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 823787 823058 348 325 0 822723 0
Current children cumulated CPU time (s) 1541.79
Current children cumulated vsize (KiB) 3295148

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12955
/proc/meminfo: memFree=23061732/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3391964 CPUtime=1601.76 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 858272 0 0 0 159963 213 0 0 20 0 1 0 342139979 3473371136 847253 33554432000 134512640 135840783 4293392848 4293392160 134551660 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 847991 847253 348 325 0 846927 0
Current children cumulated CPU time (s) 1601.76
Current children cumulated vsize (KiB) 3391964

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12955
/proc/meminfo: memFree=22902172/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3517124 CPUtime=1661.74 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 889599 0 0 0 165954 220 0 0 20 0 1 0 342139979 3601534976 878563 33554432000 134512640 135840783 4293392848 4293392160 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 879281 878563 348 325 0 878217 0
Current children cumulated CPU time (s) 1661.74
Current children cumulated vsize (KiB) 3517124

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12955
/proc/meminfo: memFree=22763444/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3623816 CPUtime=1721.72 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 916278 0 0 0 171945 227 0 0 20 0 1 0 342139979 3710787584 905228 33554432000 134512640 135840783 4293392848 4293392208 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 905954 905228 348 325 0 904890 0
Current children cumulated CPU time (s) 1721.72
Current children cumulated vsize (KiB) 3623816

[startup+1782.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12956
/proc/meminfo: memFree=22650508/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3713812 CPUtime=1781.7 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 938810 0 0 0 177937 233 0 0 20 0 1 0 342139979 3802943488 927744 33554432000 134512640 135840783 4293392848 4293392208 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 928453 927744 348 325 0 927389 0
Current children cumulated CPU time (s) 1781.7
Current children cumulated vsize (KiB) 3713812



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.7 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 12995
/proc/meminfo: memFree=23792696/32873648 swapFree=7112/7112
[pid=12906] ppid=12904 vsize=3738052 CPUtime=1800.1 cores=1,3,5,7
/proc/12906/stat : 12906 (bsolo3.0.17) R 12904 12906 11604 0 -1 4202496 944855 0 0 0 179775 235 0 0 20 0 1 0 342139979 3827765248 933782 33554432000 134512640 135840783 4293392848 4293392208 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/12906/statm: 934513 933782 348 325 0 933449 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 3738052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.78
CPU time (s): 1800.18
CPU user time (s): 1797.75
CPU system time (s): 2.43063
CPU usage (%): 99.9668
Max. virtual memory (cumulated for all children) (KiB): 3738052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1797.75
system time used= 2.43063
maximum resident set size= 3735128
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 944858
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 542
involuntary context switches= 1808

runsolver used 3.61145 second user time and 9.05262 second system time

The end

Launcher Data

Begin job on node126 at 2012-06-03 23:49:01
IDJOB=3741553
IDBENCH=89877
IDSOLVER=2318
FILE ID=node126/3741553-1338760140
RUNJOBID= node126-1338747103-11621
PBS_JOBID= 14636777
Free space on /tmp= 70768 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-neos-544324.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741553-1338760140/watcher-3741553-1338760140 -o /tmp/evaluation-result-3741553-1338760140/solver-3741553-1338760140 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741553-1338760140.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 02fa27f3dafb4f59cf08d669298a5bbe
RANDOM SEED=40281862

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27550204 kB
Buffers:          429392 kB
Cached:          4000840 kB
SwapCached:         9476 kB
Active:          1608892 kB
Inactive:        2851084 kB
Active(anon):      19944 kB
Inactive(anon):    12168 kB
Active(file):    1588948 kB
Inactive(file):  2838916 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67094928 kB
Dirty:             28448 kB
Writeback:             0 kB
AnonPages:         28428 kB
Mapped:            11064 kB
Shmem:                 0 kB
Slab:             726100 kB
SReclaimable:     170160 kB
SUnreclaim:       555940 kB
KernelStack:        1440 kB
PageTables:         3896 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     143060 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70756 MiB
End job on node126 at 2012-06-04 00:19:03