Trace number 3742412

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.06 1800.75

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K177.opb
MD5SUM8e674dc671e8e6c3e0a48d5fff5f7edd
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21063
Total number of constraints21419
Number of constraints which are clauses21242
Number of constraints which are cardinality constraints (but not clauses)177
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint177
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 178
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742412-1338770514.opb
0.00/0.00	c File size is 1455100 bytes.
0.09/0.14	c Highest Coefficient sum: 178
0.09/0.14	c Parsing was ok!!
0.09/0.14	c Total parsing time: 0.137 s
0.09/0.15	c Var: 21063 Constr: 21419 21242/177/0 Lit: 137815 Watch. Lit: 63545
0.09/0.15	c Obj. Vars: 0 (0 % of total variables)
9.79/9.81	c Pre-processing Time: 9.808 s
9.79/9.81	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
9.79/9.81	c        0  19507    19969   131282    6    60225  180030      0      0 9.81
9.79/9.81	c Switching off LPR mode.
1800.02/1800.71	c      100  19507    20069   135348    6    60425  198034    100     10 9.87
1800.02/1800.71	c      251  19507    20220   165990    8    60727  217838    251     25 9.98
1800.02/1800.71	c      476  19507    20445   179625    8    61177  239622    476     46 10.21
1800.02/1800.71	c      814  19507    20783   213113   10    61853  263585    814     77 10.53
1800.02/1800.71	c     1322  19507    21291   297146   13    62869  289944   1322    120 10.94
1800.02/1800.71	c     2085  19507    22054   407954   18    64395  318939   2085    174 11.96
1800.02/1800.71	c     3231  19507    23200   562917   24    66687  350833   3231    245 13.19
1800.02/1800.71	c     4952  19507    24921   750182   30    70129  385917   4952    325 15.20
1800.02/1800.71	c     7536  19507    27505  1045485   38    75297  424509   7536    406 18.56
1800.02/1800.71	c    11415  19507    31384  1620549   51    83055  466960  11415    489 23.34
1800.02/1800.71	c    17237  19507    37206  2600232   69    94699  513657  17237    554 31.06
1800.02/1800.71	c    25978  19507    45947  4620308  100   112181  565023  25978    587 44.23
1800.02/1800.71	c    39088  19507    59057  8510913  144   138401  621526  39088    536 72.81
1800.02/1800.71	c    58759  19507    78728 14865562  188   177743  683679  58759    484 121.37
1800.02/1800.71	c    88269  19507   108238 23720195  219   236763  752047  88269    384 229.44
1800.02/1800.71	c   132541  19507   152510 38878412  254   325307  827252 132541    288 459.87
1800.02/1800.71	c   198951  19507   218920 77184297  352   458127  909978 198951    213 933.37
1800.02/1800.71	c Caught signal: 15
1800.02/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.02/1800.71	c   17   287860 181335 19008472   307829 130159392 287860    159 1800.02
1800.02/1800.71	s UNKNOWN
1800.02/1800.71	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742412-1338770514/watcher-3742412-1338770514 -o /tmp/evaluation-result-3742412-1338770514/solver-3742412-1338770514 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742412-1338770514.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7950
/proc/meminfo: memFree=27238572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4194304 200 0 0 0 0 0 0 0 20 0 1 0 343177068 4583424 150 33554432000 134512640 135840783 4293006432 4293005572 5435020 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 1119 154 133 325 0 39 0

[startup+0.05791 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7950
/proc/meminfo: memFree=27238572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=8632 CPUtime=0.05 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 1269 0 0 0 5 0 0 0 20 0 1 0 343177068 8839168 1165 33554432000 134512640 135840783 4293006432 4293005468 14938624 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 2158 1165 457 325 0 738 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 8632

[startup+0.100223 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7950
/proc/meminfo: memFree=27238572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=9996 CPUtime=0.09 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 1712 0 0 0 9 0 0 0 20 0 1 0 343177068 10235904 1608 33554432000 134512640 135840783 4293006432 4293005152 1698557 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 2499 1609 571 325 0 1079 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9996

[startup+0.300209 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7950
/proc/meminfo: memFree=27238572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=12712 CPUtime=0.29 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 2805 0 0 0 29 0 0 0 20 0 1 0 343177068 13017088 2345 33554432000 134512640 135840783 4293006432 4292752752 134583223 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 3178 2345 344 325 0 2114 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12712

[startup+0.70019 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7950
/proc/meminfo: memFree=27238572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=12712 CPUtime=0.69 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 2806 0 0 0 69 0 0 0 20 0 1 0 343177068 13017088 2346 33554432000 134512640 135840783 4293006432 4292752640 134551330 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 3178 2346 344 325 0 2114 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 12712

[startup+1.50019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27230040/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=12712 CPUtime=1.49 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 2806 0 0 0 149 0 0 0 20 0 1 0 343177068 13017088 2346 33554432000 134512640 135840783 4293006432 4292752560 1703494 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 3178 2346 344 325 0 2114 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 12712

[startup+3.10019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27228280/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=12712 CPUtime=3.08 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 2807 0 0 0 308 0 0 0 20 0 1 0 343177068 13017088 2347 33554432000 134512640 135840783 4293006432 4292752636 14938624 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 3178 2347 344 325 0 2114 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 12712

[startup+6.30019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27224312/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=12712 CPUtime=6.28 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 2808 0 0 0 628 0 0 0 20 0 1 0 343177068 13017088 2348 33554432000 134512640 135840783 4293006432 4292752640 134551084 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 3178 2348 344 325 0 2114 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 12712

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27217208/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=17900 CPUtime=12.69 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 4341 0 0 0 1267 2 0 0 20 0 1 0 343177068 18329600 3673 33554432000 134512640 135840783 4293006432 4293005424 14929900 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 4475 3673 349 325 0 3411 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 17900

[startup+25.5002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27183944/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=34980 CPUtime=25.48 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 8624 0 0 0 2545 3 0 0 20 0 1 0 343177068 35819520 7956 33554432000 134512640 135840783 4293006432 4293005744 134551269 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/7950/statm: 8745 7956 349 325 0 7681 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 34980

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=27100212/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=84444 CPUtime=51.07 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 20973 0 0 0 5100 7 0 0 20 0 1 0 343177068 86470656 20305 33554432000 134512640 135840783 4293006432 4293005792 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 21111 20305 349 325 0 20047 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 84444

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=26953936/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=167452 CPUtime=102.27 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 41736 0 0 0 10215 12 0 0 20 0 1 0 343177068 171470848 41068 33554432000 134512640 135840783 4293006432 4293002768 1699136 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 41863 41068 349 325 0 40799 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 167452

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7951
/proc/meminfo: memFree=26776520/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=264232 CPUtime=162.25 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 65920 0 0 0 16208 17 0 0 20 0 1 0 343177068 270573568 65252 33554432000 134512640 135840783 4293006432 4293005616 134574742 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 66058 65252 349 325 0 64994 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 264232

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7952
/proc/meminfo: memFree=26652176/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=313400 CPUtime=222.25 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 78232 0 0 0 22205 20 0 0 20 0 1 0 343177068 320921600 77564 33554432000 134512640 135840783 4293006432 4293005744 134551071 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 78350 77564 349 325 0 77286 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 313400

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7952
/proc/meminfo: memFree=26546432/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=366584 CPUtime=282.24 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 91539 0 0 0 28199 25 0 0 20 0 1 0 343177068 375382016 90871 33554432000 134512640 135840783 4293006432 4293005744 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 91646 90871 349 325 0 90582 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 366584

[startup+342.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 7952
/proc/meminfo: memFree=26427916/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=406248 CPUtime=342.23 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 101443 0 0 0 34196 27 0 0 20 0 1 0 343177068 415997952 100775 33554432000 134512640 135840783 4293006432 4293005792 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 101562 100775 349 325 0 100498 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 406248

[startup+402.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 7952
/proc/meminfo: memFree=26290428/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=468808 CPUtime=402.22 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 117091 0 0 0 40190 32 0 0 20 0 1 0 343177068 480059392 116423 33554432000 134512640 135840783 4293006432 4293005744 134551071 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 117202 116423 349 325 0 116138 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 468808

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7952
/proc/meminfo: memFree=26178484/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=523324 CPUtime=462.21 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 130702 0 0 0 46187 34 0 0 20 0 1 0 343177068 535883776 130034 33554432000 134512640 135840783 4293006432 4293005792 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 130831 130034 349 325 0 129767 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 523324

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7956
/proc/meminfo: memFree=26029704/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=588364 CPUtime=522.2 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 146963 0 0 0 52182 38 0 0 20 0 1 0 343177068 602484736 146295 33554432000 134512640 135840783 4293006432 4293005792 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 147091 146295 349 325 0 146027 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 588364

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7956
/proc/meminfo: memFree=25891480/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=651196 CPUtime=582.2 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 162678 0 0 0 58177 43 0 0 20 0 1 0 343177068 666824704 162010 33554432000 134512640 135840783 4293006432 4292998688 1701159 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 162799 162010 349 325 0 161735 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 651196

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7957
/proc/meminfo: memFree=25308572/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=947504 CPUtime=882.14 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 236757 0 0 0 88150 64 0 0 20 0 1 0 343177068 970244096 236089 33554432000 134512640 135840783 4293006432 4293005668 1706547 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 236876 236089 349 325 0 235812 0
Current children cumulated CPU time (s) 882.14
Current children cumulated vsize (KiB) 947504

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7957
/proc/meminfo: memFree=25182864/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1023340 CPUtime=942.14 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 255706 0 0 0 94145 69 0 0 20 0 1 0 343177068 1047900160 255038 33554432000 134512640 135840783 4293006432 4292995680 1701159 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 255835 255038 349 325 0 254771 0
Current children cumulated CPU time (s) 942.14
Current children cumulated vsize (KiB) 1023340

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7957
/proc/meminfo: memFree=25097828/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1051824 CPUtime=1002.13 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 262854 0 0 0 100142 71 0 0 20 0 1 0 343177068 1077067776 262186 33554432000 134512640 135840783 4293006432 4293005792 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 262956 262186 349 325 0 261892 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 1051824

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7996
/proc/meminfo: memFree=27344284/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1094944 CPUtime=1062.11 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 273611 0 0 0 106137 74 0 0 20 0 1 0 343177068 1121222656 272935 33554432000 134512640 135840783 4293006432 4293005792 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 273736 272935 349 325 0 272672 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 1094944

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8000
/proc/meminfo: memFree=27107844/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1154456 CPUtime=1122.06 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 288562 0 0 0 112129 77 0 0 20 0 1 0 343177068 1182162944 287843 33554432000 134512640 135840783 4293006432 4293005784 14543056 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 288614 287843 349 325 0 287550 0
Current children cumulated CPU time (s) 1122.06
Current children cumulated vsize (KiB) 1154456

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 8023
/proc/meminfo: memFree=26908844/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1211992 CPUtime=1182.02 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 302979 0 0 0 118122 80 0 0 20 0 1 0 343177068 1241079808 302223 33554432000 134512640 135840783 4293006432 4292974896 134574500 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 302998 302223 349 325 0 301934 0
Current children cumulated CPU time (s) 1182.02
Current children cumulated vsize (KiB) 1211992

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8023
/proc/meminfo: memFree=26750656/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1277212 CPUtime=1241.97 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 319298 0 0 0 124113 84 0 0 20 0 1 0 343177068 1307865088 318503 33554432000 134512640 135840783 4293006432 4293005792 134550878 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 319303 318503 349 325 0 318239 0
Current children cumulated CPU time (s) 1241.97
Current children cumulated vsize (KiB) 1277212

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8023
/proc/meminfo: memFree=26605480/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1322192 CPUtime=1301.93 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 330587 0 0 0 130106 87 0 0 20 0 1 0 343177068 1353924608 329748 33554432000 134512640 135840783 4293006432 4293005792 134550902 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 330548 329748 349 325 0 329484 0
Current children cumulated CPU time (s) 1301.93
Current children cumulated vsize (KiB) 1322192

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8023
/proc/meminfo: memFree=26499612/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1373776 CPUtime=1361.88 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 343525 0 0 0 136099 89 0 0 20 0 1 0 343177068 1406746624 342648 33554432000 134512640 135840783 4293006432 4293005740 14543040 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 343444 342648 349 325 0 342380 0
Current children cumulated CPU time (s) 1361.88
Current children cumulated vsize (KiB) 1373776

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8024
/proc/meminfo: memFree=26403292/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1407208 CPUtime=1421.84 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 351941 0 0 0 142093 91 0 0 20 0 1 0 343177068 1440980992 351023 33554432000 134512640 135840783 4293006432 4293005792 134551671 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 351802 351023 349 325 0 350738 0
Current children cumulated CPU time (s) 1421.84
Current children cumulated vsize (KiB) 1407208

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8024
/proc/meminfo: memFree=26316396/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1443200 CPUtime=1481.8 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 360956 0 0 0 148087 93 0 0 20 0 1 0 343177068 1477836800 360008 33554432000 134512640 135840783 4293006432 4293005792 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 360800 360008 349 325 0 359736 0
Current children cumulated CPU time (s) 1481.8
Current children cumulated vsize (KiB) 1443200

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8024
/proc/meminfo: memFree=26174692/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1491116 CPUtime=1541.76 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 372962 0 0 0 154080 96 0 0 20 0 1 0 343177068 1526902784 371982 33554432000 134512640 135840783 4293006432 4293005792 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 372779 371982 349 325 0 371715 0
Current children cumulated CPU time (s) 1541.76
Current children cumulated vsize (KiB) 1491116

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8024
/proc/meminfo: memFree=26072668/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1543532 CPUtime=1601.71 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 386112 0 0 0 160072 99 0 0 20 0 1 0 343177068 1580576768 385096 33554432000 134512640 135840783 4293006432 4293005792 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 385883 385096 349 325 0 384819 0
Current children cumulated CPU time (s) 1601.71
Current children cumulated vsize (KiB) 1543532

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8024
/proc/meminfo: memFree=25992716/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1572064 CPUtime=1661.68 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 393283 0 0 0 166067 101 0 0 20 0 1 0 343177068 1609793536 392241 33554432000 134512640 135840783 4293006432 4293005792 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 393016 392241 349 325 0 391952 0
Current children cumulated CPU time (s) 1661.68
Current children cumulated vsize (KiB) 1572064

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8027
/proc/meminfo: memFree=25868860/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1651564 CPUtime=1721.65 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 413164 0 0 0 172059 106 0 0 20 0 1 0 343177068 1691201536 412090 33554432000 134512640 135840783 4293006432 4293005792 134550902 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 412891 412090 349 325 0 411827 0
Current children cumulated CPU time (s) 1721.65
Current children cumulated vsize (KiB) 1651564

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 8028
/proc/meminfo: memFree=25763248/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1690028 CPUtime=1781.61 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 422806 0 0 0 178052 109 0 0 20 0 1 0 343177068 1730588672 421707 33554432000 134512640 135840783 4293006432 4293005792 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 422507 421707 349 325 0 421443 0
Current children cumulated CPU time (s) 1781.61
Current children cumulated vsize (KiB) 1690028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 8028
/proc/meminfo: memFree=25719940/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1696864 CPUtime=1800.02 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 424553 0 0 0 179892 110 0 0 20 0 1 0 343177068 1737588736 423443 33554432000 134512640 135840783 4293006432 4293005952 134551955 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 424216 423443 349 325 0 423152 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1696864

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.71 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 8028
/proc/meminfo: memFree=25719940/32873844 swapFree=7112/7112
[pid=7950] ppid=7948 vsize=1696864 CPUtime=1800.02 cores=0,2,4,6
/proc/7950/stat : 7950 (bsolo3.0.17) R 7948 7950 5948 0 -1 4202496 424553 0 0 0 179892 110 0 0 20 0 1 0 343177068 1737588736 423443 33554432000 134512640 135840783 4293006432 4293005952 134551955 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/7950/statm: 424216 423443 349 325 0 423152 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1696864

Child status: 15
Real time (s): 1800.75
CPU time (s): 1800.06
CPU user time (s): 1798.92
CPU system time (s): 1.13583
CPU usage (%): 99.9617
Max. virtual memory (cumulated for all children) (KiB): 1696864

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.92
system time used= 1.13583
maximum resident set size= 1693772
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 424556
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 460
involuntary context switches= 1967

runsolver used 3.34049 second user time and 9.10462 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-04 02:41:54
IDJOB=3742412
IDBENCH=90182
IDSOLVER=2318
FILE ID=node119/3742412-1338770514
RUNJOBID= node119-1338748763-5964
PBS_JOBID= 14636790
Free space on /tmp= 70892 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K177.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742412-1338770514/watcher-3742412-1338770514 -o /tmp/evaluation-result-3742412-1338770514/solver-3742412-1338770514 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742412-1338770514.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e674dc671e8e6c3e0a48d5fff5f7edd
RANDOM SEED=1140721084

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27239728 kB
Buffers:          430048 kB
Cached:          3142116 kB
SwapCached:         1936 kB
Active:          2726648 kB
Inactive:        2057308 kB
Active(anon):    1207316 kB
Inactive(anon):     6616 kB
Active(file):    1519332 kB
Inactive(file):  2050692 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:              8160 kB
Writeback:             0 kB
AnonPages:       1217232 kB
Mapped:            13116 kB
Shmem:                 0 kB
Slab:             705972 kB
SReclaimable:     148120 kB
SUnreclaim:       557852 kB
KernelStack:        1480 kB
PageTables:         6580 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1330440 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70884 MiB
End job on node119 at 2012-06-04 03:11:57