Trace number 3742087

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.16 1800.68

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K93.opb
MD5SUM91412677f9785e1c6465ad7d3d170f82
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark510.634
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6324
Total number of constraints6512
Number of constraints which are clauses6419
Number of constraints which are cardinality constraints (but not clauses)93
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint93
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 94
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742087-1338766784.opb
0.00/0.00	c File size is 404707 bytes.
0.00/0.04	c Highest Coefficient sum: 94
0.00/0.04	c Parsing was ok!!
0.00/0.04	c Total parsing time: 0.038 s
0.00/0.04	c Var: 6324 Constr: 6512 6419/93/0 Lit: 40594 Watch. Lit: 19160
0.00/0.04	c Obj. Vars: 0 (0 % of total variables)
1.19/1.21	c Pre-processing Time: 1.212 s
1.19/1.21	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.19/1.21	c        0   5581     5825    37546    6    17557   91147      0      0 1.21
1.19/1.21	c Switching off LPR mode.
1800.08/1800.60	c      102   5581     5927    47119    7    17761  100262    102     82 1.23
1800.08/1800.60	c      252   5581     6077    64747   10    18061  110289    252    196 1.28
1800.08/1800.60	c      478   5581     6303    95129   15    18513  121318    478    354 1.35
1800.08/1800.60	c      817   5581     6642   133833   20    19191  133450    817    558 1.46
1800.08/1800.60	c     1326   5581     7151   189518   26    20209  146796   1326    801 1.65
1800.08/1800.60	c     2089   5581     7914   280783   35    21735  161476   2089   1076 1.94
1800.08/1800.60	c     3235   5581     9060   427213   47    24027  177624   3235   1306 2.48
1800.08/1800.60	c     4957   5581    10782   742044   68    27471  195387   4957   1493 3.32
1800.08/1800.60	c     7541   5581    13366  1412699  105    32639  214926   7541   1550 4.86
1800.08/1800.60	c    11420   5581    17245  2162369  125    40397  236419  11420   1520 7.51
1800.08/1800.60	c    17242   5581    23067  4269845  185    52041  260061  17242   1316 13.10
1800.08/1800.60	c    25981   5581    31806  8786394  276    69519  286068  25981    993 26.14
1800.08/1800.60	c    39091   5581    44916 15520024  345    95739  314675  39091    825 47.37
1800.08/1800.60	c    58767   5581    64592 27277226  422   135091  346143  58767    596 98.46
1800.08/1800.60	c    88277   5581    94102 51097394  543   194111  380758  88277    348 253.07
1800.08/1800.60	c   132547   5581   138372 115066774  831   282651  418834 132547    135 981.77
1800.08/1800.60	c Caught signal: 15
1800.08/1800.60	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.08/1800.60	c   16   164401  79336  1959052   170226 167366615 164401     91 1800.08
1800.08/1800.60	s UNKNOWN
1800.08/1800.60	c Total time: 1800.08 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742087-1338766784/watcher-3742087-1338766784 -o /tmp/evaluation-result-3742087-1338766784/solver-3742087-1338766784 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742087-1338766784.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14089
/proc/meminfo: memFree=26090368/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 342802816 4583424 157 33554432000 134512640 135840783 4289883488 4289882828 10769752 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 1119 157 136 325 0 39 0

[startup+0.103794 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14089
/proc/meminfo: memFree=26090368/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=6940 CPUtime=0.09 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 1140 0 0 0 9 0 0 0 20 0 1 0 342802816 7106560 977 33554432000 134512640 135840783 4289883488 4289806716 4006960 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 1735 977 344 325 0 671 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 6940

[startup+0.200213 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14089
/proc/meminfo: memFree=26090368/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=6940 CPUtime=0.18 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 1140 0 0 0 18 0 0 0 20 0 1 0 342802816 7106560 977 33554432000 134512640 135840783 4289883488 4289806576 134551058 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 1735 977 344 325 0 671 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 6940

[startup+0.300202 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14089
/proc/meminfo: memFree=26090368/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=6940 CPUtime=0.28 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 1141 0 0 0 28 0 0 0 20 0 1 0 342802816 7106560 978 33554432000 134512640 135840783 4289883488 4289806564 1577130 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 1735 978 344 325 0 671 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 6940

[startup+0.700184 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14089
/proc/meminfo: memFree=26090368/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=6940 CPUtime=0.68 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 1141 0 0 0 68 0 0 0 20 0 1 0 342802816 7106560 978 33554432000 134512640 135840783 4289883488 4289806784 134567665 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 1735 978 344 325 0 671 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 6940

[startup+1.50018 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14090
/proc/meminfo: memFree=26086012/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=8264 CPUtime=1.48 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 1587 0 0 0 148 0 0 0 20 0 1 0 342802816 8462336 1321 33554432000 134512640 135840783 4289883488 4289882784 134572687 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 2066 1322 349 325 0 1002 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 8264

[startup+3.10022 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14090
/proc/meminfo: memFree=26081408/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=14700 CPUtime=3.09 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 3220 0 0 0 308 1 0 0 20 0 1 0 342802816 15052800 2954 33554432000 134512640 135840783 4289883488 4289882988 134551677 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/14089/statm: 3675 2954 349 325 0 2611 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 14700

[startup+6.30026 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14090
/proc/meminfo: memFree=26060684/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=31692 CPUtime=6.28 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 7442 0 0 0 627 1 0 0 20 0 1 0 342802816 32452608 7176 33554432000 134512640 135840783 4289883488 4289879936 1582375 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 7923 7176 349 325 0 6859 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 31692

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14090
/proc/meminfo: memFree=26027468/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=60264 CPUtime=12.68 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 14610 0 0 0 1265 3 0 0 20 0 1 0 342802816 61710336 14344 33554432000 134512640 135840783 4289883488 4289882784 134572687 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 15066 14344 349 325 0 14002 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 60264

[startup+25.5066 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14093
/proc/meminfo: memFree=25958972/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=115552 CPUtime=25.48 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 28429 0 0 0 2542 6 0 0 20 0 1 0 342802816 118325248 28163 33554432000 134512640 135840783 4289883488 4289882848 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 28888 28163 349 325 0 27824 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 115552

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14093
/proc/meminfo: memFree=25839412/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=215476 CPUtime=51.08 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 53409 0 0 0 5096 12 0 0 20 0 1 0 342802816 220647424 53143 33554432000 134512640 135840783 4289883488 4289882848 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 53869 53143 349 325 0 52805 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 215476

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14093
/proc/meminfo: memFree=25634864/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=366664 CPUtime=102.27 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 91198 0 0 0 10207 20 0 0 20 0 1 0 342802816 375463936 90932 33554432000 134512640 135840783 4289883488 4289882848 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 91666 90932 349 325 0 90602 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 366664

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25457696/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=482800 CPUtime=162.26 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 120219 0 0 0 16200 26 0 0 20 0 1 0 342802816 494387200 119953 33554432000 134512640 135840783 4289883488 4289863520 134586540 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 120696 119953 349 325 0 119632 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 482800

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25279164/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=610200 CPUtime=222.26 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 152087 0 0 0 22191 35 0 0 20 0 1 0 342802816 624844800 151821 33554432000 134512640 135840783 4289883488 4289882848 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 152550 151821 349 325 0 151486 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 610200

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25133120/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=705092 CPUtime=282.24 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 175807 0 0 0 28184 40 0 0 20 0 1 0 342802816 722014208 175541 33554432000 134512640 135840783 4289883488 4289882848 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 176273 175541 349 325 0 175209 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 705092

[startup+342.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=24971576/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=797680 CPUtime=342.24 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 198966 0 0 0 34178 46 0 0 20 0 1 0 342802816 816824320 198700 33554432000 134512640 135840783 4289883488 4289882848 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 199420 198700 349 325 0 198356 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 797680

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=24818092/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=883928 CPUtime=402.22 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 220507 0 0 0 40172 50 0 0 20 0 1 0 342802816 905142272 220241 33554432000 134512640 135840783 4289883488 4289882848 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 220982 220241 349 325 0 219918 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 883928

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14095
/proc/meminfo: memFree=24688044/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=959616 CPUtime=462.22 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 239445 0 0 0 46168 54 0 0 20 0 1 0 342802816 982646784 239179 33554432000 134512640 135840783 4289883488 4289882848 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 239904 239179 349 325 0 238840 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 959616

[startup+522.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 14095
/proc/meminfo: memFree=24535428/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1027344 CPUtime=522.2 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 256387 0 0 0 52163 57 0 0 20 0 1 0 342802816 1052000256 256121 33554432000 134512640 135840783 4289883488 4289882848 134551104 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 256836 256121 349 325 0 255772 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 1027344

[startup+582.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 14095
/proc/meminfo: memFree=24376240/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1111012 CPUtime=582.2 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 277301 0 0 0 58157 63 0 0 20 0 1 0 342802816 1137676288 277035 33554432000 134512640 135840783 4289883488 4289882848 134551324 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 277753 277035 349 325 0 276689 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 1111012

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 14099
/proc/meminfo: memFree=23913584/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1346124 CPUtime=822.16 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 336068 0 0 0 82138 78 0 0 20 0 1 0 342802816 1378430976 335802 33554432000 134512640 135840783 4289883488 4289882848 134550872 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 336531 335802 349 325 0 335467 0
Current children cumulated CPU time (s) 822.16
Current children cumulated vsize (KiB) 1346124

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14099
/proc/meminfo: memFree=23822224/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1398392 CPUtime=882.16 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 349134 0 0 0 88135 81 0 0 20 0 1 0 342802816 1431953408 348868 33554432000 134512640 135840783 4289883488 4289882624 1579934 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 349598 348868 349 325 0 348534 0
Current children cumulated CPU time (s) 882.16
Current children cumulated vsize (KiB) 1398392

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14099
/proc/meminfo: memFree=23743636/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1446148 CPUtime=942.14 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 361065 0 0 0 94130 84 0 0 20 0 1 0 342802816 1480855552 360799 33554432000 134512640 135840783 4289883488 4289882848 134550910 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 361537 360799 349 325 0 360473 0
Current children cumulated CPU time (s) 942.14
Current children cumulated vsize (KiB) 1446148

[startup+1002.31 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 14099
/proc/meminfo: memFree=23654136/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1501508 CPUtime=1002.13 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 374921 0 0 0 100126 87 0 0 20 0 1 0 342802816 1537544192 374655 33554432000 134512640 135840783 4289883488 4289882848 134551071 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 375377 374655 349 325 0 374313 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 1501508

[startup+1062.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 14100
/proc/meminfo: memFree=23545664/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1555360 CPUtime=1062.13 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 388365 0 0 0 106121 92 0 0 20 0 1 0 342802816 1592688640 388099 33554432000 134512640 135840783 4289883488 4289882848 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 388840 388099 349 325 0 387776 0
Current children cumulated CPU time (s) 1062.13
Current children cumulated vsize (KiB) 1555360

[startup+1122.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 14139
/proc/meminfo: memFree=25751008/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1618768 CPUtime=1122.11 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 404223 0 0 0 112116 95 0 0 20 0 1 0 342802816 1657618432 403957 33554432000 134512640 135840783 4289883488 4289882848 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 404692 403957 349 325 0 403628 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 1618768

[startup+1182.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 14139
/proc/meminfo: memFree=25486748/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1686516 CPUtime=1182.08 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 421189 0 0 0 118109 99 0 0 20 0 1 0 342802816 1726992384 420888 33554432000 134512640 135840783 4289883488 4289882848 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 421629 420888 349 325 0 420565 0
Current children cumulated CPU time (s) 1182.08
Current children cumulated vsize (KiB) 1686516

[startup+1242.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/178 14142
/proc/meminfo: memFree=25306100/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1736672 CPUtime=1242.05 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 433763 0 0 0 124103 102 0 0 20 0 1 0 342802816 1778352128 433427 33554432000 134512640 135840783 4289883488 4289882848 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 434168 433427 349 325 0 433104 0
Current children cumulated CPU time (s) 1242.05
Current children cumulated vsize (KiB) 1736672

[startup+1302.3 s]
/proc/loadavg: 2.08 2.05 2.01 3/178 14165
/proc/meminfo: memFree=25157072/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1789176 CPUtime=1302.01 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 446929 0 0 0 130096 105 0 0 20 0 1 0 342802816 1832116224 446554 33554432000 134512640 135840783 4289883488 4289882848 134551186 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 447294 446554 349 325 0 446230 0
Current children cumulated CPU time (s) 1302.01
Current children cumulated vsize (KiB) 1789176

[startup+1362.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/177 14166
/proc/meminfo: memFree=25034596/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1830588 CPUtime=1361.99 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 457334 0 0 0 136092 107 0 0 20 0 1 0 342802816 1874522112 456925 33554432000 134512640 135840783 4289883488 4289882848 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 457647 456925 349 325 0 456583 0
Current children cumulated CPU time (s) 1361.99
Current children cumulated vsize (KiB) 1830588

[startup+1422.3 s]
/proc/loadavg: 2.04 2.05 2.00 3/177 14166
/proc/meminfo: memFree=24929720/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1869376 CPUtime=1421.96 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 467062 0 0 0 142086 110 0 0 20 0 1 0 342802816 1914241024 466616 33554432000 134512640 135840783 4289883488 4289882848 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 467344 466616 349 325 0 466280 0
Current children cumulated CPU time (s) 1421.96
Current children cumulated vsize (KiB) 1869376

[startup+1482.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/177 14166
/proc/meminfo: memFree=24809468/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1917288 CPUtime=1481.93 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 479086 0 0 0 148080 113 0 0 20 0 1 0 342802816 1963302912 478605 33554432000 134512640 135840783 4289883488 4289882848 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 479322 478605 349 325 0 478258 0
Current children cumulated CPU time (s) 1481.93
Current children cumulated vsize (KiB) 1917288

[startup+1542.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/177 14166
/proc/meminfo: memFree=24699632/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=1957744 CPUtime=1541.91 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 489232 0 0 0 154076 115 0 0 20 0 1 0 342802816 2004729856 488715 33554432000 134512640 135840783 4289883488 4289882848 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 489436 488715 349 325 0 488372 0
Current children cumulated CPU time (s) 1541.91
Current children cumulated vsize (KiB) 1957744

[startup+1602.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 14166
/proc/meminfo: memFree=24597980/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=2001092 CPUtime=1601.87 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 500087 0 0 0 160070 117 0 0 20 0 1 0 342802816 2049118208 499535 33554432000 134512640 135840783 4289883488 4289882848 134551186 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 500273 499535 349 325 0 499209 0
Current children cumulated CPU time (s) 1601.87
Current children cumulated vsize (KiB) 2001092

[startup+1662.31 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 14167
/proc/meminfo: memFree=24500172/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=2043852 CPUtime=1661.84 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 510827 0 0 0 166065 119 0 0 20 0 1 0 342802816 2092904448 510241 33554432000 134512640 135840783 4289883488 4289882848 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 510963 510241 349 325 0 509899 0
Current children cumulated CPU time (s) 1661.84
Current children cumulated vsize (KiB) 2043852

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 14167
/proc/meminfo: memFree=24395792/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=2088616 CPUtime=1721.8 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 522054 0 0 0 172058 122 0 0 20 0 1 0 342802816 2138742784 521430 33554432000 134512640 135840783 4289883488 4289882848 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 522154 521430 349 325 0 521090 0
Current children cumulated CPU time (s) 1721.8
Current children cumulated vsize (KiB) 2088616

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14167
/proc/meminfo: memFree=24281740/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=2134692 CPUtime=1781.77 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 533613 0 0 0 178052 125 0 0 20 0 1 0 342802816 2185924608 532955 33554432000 134512640 135840783 4289883488 4289882848 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 533673 532955 349 325 0 532609 0
Current children cumulated CPU time (s) 1781.77
Current children cumulated vsize (KiB) 2134692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14167
/proc/meminfo: memFree=24245128/32873844 swapFree=6608/6608
[pid=14089] ppid=14087 vsize=2150148 CPUtime=1800.08 cores=0,2,4,6
/proc/14089/stat : 14089 (bsolo3.0.17) R 14087 14089 12501 0 -1 4202496 537487 0 0 0 179881 127 0 0 20 0 1 0 342802816 2201751552 536817 33554432000 134512640 135840783 4289883488 4289882788 1587784 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14089/statm: 537537 536817 349 325 0 536473 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 2150148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.68
CPU time (s): 1800.16
CPU user time (s): 1798.81
CPU system time (s): 1.3448
CPU usage (%): 99.971
Max. virtual memory (cumulated for all children) (KiB): 2150148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.81
system time used= 1.34479
maximum resident set size= 2147268
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 537490
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 429
involuntary context switches= 2047

runsolver used 4.01139 second user time and 8.5327 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-04 01:39:44
IDJOB=3742087
IDBENCH=90131
IDSOLVER=2318
FILE ID=node140/3742087-1338766784
RUNJOBID= node140-1338749243-12517
PBS_JOBID= 14636796
Free space on /tmp= 70608 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K93.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742087-1338766784/watcher-3742087-1338766784 -o /tmp/evaluation-result-3742087-1338766784/solver-3742087-1338766784 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742087-1338766784.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 91412677f9785e1c6465ad7d3d170f82
RANDOM SEED=748316070

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26090368 kB
Buffers:          518076 kB
Cached:          4015124 kB
SwapCached:         1620 kB
Active:          2849888 kB
Inactive:        2999932 kB
Active(anon):    1309032 kB
Inactive(anon):     9476 kB
Active(file):    1540856 kB
Inactive(file):  2990456 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:              7004 kB
Writeback:             0 kB
AnonPages:       1321348 kB
Mapped:            11732 kB
Shmem:                 8 kB
Slab:             791508 kB
SReclaimable:     233604 kB
SUnreclaim:       557904 kB
KernelStack:        1464 kB
PageTables:         6284 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1431644 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70604 MiB
End job on node140 at 2012-06-04 02:09:47