Trace number 3741996

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.08 1800.76

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K106.opb
MD5SUMafe4117ba13dcfbcd06fd88e1353402a
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark143.74
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables7208
Total number of constraints7422
Number of constraints which are clauses7316
Number of constraints which are cardinality constraints (but not clauses)106
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint106
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 107
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741996-1338766097.opb
0.00/0.00	c File size is 462421 bytes.
0.00/0.04	c Highest Coefficient sum: 107
0.00/0.04	c Parsing was ok!!
0.00/0.04	c Total parsing time: 0.039 s
0.00/0.04	c Var: 7208 Constr: 7422 7316/106/0 Lit: 46301 Watch. Lit: 21838
0.00/0.04	c Obj. Vars: 0 (0 % of total variables)
1.28/1.35	c Pre-processing Time: 1.35 s
1.28/1.35	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.28/1.35	c        0   6452     6722    43175    6    20209  104442      0      0 1.35
1.28/1.35	c Switching off LPR mode.
1800.03/1800.71	c      100   6452     6822    52946    7    20409  114887    100     72 1.37
1800.03/1800.71	c      250   6452     6972    80874   11    20709  126376    250    177 1.41
1800.03/1800.71	c      475   6452     7197   115344   16    21159  139014    475    323 1.47
1800.03/1800.71	c      813   6452     7535   149112   19    21835  152916    813    499 1.63
1800.03/1800.71	c     1321   6452     8043   242968   30    22851  168208   1321    738 1.79
1800.03/1800.71	c     2085   6452     8807   316052   35    24379  185029   2085    959 2.17
1800.03/1800.71	c     3234   6452     9956   498766   50    26677  203532   3234   1217 2.66
1800.03/1800.71	c     4962   6452    11684   793882   67    30133  223886   4962   1506 3.29
1800.03/1800.71	c     7552   6452    14274  2232290  156    35313  246275   7552   1519 4.97
1800.03/1800.71	c    11433   6452    18155  3581036  197    43075  270903  11433   1357 8.42
1800.03/1800.71	c    17255   6452    23977  4974239  207    54719  297994  17255   1233 13.99
1800.03/1800.71	c    25994   6452    32716  7230506  221    72197  327794  25994   1105 23.51
1800.03/1800.71	c    39105   6452    45827 11177218  243    98419  360574  39105    868 45.01
1800.03/1800.71	c    58776   6452    65498 28569530  436   137761  396632  58776    531 110.60
1800.03/1800.71	c    88286   6452    95008 42026205  442   196781  436296  88286    413 213.64
1800.03/1800.71	c   132556   6452   139278 94992506  682   285321  479926 132556    223 592.36
1800.03/1800.71	c   198972   6452   205694 152051017  739   418153  527919 198972    152 1300.65
1800.03/1800.71	c Caught signal: 15
1800.03/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.03/1800.71	c   17   244801 131958  4104868   251523 181472990 244801    135 1800.04
1800.03/1800.71	s UNKNOWN
1800.03/1800.71	c Total time: 1800.04 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741996-1338766097/watcher-3741996-1338766097 -o /tmp/evaluation-result-3741996-1338766097/solver-3741996-1338766097 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741996-1338766097.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.00 1.99 3/176 14045
/proc/meminfo: memFree=25486388/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4194304 132 0 0 0 0 0 0 0 20 0 1 0 342734161 4583424 84 33554432000 134512640 135840783 4293437088 4293436004 10820152 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 1119 102 83 325 0 39 0

[startup+0.0525751 s]
/proc/loadavg: 1.93 2.00 1.99 3/176 14045
/proc/meminfo: memFree=25486388/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=7268 CPUtime=0.04 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 1230 0 0 0 4 0 0 0 20 0 1 0 342734161 7442432 1053 33554432000 134512640 135840783 4293437088 4293349708 1967152 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 1817 1053 342 325 0 753 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 7268

[startup+0.100268 s]
/proc/loadavg: 1.93 2.00 1.99 3/176 14045
/proc/meminfo: memFree=25486388/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=7268 CPUtime=0.09 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 1231 0 0 0 9 0 0 0 20 0 1 0 342734161 7442432 1054 33554432000 134512640 135840783 4293437088 4293349708 1967152 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 1817 1054 342 325 0 753 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7268

[startup+0.300223 s]
/proc/loadavg: 1.93 2.00 1.99 3/176 14045
/proc/meminfo: memFree=25486388/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=7268 CPUtime=0.29 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 1233 0 0 0 29 0 0 0 20 0 1 0 342734161 7442432 1056 33554432000 134512640 135840783 4293437088 4293349708 1967152 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 1817 1056 342 325 0 753 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7268

[startup+0.700219 s]
/proc/loadavg: 1.93 2.00 1.99 3/176 14045
/proc/meminfo: memFree=25486388/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=7268 CPUtime=0.68 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 1233 0 0 0 68 0 0 0 20 0 1 0 342734161 7442432 1056 33554432000 134512640 135840783 4293437088 4293349708 1967152 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 1817 1056 342 325 0 753 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 7268

[startup+1.50023 s]
/proc/loadavg: 1.93 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25482900/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=8220 CPUtime=1.48 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 1630 0 0 0 148 0 0 0 20 0 1 0 342734161 8417280 1326 33554432000 134512640 135840783 4293437088 4293436224 11328414 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 2055 1326 347 325 0 991 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 8220

[startup+3.10023 s]
/proc/loadavg: 1.93 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25477800/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=15292 CPUtime=3.09 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 3386 0 0 0 308 1 0 0 20 0 1 0 342734161 15659008 3082 33554432000 134512640 135840783 4293437088 4293429872 2671145 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 3823 3082 347 325 0 2759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 15292

[startup+6.3003 s]
/proc/loadavg: 1.94 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25443948/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=41780 CPUtime=6.28 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 10015 0 0 0 626 2 0 0 20 0 1 0 342734161 42782720 9711 33554432000 134512640 135840783 4293437088 4293431904 11330855 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 10445 9711 347 325 0 9381 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 41780

[startup+12.7003 s]
/proc/loadavg: 1.94 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25409228/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=67132 CPUtime=12.69 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 16350 0 0 0 1265 4 0 0 20 0 1 0 342734161 68743168 16046 33554432000 134512640 135840783 4293437088 4293433248 11330855 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 16783 16047 347 325 0 15719 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 67132

[startup+25.5004 s]
/proc/loadavg: 1.95 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25356636/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=104468 CPUtime=25.48 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 25679 0 0 0 2542 6 0 0 20 0 1 0 342734161 106975232 25375 33554432000 134512640 135840783 4293437088 4293436448 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 26117 25375 347 325 0 25053 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 104468

[startup+51.1004 s]
/proc/loadavg: 1.97 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25272764/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=165772 CPUtime=51.07 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 41008 0 0 0 5095 12 0 0 20 0 1 0 342734161 169750528 40704 33554432000 134512640 135840783 4293437088 4293436304 134574896 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 41443 40704 347 325 0 40379 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 165772

[startup+102.3 s]
/proc/loadavg: 1.98 2.00 1.99 3/177 14046
/proc/meminfo: memFree=25038944/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=345884 CPUtime=102.28 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 86047 0 0 0 10205 23 0 0 20 0 1 0 342734161 354185216 85743 33554432000 134512640 135840783 4293437088 4293436448 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 86471 85743 347 325 0 85407 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 345884

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/178 14049
/proc/meminfo: memFree=24863008/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=460452 CPUtime=162.26 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 114682 0 0 0 16197 29 0 0 20 0 1 0 342734161 471502848 114378 33554432000 134512640 135840783 4293437088 4293436448 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 115113 114378 347 325 0 114049 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 460452

[startup+222.307 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 14050
/proc/meminfo: memFree=24680144/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=561120 CPUtime=222.26 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 139833 0 0 0 22188 38 0 0 20 0 1 0 342734161 574586880 139529 33554432000 134512640 135840783 4293437088 4293436448 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 140280 139529 347 325 0 139216 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 561120

[startup+282.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 14050
/proc/meminfo: memFree=24477432/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=690368 CPUtime=282.24 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 172161 0 0 0 28176 48 0 0 20 0 1 0 342734161 706936832 171857 33554432000 134512640 135840783 4293437088 4293436448 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 172592 171857 347 325 0 171528 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 690368

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 14050
/proc/meminfo: memFree=24271124/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=831300 CPUtime=342.23 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 207408 0 0 0 34167 56 0 0 20 0 1 0 342734161 851251200 207104 33554432000 134512640 135840783 4293437088 4293395760 134547760 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 207825 207104 347 325 0 206761 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 831300

[startup+402.3 s]
/proc/loadavg: 2.10 2.03 2.00 3/177 14050
/proc/meminfo: memFree=24082300/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=952628 CPUtime=402.23 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 237721 0 0 0 40159 64 0 0 20 0 1 0 342734161 975491072 237417 33554432000 134512640 135840783 4293437088 4293436448 134550902 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 238157 237417 347 325 0 237093 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 952628

[startup+462.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 14050
/proc/meminfo: memFree=23941216/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1031024 CPUtime=462.22 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 257317 0 0 0 46153 69 0 0 20 0 1 0 342734161 1055768576 257013 33554432000 134512640 135840783 4293437088 4293436448 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 257756 257013 347 325 0 256692 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 1031024

[startup+522.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 14051
/proc/meminfo: memFree=23807448/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1115420 CPUtime=522.21 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 278428 0 0 0 52145 76 0 0 20 0 1 0 342734161 1142190080 278124 33554432000 134512640 135840783 4293437088 4293436448 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 278855 278124 347 325 0 277791 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 1115420

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 14051
/proc/meminfo: memFree=23674672/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1210108 CPUtime=582.19 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 302101 0 0 0 58136 83 0 0 20 0 1 0 342734161 1239150592 301797 33554432000 134512640 135840783 4293437088 4293436448 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 302527 301797 347 325 0 301463 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 1210108

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25528780/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1429664 CPUtime=822.09 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 357087 0 0 0 82110 99 0 0 20 0 1 0 342734161 1463975936 356688 33554432000 134512640 135840783 4293437088 4293436440 2275536 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 357416 356688 347 325 0 356352 0
Current children cumulated CPU time (s) 822.09
Current children cumulated vsize (KiB) 1429664

[startup+882.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25349504/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1488992 CPUtime=882.07 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 371970 0 0 0 88104 103 0 0 20 0 1 0 342734161 1524727808 371538 33554432000 134512640 135840783 4293437088 4293436448 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 372248 371538 347 325 0 371184 0
Current children cumulated CPU time (s) 882.07
Current children cumulated vsize (KiB) 1488992

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25197012/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1534440 CPUtime=942.03 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 383370 0 0 0 94097 106 0 0 20 0 1 0 342734161 1571266560 382899 33554432000 134512640 135840783 4293437088 4293436448 134551326 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 383610 382899 347 325 0 382546 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 1534440

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=25057044/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1592252 CPUtime=1001.99 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 397846 0 0 0 100088 111 0 0 20 0 1 0 342734161 1630466048 397337 33554432000 134512640 135840783 4293437088 4293436448 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 398063 397337 347 325 0 396999 0
Current children cumulated CPU time (s) 1001.99
Current children cumulated vsize (KiB) 1592252

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14094
/proc/meminfo: memFree=24879256/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1671048 CPUtime=1061.95 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 417574 0 0 0 106079 116 0 0 20 0 1 0 342734161 1711153152 417028 33554432000 134512640 135840783 4293437088 4293436448 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 417762 417028 347 325 0 416698 0
Current children cumulated CPU time (s) 1061.95
Current children cumulated vsize (KiB) 1671048

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14095
/proc/meminfo: memFree=24748216/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1723952 CPUtime=1121.93 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 430830 0 0 0 112073 120 0 0 20 0 1 0 342734161 1765326848 430261 33554432000 134512640 135840783 4293437088 4293436448 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 430988 430261 347 325 0 429924 0
Current children cumulated CPU time (s) 1121.93
Current children cumulated vsize (KiB) 1723952

[startup+1182.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 14095
/proc/meminfo: memFree=24600312/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1803924 CPUtime=1181.9 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 450859 0 0 0 118064 126 0 0 20 0 1 0 342734161 1847218176 450262 33554432000 134512640 135840783 4293437088 4293436224 11328253 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 450981 450262 347 325 0 449917 0
Current children cumulated CPU time (s) 1181.9
Current children cumulated vsize (KiB) 1803924

[startup+1242.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 14095
/proc/meminfo: memFree=24447076/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1879352 CPUtime=1241.88 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 469728 0 0 0 124057 131 0 0 20 0 1 0 342734161 1924456448 469112 33554432000 134512640 135840783 4293437088 4293436448 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 469838 469112 347 325 0 468774 0
Current children cumulated CPU time (s) 1241.88
Current children cumulated vsize (KiB) 1879352

[startup+1302.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 14095
/proc/meminfo: memFree=24289128/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=1960692 CPUtime=1301.85 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 490087 0 0 0 130048 137 0 0 20 0 1 0 342734161 2007748608 489441 33554432000 134512640 135840783 4293437088 4293436448 134550916 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 490173 489441 347 325 0 489109 0
Current children cumulated CPU time (s) 1301.85
Current children cumulated vsize (KiB) 1960692

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14098
/proc/meminfo: memFree=24177920/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2006220 CPUtime=1361.82 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 501496 0 0 0 136042 140 0 0 20 0 1 0 342734161 2054369280 500817 33554432000 134512640 135840783 4293437088 4293436448 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 501555 500817 347 325 0 500491 0
Current children cumulated CPU time (s) 1361.82
Current children cumulated vsize (KiB) 2006220

[startup+1422.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 14099
/proc/meminfo: memFree=24063876/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2061496 CPUtime=1421.81 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 515360 0 0 0 142036 145 0 0 20 0 1 0 342734161 2110971904 514644 33554432000 134512640 135840783 4293437088 4293436324 11325421 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 515374 514644 347 325 0 514310 0
Current children cumulated CPU time (s) 1421.81
Current children cumulated vsize (KiB) 2061496

[startup+1482.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 14099
/proc/meminfo: memFree=23956892/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2114452 CPUtime=1481.78 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 528632 0 0 0 148028 150 0 0 20 0 1 0 342734161 2165198848 527879 33554432000 134512640 135840783 4293437088 4293436448 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 528613 527879 347 325 0 527549 0
Current children cumulated CPU time (s) 1481.78
Current children cumulated vsize (KiB) 2114452

[startup+1542.31 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 14099
/proc/meminfo: memFree=23862680/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2159916 CPUtime=1541.75 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 540045 0 0 0 154022 153 0 0 20 0 1 0 342734161 2211753984 539254 33554432000 134512640 135840783 4293437088 4293436448 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 539979 539254 347 325 0 538915 0
Current children cumulated CPU time (s) 1541.75
Current children cumulated vsize (KiB) 2159916

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14099
/proc/meminfo: memFree=23776776/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2192592 CPUtime=1601.71 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 548250 0 0 0 160015 156 0 0 20 0 1 0 342734161 2245214208 547417 33554432000 134512640 135840783 4293437088 4293436448 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 548148 547417 347 325 0 547084 0
Current children cumulated CPU time (s) 1601.71
Current children cumulated vsize (KiB) 2192592

[startup+1662.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 14099
/proc/meminfo: memFree=23691120/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2227480 CPUtime=1661.68 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 556998 0 0 0 166008 160 0 0 20 0 1 0 342734161 2280939520 556133 33554432000 134512640 135840783 4293437088 4293436448 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 556870 556133 347 325 0 555806 0
Current children cumulated CPU time (s) 1661.68
Current children cumulated vsize (KiB) 2227480

[startup+1722.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 14100
/proc/meminfo: memFree=23602488/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2264176 CPUtime=1721.65 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 566217 0 0 0 172002 163 0 0 20 0 1 0 342734161 2318516224 565315 33554432000 134512640 135840783 4293437088 4293436448 134551071 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 566044 565315 347 325 0 564980 0
Current children cumulated CPU time (s) 1721.65
Current children cumulated vsize (KiB) 2264176

[startup+1782.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 14100
/proc/meminfo: memFree=23472564/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2326292 CPUtime=1781.63 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 581774 0 0 0 177996 167 0 0 20 0 1 0 342734161 2382123008 580839 33554432000 134512640 135840783 4293437088 4293436448 134550902 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 581573 580839 347 325 0 580509 0
Current children cumulated CPU time (s) 1781.63
Current children cumulated vsize (KiB) 2326292



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.7 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 14100
/proc/meminfo: memFree=23446120/32873844 swapFree=6608/6608
[pid=14045] ppid=14043 vsize=2338792 CPUtime=1800.03 cores=1,3,5,7
/proc/14045/stat : 14045 (bsolo3.0.17) R 14043 14045 12501 0 -1 4202496 584926 0 0 0 179835 168 0 0 20 0 1 0 342734161 2394923008 583981 33554432000 134512640 135840783 4293437088 4293436448 134551330 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/14045/statm: 584698 583981 347 325 0 583634 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 2338792

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.76
CPU time (s): 1800.08
CPU user time (s): 1798.35
CPU system time (s): 1.72874
CPU usage (%): 99.9625
Max. virtual memory (cumulated for all children) (KiB): 2338792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.35
system time used= 1.72874
maximum resident set size= 2335924
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 584929
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 711
involuntary context switches= 1829

runsolver used 3.61245 second user time and 10.1625 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-04 01:28:17
IDJOB=3741996
IDBENCH=90124
IDSOLVER=2318
FILE ID=node140/3741996-1338766097
RUNJOBID= node140-1338749243-12518
PBS_JOBID= 14636796
Free space on /tmp= 70608 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K106.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741996-1338766097/watcher-3741996-1338766097 -o /tmp/evaluation-result-3741996-1338766097/solver-3741996-1338766097 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741996-1338766097.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= afe4117ba13dcfbcd06fd88e1353402a
RANDOM SEED=909460229

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        25486388 kB
Buffers:          517916 kB
Cached:          4015004 kB
SwapCached:         1620 kB
Active:          3453092 kB
Inactive:        2999848 kB
Active(anon):    1912176 kB
Inactive(anon):     9476 kB
Active(file):    1540916 kB
Inactive(file):  2990372 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:              7000 kB
Writeback:             0 kB
AnonPages:       1926332 kB
Mapped:            11740 kB
Shmem:                 8 kB
Slab:             791488 kB
SReclaimable:     233596 kB
SUnreclaim:       557892 kB
KernelStack:        1464 kB
PageTables:         7884 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    2034848 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    612352 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70604 MiB
End job on node140 at 2012-06-04 01:58:20