Trace number 3741840

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.14 1801.04

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K102.opb
MD5SUM2946edf6ae8af40eb44098433ff3dcec
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark213.965
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6936
Total number of constraints7142
Number of constraints which are clauses7040
Number of constraints which are cardinality constraints (but not clauses)102
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint102
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 103
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741840-1338764294.opb
0.00/0.00	c File size is 444621 bytes.
0.03/0.04	c Highest Coefficient sum: 103
0.03/0.04	c Parsing was ok!!
0.03/0.04	c Total parsing time: 0.037 s
0.03/0.04	c Var: 6936 Constr: 7142 7040/102/0 Lit: 44545 Watch. Lit: 21014
0.03/0.04	c Obj. Vars: 0 (0 % of total variables)
1.18/1.29	c Pre-processing Time: 1.291 s
1.18/1.29	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.18/1.29	c        0   6184     6446    41443    6    19393  100351      0      0 1.29
1.18/1.29	c Switching off LPR mode.
1800.10/1801.00	c      100   6184     6546    47594    7    19593  110387    100     76 1.31
1800.10/1801.00	c      251   6184     6697    58964    8    19895  121426    251    186 1.35
1800.10/1801.00	c      477   6184     6923    76729   11    20347  133569    477    341 1.40
1800.10/1801.00	c      815   6184     7261   120803   16    21023  146926    815    545 1.49
1800.10/1801.00	c     1323   6184     7769   193248   24    22039  161619   1323    756 1.75
1800.10/1801.00	c     2087   6184     8533   330774   38    23567  177781   2087   1014 2.06
1800.10/1801.00	c     3233   6184     9679   469730   48    25859  195560   3233   1293 2.50
1800.10/1801.00	c     4956   6184    11402   770252   67    29305  215117   4956   1542 3.21
1800.10/1801.00	c     7540   6184    13986  1090690   77    34473  236629   7540   1688 4.47
1800.10/1801.00	c    11419   6184    17865  1541229   86    42231  260292  11419   1583 7.21
1800.10/1801.00	c    17242   6184    23688  2738213  115    53877  286322  17242   1402 12.29
1800.10/1801.00	c    25981   6184    32427  6463735  199    71355  314955  25981   1120 23.18
1800.10/1801.00	c    39091   6184    45537 16634451  365    97575  346451  39091    671 58.20
1800.10/1801.00	c    58762   6184    65208 42677451  654   136917  381097  58762    290 202.04
1800.10/1801.00	c    88272   6184    94718 64932489  685   195937  419207  88272    257 343.03
1800.10/1801.00	c   132543   6184   138989 106135859  763   284479  461128 132543    184 720.06
1800.10/1801.00	c   198953   6184   205399 192392385  936   417299  507241 198953    121 1638.97
1800.10/1801.00	c Caught signal: 15
1800.10/1801.00	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.10/1801.00	c   17   214199 111472  3203003   220645 199536545 214199    118 1800.11
1800.10/1801.00	s UNKNOWN
1800.10/1801.00	c Total time: 1800.11 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741840-1338764294/watcher-3741840-1338764294 -o /tmp/evaluation-result-3741840-1338764294/solver-3741840-1338764294 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741840-1338764294.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13928
/proc/meminfo: memFree=27123172/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2660 CPUtime=0 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4194304 96 0 0 0 0 0 0 0 20 0 1 0 342553820 2723840 48 33554432000 134512640 135840783 4287571712 4287569748 10818500 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 665 48 37 325 0 32 0

[startup+0.0438681 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13928
/proc/meminfo: memFree=27123172/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=6492 CPUtime=0.03 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 909 0 0 0 3 0 0 0 20 0 1 0 342553820 6647808 845 33554432000 134512640 135840783 4287571712 4287570704 134525286 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 1623 845 428 325 0 450 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 6492

[startup+0.100286 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13928
/proc/meminfo: memFree=27123172/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=7172 CPUtime=0.09 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 1202 0 0 0 9 0 0 0 20 0 1 0 342553820 7344128 1029 33554432000 134512640 135840783 4287571712 4287487596 5149744 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 1793 1029 342 325 0 729 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7172

[startup+0.300222 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13928
/proc/meminfo: memFree=27123172/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=7172 CPUtime=0.29 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 1203 0 0 0 29 0 0 0 20 0 1 0 342553820 7344128 1030 33554432000 134512640 135840783 4287571712 4287487596 5149744 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 1793 1030 342 325 0 729 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7172

[startup+0.700225 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13928
/proc/meminfo: memFree=27123172/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=7172 CPUtime=0.69 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 1203 0 0 0 69 0 0 0 20 0 1 0 342553820 7344128 1030 33554432000 134512640 135840783 4287571712 4287487596 5149744 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 1793 1030 342 325 0 729 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7172

[startup+1.50022 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=27118504/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=8108 CPUtime=1.48 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 1594 0 0 0 148 0 0 0 20 0 1 0 342553820 8302592 1301 33554432000 134512640 135840783 4287571712 4287565184 134586822 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 2027 1301 347 325 0 963 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 8108

[startup+3.10023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=27114016/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=15576 CPUtime=3.08 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 3458 0 0 0 308 0 0 0 20 0 1 0 342553820 15949824 3165 33554432000 134512640 135840783 4287571712 4287559088 134586540 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 3894 3165 347 325 0 2830 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 15576

[startup+6.30028 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=27101988/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=25268 CPUtime=6.29 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 5878 0 0 0 628 1 0 0 20 0 1 0 342553820 25874432 5585 33554432000 134512640 135840783 4287571712 4287569264 11330855 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 6317 5585 347 325 0 5253 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 25268

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=27082264/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=44036 CPUtime=12.69 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 10567 0 0 0 1267 2 0 0 20 0 1 0 342553820 45092864 10274 33554432000 134512640 135840783 4287571712 4287571024 134551071 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 11009 10274 347 325 0 9945 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 44036

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=27025472/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=101916 CPUtime=25.48 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 25028 0 0 0 2542 6 0 0 20 0 1 0 342553820 104361984 24735 33554432000 134512640 135840783 4287571712 4287570992 11333278 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 25479 24735 347 325 0 24415 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 101916

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=26929340/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=197008 CPUtime=51.07 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 48813 0 0 0 5096 11 0 0 20 0 1 0 342553820 201736192 48520 33554432000 134512640 135840783 4287571712 4287571072 134551071 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 49252 48520 347 325 0 48188 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 197008

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13929
/proc/meminfo: memFree=26769904/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=355372 CPUtime=102.23 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 88453 0 0 0 10199 24 0 0 20 0 1 0 342553820 363900928 88122 33554432000 134512640 135840783 4287571712 4287571072 134550913 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 88843 88122 347 325 0 87779 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 355372

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13932
/proc/meminfo: memFree=26641964/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=484980 CPUtime=162.16 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 120903 0 0 0 16182 34 0 0 20 0 1 0 342553820 496619520 120525 33554432000 134512640 135840783 4287571712 4287571072 134551093 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 121245 120525 347 325 0 120181 0
Current children cumulated CPU time (s) 162.16
Current children cumulated vsize (KiB) 484980

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 13956
/proc/meminfo: memFree=26523192/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=600472 CPUtime=222.12 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 149823 0 0 0 22168 44 0 0 20 0 1 0 342553820 614883328 149398 33554432000 134512640 135840783 4287571712 4287571072 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 150118 149398 347 325 0 149054 0
Current children cumulated CPU time (s) 222.12
Current children cumulated vsize (KiB) 600472

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13956
/proc/meminfo: memFree=26387076/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=738252 CPUtime=282.07 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 184299 0 0 0 28154 53 0 0 20 0 1 0 342553820 755970048 183834 33554432000 134512640 135840783 4287571712 4287571072 134550820 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 184563 183834 347 325 0 183499 0
Current children cumulated CPU time (s) 282.07
Current children cumulated vsize (KiB) 738252

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13956
/proc/meminfo: memFree=26283936/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=839936 CPUtime=342.02 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 209779 0 0 0 34141 61 0 0 20 0 1 0 342553820 860094464 209267 33554432000 134512640 135840783 4287571712 4287571072 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 209984 209267 347 325 0 208920 0
Current children cumulated CPU time (s) 342.02
Current children cumulated vsize (KiB) 839936

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13956
/proc/meminfo: memFree=26200156/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=924016 CPUtime=401.97 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 230837 0 0 0 40129 68 0 0 20 0 1 0 342553820 946192384 230289 33554432000 134512640 135840783 4287571712 4287549088 134547589 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 231004 230289 347 325 0 229940 0
Current children cumulated CPU time (s) 401.97
Current children cumulated vsize (KiB) 924016

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13956
/proc/meminfo: memFree=26099108/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1024408 CPUtime=461.93 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 255953 0 0 0 46117 76 0 0 20 0 1 0 342553820 1048993792 255365 33554432000 134512640 135840783 4287571712 4287571072 134551330 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 256102 255365 347 325 0 255038 0
Current children cumulated CPU time (s) 461.93
Current children cumulated vsize (KiB) 1024408

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13957
/proc/meminfo: memFree=26021900/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1103896 CPUtime=521.9 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 275870 0 0 0 52108 82 0 0 20 0 1 0 342553820 1130389504 275241 33554432000 134512640 135840783 4287571712 4287571072 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 275974 275241 347 325 0 274910 0
Current children cumulated CPU time (s) 521.9
Current children cumulated vsize (KiB) 1103896

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 13957
/proc/meminfo: memFree=25923092/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1200896 CPUtime=581.85 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 300184 0 0 0 58097 88 0 0 20 0 1 0 342553820 1229717504 299509 33554432000 134512640 135840783 4287571712 4287571072 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 300224 299509 347 325 0 299160 0
Current children cumulated CPU time (s) 581.85
Current children cumulated vsize (KiB) 1200896

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14001
/proc/meminfo: memFree=25650344/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1442600 CPUtime=821.7 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 360756 0 0 0 82059 111 0 0 20 0 1 0 342553820 1477222400 359915 33554432000 134512640 135840783 4287571712 4287571072 134551058 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 360650 359915 347 325 0 359586 0
Current children cumulated CPU time (s) 821.7
Current children cumulated vsize (KiB) 1442600

[startup+882.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14001
/proc/meminfo: memFree=25416244/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1502316 CPUtime=881.67 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 375739 0 0 0 88050 117 0 0 20 0 1 0 342553820 1538371584 374855 33554432000 134512640 135840783 4287571712 4287571072 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 375579 374855 347 325 0 374515 0
Current children cumulated CPU time (s) 881.67
Current children cumulated vsize (KiB) 1502316

[startup+942.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14001
/proc/meminfo: memFree=25190608/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1586908 CPUtime=941.63 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 396933 0 0 0 94040 123 0 0 20 0 1 0 342553820 1624993792 396006 33554432000 134512640 135840783 4287571712 4287571072 134550902 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 396727 396006 347 325 0 395663 0
Current children cumulated CPU time (s) 941.63
Current children cumulated vsize (KiB) 1586908

[startup+1002.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14001
/proc/meminfo: memFree=24945224/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1679136 CPUtime=1001.6 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 420034 0 0 0 100031 129 0 0 20 0 1 0 342553820 1719435264 419069 33554432000 134512640 135840783 4287571712 4287571072 134551093 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 419784 419069 347 325 0 418720 0
Current children cumulated CPU time (s) 1001.6
Current children cumulated vsize (KiB) 1679136

[startup+1062.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14001
/proc/meminfo: memFree=24742032/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1766720 CPUtime=1061.58 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 441975 0 0 0 106023 135 0 0 20 0 1 0 342553820 1809121280 440971 33554432000 134512640 135840783 4287571712 4287571072 134551330 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 441680 440971 347 325 0 440616 0
Current children cumulated CPU time (s) 1061.58
Current children cumulated vsize (KiB) 1766720

[startup+1122.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 14002
/proc/meminfo: memFree=24543288/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1854656 CPUtime=1121.56 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 463977 0 0 0 112015 141 0 0 20 0 1 0 342553820 1899167744 462932 33554432000 134512640 135840783 4287571712 4287571072 134550863 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 463664 462932 347 325 0 462600 0
Current children cumulated CPU time (s) 1121.56
Current children cumulated vsize (KiB) 1854656

[startup+1182.3 s]
/proc/loadavg: 2.10 2.02 2.00 3/177 14002
/proc/meminfo: memFree=24381248/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=1934952 CPUtime=1181.54 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 484104 0 0 0 118009 145 0 0 20 0 1 0 342553820 1981390848 483018 33554432000 134512640 135840783 4287571712 4287571072 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 483738 483018 347 325 0 482674 0
Current children cumulated CPU time (s) 1181.54
Current children cumulated vsize (KiB) 1934952

[startup+1242.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 14002
/proc/meminfo: memFree=24236444/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2020028 CPUtime=1241.52 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 505421 0 0 0 124001 151 0 0 20 0 1 0 342553820 2068508672 504296 33554432000 134512640 135840783 4287571712 4287569056 134574713 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 505007 504296 347 325 0 503943 0
Current children cumulated CPU time (s) 1241.52
Current children cumulated vsize (KiB) 2020028

[startup+1302.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 14002
/proc/meminfo: memFree=24042024/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2095732 CPUtime=1301.51 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 524364 0 0 0 129993 158 0 0 20 0 1 0 342553820 2146029568 523211 33554432000 134512640 135840783 4287571712 4287570848 11328414 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 523933 523211 347 325 0 522869 0
Current children cumulated CPU time (s) 1301.51
Current children cumulated vsize (KiB) 2095732

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14005
/proc/meminfo: memFree=23860524/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2187400 CPUtime=1361.48 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 547317 0 0 0 135983 165 0 0 20 0 1 0 342553820 2239897600 546129 33554432000 134512640 135840783 4287571712 4287571028 11325380 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 546850 546129 347 325 0 545786 0
Current children cumulated CPU time (s) 1361.48
Current children cumulated vsize (KiB) 2187400

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14006
/proc/meminfo: memFree=23686268/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2263828 CPUtime=1421.46 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 566444 0 0 0 141976 170 0 0 20 0 1 0 342553820 2318159872 565225 33554432000 134512640 135840783 4287571712 4287571072 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 565957 565225 347 325 0 564893 0
Current children cumulated CPU time (s) 1421.46
Current children cumulated vsize (KiB) 2263828

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14006
/proc/meminfo: memFree=23544280/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2338844 CPUtime=1481.44 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 585217 0 0 0 147969 175 0 0 20 0 1 0 342553820 2394976256 583998 33554432000 134512640 135840783 4287571712 4287571072 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 584711 583998 347 325 0 583647 0
Current children cumulated CPU time (s) 1481.44
Current children cumulated vsize (KiB) 2338844

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14006
/proc/meminfo: memFree=23404188/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2395952 CPUtime=1541.44 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 599476 0 0 0 153964 180 0 0 20 0 1 0 342553820 2453454848 598257 33554432000 134512640 135840783 4287571712 4287571064 4229328 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 598988 598257 347 325 0 597924 0
Current children cumulated CPU time (s) 1541.44
Current children cumulated vsize (KiB) 2395952

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14006
/proc/meminfo: memFree=23264096/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2454544 CPUtime=1601.43 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 614120 0 0 0 159957 186 0 0 20 0 1 0 342553820 2513453056 612901 33554432000 134512640 135840783 4287571712 4287571072 134551104 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 613636 612901 347 325 0 612572 0
Current children cumulated CPU time (s) 1601.43
Current children cumulated vsize (KiB) 2454544

[startup+1662.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 14006
/proc/meminfo: memFree=23168644/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2480896 CPUtime=1661.41 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 620714 0 0 0 165952 189 0 0 20 0 1 0 342553820 2540437504 619495 33554432000 134512640 135840783 4287571712 4287571024 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 620224 619495 347 325 0 619160 0
Current children cumulated CPU time (s) 1661.41
Current children cumulated vsize (KiB) 2480896

[startup+1722.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 14007
/proc/meminfo: memFree=23076788/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2511084 CPUtime=1721.41 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 628278 0 0 0 171950 191 0 0 20 0 1 0 342553820 2571350016 627059 33554432000 134512640 135840783 4287571712 4287571072 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 627771 627059 347 325 0 626707 0
Current children cumulated CPU time (s) 1721.41
Current children cumulated vsize (KiB) 2511084

[startup+1782.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 14007
/proc/meminfo: memFree=22953188/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2558332 CPUtime=1781.4 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 640078 0 0 0 177945 195 0 0 20 0 1 0 342553820 2619731968 638859 33554432000 134512640 135840783 4287571712 4287571024 134551532 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 639583 638859 347 325 0 638519 0
Current children cumulated CPU time (s) 1781.4
Current children cumulated vsize (KiB) 2558332



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 14007
/proc/meminfo: memFree=22921784/32873844 swapFree=6608/6608
[pid=13928] ppid=13926 vsize=2564556 CPUtime=1800.1 cores=1,3,5,7
/proc/13928/stat : 13928 (bsolo3.0.17) R 13926 13928 12501 0 -1 4202496 641619 0 0 0 179815 195 0 0 20 0 1 0 342553820 2626105344 640400 33554432000 134512640 135840783 4287571712 4287571072 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/13928/statm: 641139 640400 347 325 0 640075 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2564556

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1801.04
CPU time (s): 1800.14
CPU user time (s): 1798.15
CPU system time (s): 1.9867
CPU usage (%): 99.9502
Max. virtual memory (cumulated for all children) (KiB): 2564556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.15
system time used= 1.9867
maximum resident set size= 2561600
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 641622
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 970
involuntary context switches= 1833

runsolver used 3.15252 second user time and 9.93149 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-04 00:58:14
IDJOB=3741840
IDBENCH=90112
IDSOLVER=2318
FILE ID=node140/3741840-1338764294
RUNJOBID= node140-1338749243-12518
PBS_JOBID= 14636796
Free space on /tmp= 70588 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K102.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741840-1338764294/watcher-3741840-1338764294 -o /tmp/evaluation-result-3741840-1338764294/solver-3741840-1338764294 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741840-1338764294.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2946edf6ae8af40eb44098433ff3dcec
RANDOM SEED=425747112

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27123560 kB
Buffers:          517276 kB
Cached:          4035048 kB
SwapCached:         1620 kB
Active:          1818944 kB
Inactive:        2999056 kB
Active(anon):     258056 kB
Inactive(anon):     9476 kB
Active(file):    1560888 kB
Inactive(file):  2989580 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:              7000 kB
Writeback:             4 kB
AnonPages:        269928 kB
Mapped:            11836 kB
Shmem:                 8 kB
Slab:             791712 kB
SReclaimable:     233644 kB
SUnreclaim:       558068 kB
KernelStack:        1448 kB
PageTables:         4144 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     380276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    165888 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70604 MiB
End job on node140 at 2012-06-04 01:28:17