Trace number 3741853

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.08 1801.02

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K87.opb
MD5SUM800363f05bcd3a7fdae42567bbf8c0cf
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables5916
Total number of constraints6092
Number of constraints which are clauses6005
Number of constraints which are cardinality constraints (but not clauses)87
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint87
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 88
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741853-1338764356.opb
0.00/0.00	c File size is 378082 bytes.
0.00/0.03	c Highest Coefficient sum: 88
0.00/0.03	c Parsing was ok!!
0.00/0.03	c Total parsing time: 0.031 s
0.00/0.04	c Var: 5916 Constr: 6092 6005/87/0 Lit: 37960 Watch. Lit: 17924
0.00/0.04	c Obj. Vars: 0 (0 % of total variables)
0.99/1.06	c Pre-processing Time: 1.053 s
0.99/1.06	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.99/1.06	c        0   5179     5411    34948    6    16333   85011      0      0 1.05
0.99/1.06	c Switching off LPR mode.
1800.07/1801.00	c      100   5179     5511    42709    7    16533   93513    100     93 1.07
1800.07/1801.00	c      250   5179     5661    56666   10    16833  102865    250    222 1.13
1800.07/1801.00	c      475   5179     5886    78472   13    17283  113152    475    396 1.20
1800.07/1801.00	c      814   5179     6225   122573   19    17961  124468    814    625 1.30
1800.07/1801.00	c     1322   5179     6733   204356   30    18977  136915   1322    914 1.45
1800.07/1801.00	c     2085   5179     7496   335843   44    20503  150607   2085   1211 1.72
1800.07/1801.00	c     3232   5179     8643   634827   73    22797  165668   3232   1427 2.26
1800.07/1801.00	c     4954   5179    10365  1446708  139    26241  182235   4954   1382 3.58
1800.07/1801.00	c     7539   5179    12950  2083615  160    31411  200459   7539   1359 5.54
1800.07/1801.00	c    11418   5179    16829  3017269  179    39169  220505  11418   1406 8.12
1800.07/1801.00	c    17240   5179    22651  3900787  172    50813  242556  17240   1344 12.82
1800.07/1801.00	c    25977   5179    31388  8328482  265    68287  266812  25977   1000 25.95
1800.07/1801.00	c    39088   5179    44499 17274509  388    94509  293494  39088    634 61.60
1800.07/1801.00	c    58759   5179    64170 40005891  623   133851  322844  58759    293 199.94
1800.07/1801.00	c    88269   5179    93680 73789240  787   192871  355129  88269    170 518.15
1800.07/1801.00	c   132540   5179   137951 124104855  899   281413  390642 132540    112 1182.49
1800.07/1801.00	c Caught signal: 15
1800.07/1801.00	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.07/1801.00	c   16   171184  84624  1942666   176595 157900078 171184     95 1800.07
1800.07/1801.00	s UNKNOWN
1800.07/1801.00	c Total time: 1800.07 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741853-1338764356/watcher-3741853-1338764356 -o /tmp/evaluation-result-3741853-1338764356/solver-3741853-1338764356 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741853-1338764356.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.03 2.05 2.20 3/176 7576
/proc/meminfo: memFree=27681712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=2660 CPUtime=0 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) D 7574 7576 5948 0 -1 4194304 95 0 0 0 0 0 0 0 20 0 1 0 342561262 2723840 48 33554432000 134512640 135840783 4290430976 4290429012 5489604 0 0 4096 0 18446744072100609316 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 665 48 37 325 0 32 0

[startup+0.097762 s]
/proc/loadavg: 2.03 2.05 2.20 3/176 7576
/proc/meminfo: memFree=27681712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=6776 CPUtime=0.08 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 1089 0 0 0 8 0 0 0 20 0 1 0 342561262 6938624 933 33554432000 134512640 135840783 4290430976 4290359100 10028080 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 1694 933 342 325 0 630 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 6776

[startup+0.100272 s]
/proc/loadavg: 2.03 2.05 2.20 3/176 7576
/proc/meminfo: memFree=27681712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=6776 CPUtime=0.08 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 1089 0 0 0 8 0 0 0 20 0 1 0 342561262 6938624 933 33554432000 134512640 135840783 4290430976 4290359100 10028080 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 1694 933 342 325 0 630 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 6776

[startup+0.300221 s]
/proc/loadavg: 2.03 2.05 2.20 3/176 7576
/proc/meminfo: memFree=27681712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=6776 CPUtime=0.28 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 1090 0 0 0 28 0 0 0 20 0 1 0 342561262 6938624 934 33554432000 134512640 135840783 4290430976 4290359100 10028080 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 1694 934 342 325 0 630 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 6776

[startup+0.700223 s]
/proc/loadavg: 2.03 2.05 2.20 3/176 7576
/proc/meminfo: memFree=27681712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=6776 CPUtime=0.68 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 1090 0 0 0 68 0 0 0 20 0 1 0 342561262 6938624 934 33554432000 134512640 135840783 4290430976 4290359100 10028080 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 1694 934 342 325 0 630 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 6776

[startup+1.50022 s]
/proc/loadavg: 2.03 2.05 2.20 3/177 7577
/proc/meminfo: memFree=27679580/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=9016 CPUtime=1.49 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 1777 0 0 0 148 1 0 0 20 0 1 0 342561262 9232384 1530 33554432000 134512640 135840783 4290430976 4290427088 6001959 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 2254 1530 347 325 0 1190 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 9016

[startup+3.10025 s]
/proc/loadavg: 2.03 2.05 2.20 3/177 7577
/proc/meminfo: memFree=27672760/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=21244 CPUtime=3.09 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 4826 0 0 0 307 2 0 0 20 0 1 0 342561262 21753856 4579 33554432000 134512640 135840783 4290430976 4290430336 134550902 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 5311 4579 347 325 0 4247 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 21244

[startup+6.30027 s]
/proc/loadavg: 2.03 2.05 2.20 3/177 7577
/proc/meminfo: memFree=27652424/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=36196 CPUtime=6.29 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 8553 0 0 0 626 3 0 0 20 0 1 0 342561262 37064704 8306 33554432000 134512640 135840783 4290430976 4290430268 134519592 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 9049 8306 347 325 0 7985 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 36196

[startup+12.7003 s]
/proc/loadavg: 2.02 2.05 2.19 3/177 7577
/proc/meminfo: memFree=27628872/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=57500 CPUtime=12.68 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 13897 0 0 0 1264 4 0 0 20 0 1 0 342561262 58880000 13650 33554432000 134512640 135840783 4290430976 4290430336 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 14375 13650 347 325 0 13311 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 57500

[startup+25.5003 s]
/proc/loadavg: 2.02 2.04 2.19 3/177 7577
/proc/meminfo: memFree=27573924/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=113280 CPUtime=25.48 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 27831 0 0 0 2541 7 0 0 20 0 1 0 342561262 115998720 27584 33554432000 134512640 135840783 4290430976 4290430336 134550878 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 28320 27584 347 325 0 27256 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 113280

[startup+51.1003 s]
/proc/loadavg: 2.01 2.04 2.18 3/178 7580
/proc/meminfo: memFree=27495592/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=191036 CPUtime=51.08 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 47279 0 0 0 5095 13 0 0 20 0 1 0 342561262 195620864 47032 33554432000 134512640 135840783 4290430976 4290430336 134550916 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 47759 47032 347 325 0 46695 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 191036

[startup+102.307 s]
/proc/loadavg: 2.04 2.04 2.18 3/178 7580
/proc/meminfo: memFree=27351332/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=333592 CPUtime=102.28 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 82903 0 0 0 10205 23 0 0 20 0 1 0 342561262 341598208 82656 33554432000 134512640 135840783 4290430976 4290430336 134551071 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 83398 82656 347 325 0 82334 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 333592

[startup+162.3 s]
/proc/loadavg: 2.01 2.03 2.16 3/178 7603
/proc/meminfo: memFree=27227608/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=457800 CPUtime=162.26 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 113962 0 0 0 16195 31 0 0 20 0 1 0 342561262 468787200 113715 33554432000 134512640 135840783 4290430976 4290430336 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 114450 113715 347 325 0 113386 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 457800

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.15 3/177 7603
/proc/meminfo: memFree=27030484/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=559136 CPUtime=222.25 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 139288 0 0 0 22187 38 0 0 20 0 1 0 342561262 572555264 139041 33554432000 134512640 135840783 4290430976 4290430336 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 139784 139041 347 325 0 138720 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 559136

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.14 3/177 7604
/proc/meminfo: memFree=26943712/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=646584 CPUtime=282.25 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 161165 0 0 0 28181 44 0 0 20 0 1 0 342561262 662102016 160918 33554432000 134512640 135840783 4290430976 4290430336 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 161646 160918 347 325 0 160582 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 646584

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.13 3/177 7604
/proc/meminfo: memFree=26855700/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=733564 CPUtime=342.23 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 182893 0 0 0 34172 51 0 0 20 0 1 0 342561262 751169536 182646 33554432000 134512640 135840783 4290430976 4290430336 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 183391 182646 347 325 0 182327 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 733564

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.12 3/177 7604
/proc/meminfo: memFree=26786040/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=803268 CPUtime=402.22 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 200334 0 0 0 40164 58 0 0 20 0 1 0 342561262 822546432 200087 33554432000 134512640 135840783 4290430976 4290430336 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 200817 200087 347 325 0 199753 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 803268

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.11 3/177 7604
/proc/meminfo: memFree=26694060/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=875924 CPUtime=462.22 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 218500 0 0 0 46158 64 0 0 20 0 1 0 342561262 896946176 218253 33554432000 134512640 135840783 4290430976 4290430288 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 218981 218253 347 325 0 217917 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 875924

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.09 3/177 7604
/proc/meminfo: memFree=26505484/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=957236 CPUtime=522.2 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 238835 0 0 0 52151 69 0 0 20 0 1 0 342561262 980209664 238588 33554432000 134512640 135840783 4290430976 4290430336 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 239309 238588 347 325 0 238245 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 957236

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.09 3/177 7605
/proc/meminfo: memFree=26457596/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1000780 CPUtime=582.2 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 249712 0 0 0 58147 73 0 0 20 0 1 0 342561262 1024798720 249465 33554432000 134512640 135840783 4290430976 4290430336 134550782 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 250195 249465 347 325 0 249131 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 1000780

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 1.98 1.99 2.06 3/177 7647
/proc/meminfo: memFree=26923136/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1253032 CPUtime=822.03 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 312922 0 0 0 82108 95 0 0 20 0 1 0 342561262 1283104768 312534 33554432000 134512640 135840783 4290430976 4290430288 5996485 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 313258 312534 347 325 0 312194 0
Current children cumulated CPU time (s) 822.03
Current children cumulated vsize (KiB) 1253032

[startup+882.3 s]
/proc/loadavg: 1.99 1.99 2.06 3/177 7648
/proc/meminfo: memFree=26706784/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1306296 CPUtime=882 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 326278 0 0 0 88102 98 0 0 20 0 1 0 342561262 1337647104 325851 33554432000 134512640 135840783 4290430976 4290430288 5996485 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 326574 325851 347 325 0 325510 0
Current children cumulated CPU time (s) 882
Current children cumulated vsize (KiB) 1306296

[startup+942.3 s]
/proc/loadavg: 1.99 1.99 2.05 3/177 7648
/proc/meminfo: memFree=26568304/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1349012 CPUtime=941.98 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 336994 0 0 0 94096 102 0 0 20 0 1 0 342561262 1381388288 336532 33554432000 134512640 135840783 4290430976 4290430336 134551455 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 337253 336532 347 325 0 336189 0
Current children cumulated CPU time (s) 941.98
Current children cumulated vsize (KiB) 1349012

[startup+1002.3 s]
/proc/loadavg: 1.99 1.99 2.05 3/177 7648
/proc/meminfo: memFree=26337568/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1399676 CPUtime=1001.93 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 349697 0 0 0 100087 106 0 0 20 0 1 0 342561262 1433268224 349202 33554432000 134512640 135840783 4290430976 4290430336 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 349919 349202 347 325 0 348855 0
Current children cumulated CPU time (s) 1001.93
Current children cumulated vsize (KiB) 1399676

[startup+1062.3 s]
/proc/loadavg: 1.99 1.99 2.04 3/177 7648
/proc/meminfo: memFree=26191276/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1466048 CPUtime=1061.89 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 366329 0 0 0 106080 109 0 0 20 0 1 0 342561262 1501233152 365801 33554432000 134512640 135840783 4290430976 4290430336 134551175 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 366512 365801 347 325 0 365448 0
Current children cumulated CPU time (s) 1061.89
Current children cumulated vsize (KiB) 1466048

[startup+1122.3 s]
/proc/loadavg: 2.05 2.01 2.04 3/177 7648
/proc/meminfo: memFree=26048828/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1546336 CPUtime=1121.85 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 386429 0 0 0 112070 115 0 0 20 0 1 0 342561262 1583448064 385862 33554432000 134512640 135840783 4290430976 4290430336 134551175 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 386584 385862 347 325 0 385520 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 1546336

[startup+1182.3 s]
/proc/loadavg: 2.02 2.00 2.03 3/177 7649
/proc/meminfo: memFree=25946308/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1596672 CPUtime=1181.82 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 399046 0 0 0 118063 119 0 0 20 0 1 0 342561262 1634992128 398443 33554432000 134512640 135840783 4290430976 4290430336 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 399168 398443 347 325 0 398104 0
Current children cumulated CPU time (s) 1181.82
Current children cumulated vsize (KiB) 1596672

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/177 7649
/proc/meminfo: memFree=25815020/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1630380 CPUtime=1241.77 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 407530 0 0 0 124055 122 0 0 20 0 1 0 342561262 1669509120 406884 33554432000 134512640 135840783 4290430976 4290430288 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 407595 406884 347 325 0 406531 0
Current children cumulated CPU time (s) 1241.77
Current children cumulated vsize (KiB) 1630380

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/178 7652
/proc/meminfo: memFree=25668224/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1672308 CPUtime=1301.73 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 418044 0 0 0 130048 125 0 0 20 0 1 0 342561262 1712443392 417356 33554432000 134512640 135840783 4290430976 4290430336 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 418077 417356 347 325 0 417013 0
Current children cumulated CPU time (s) 1301.73
Current children cumulated vsize (KiB) 1672308

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/177 7652
/proc/meminfo: memFree=25529256/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1711356 CPUtime=1361.68 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 427863 0 0 0 136040 128 0 0 20 0 1 0 342561262 1752428544 427129 33554432000 134512640 135840783 4290430976 4290430336 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 427839 427129 347 325 0 426775 0
Current children cumulated CPU time (s) 1361.68
Current children cumulated vsize (KiB) 1711356

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.01 3/177 7652
/proc/meminfo: memFree=25401936/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1767000 CPUtime=1421.64 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 441786 0 0 0 142032 132 0 0 20 0 1 0 342561262 1809408000 441016 33554432000 134512640 135840783 4290430976 4290430336 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 441750 441016 347 325 0 440686 0
Current children cumulated CPU time (s) 1421.64
Current children cumulated vsize (KiB) 1767000

[startup+1482.3 s]
/proc/loadavg: 2.06 2.02 2.01 3/177 7653
/proc/meminfo: memFree=25256512/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1837904 CPUtime=1481.59 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 459554 0 0 0 148022 137 0 0 20 0 1 0 342561262 1882013696 458749 33554432000 134512640 135840783 4290430976 4290430336 134550939 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 459476 458749 347 325 0 458412 0
Current children cumulated CPU time (s) 1481.59
Current children cumulated vsize (KiB) 1837904

[startup+1542.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 7653
/proc/meminfo: memFree=25151388/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1883460 CPUtime=1541.55 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 470982 0 0 0 154015 140 0 0 20 0 1 0 342561262 1928663040 470137 33554432000 134512640 135840783 4290430976 4290430336 134550921 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 470865 470137 347 325 0 469801 0
Current children cumulated CPU time (s) 1541.55
Current children cumulated vsize (KiB) 1883460

[startup+1602.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 7653
/proc/meminfo: memFree=25015512/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1919528 CPUtime=1601.51 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 480039 0 0 0 160008 143 0 0 20 0 1 0 342561262 1965596672 479151 33554432000 134512640 135840783 4290430976 4290430336 134550878 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 479882 479151 347 325 0 478818 0
Current children cumulated CPU time (s) 1601.51
Current children cumulated vsize (KiB) 1919528

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7654
/proc/meminfo: memFree=24890044/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1955148 CPUtime=1661.46 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 488984 0 0 0 166001 145 0 0 20 0 1 0 342561262 2002071552 488052 33554432000 134512640 135840783 4290430976 4290430336 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 488787 488052 347 325 0 487723 0
Current children cumulated CPU time (s) 1661.46
Current children cumulated vsize (KiB) 1955148

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7654
/proc/meminfo: memFree=24778480/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=1991116 CPUtime=1721.42 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 498032 0 0 0 171994 148 0 0 20 0 1 0 342561262 2038902784 497063 33554432000 134512640 135840783 4290430976 4290430336 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 497779 497063 347 325 0 496715 0
Current children cumulated CPU time (s) 1721.42
Current children cumulated vsize (KiB) 1991116

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 7654
/proc/meminfo: memFree=24664560/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=2021000 CPUtime=1781.38 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 505546 0 0 0 177987 151 0 0 20 0 1 0 342561262 2069504000 504536 33554432000 134512640 135840783 4290430976 4290430336 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 505250 504536 347 325 0 504186 0
Current children cumulated CPU time (s) 1781.38
Current children cumulated vsize (KiB) 2021000



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7655
/proc/meminfo: memFree=24628312/32873844 swapFree=7112/7112
[pid=7576] ppid=7574 vsize=2030588 CPUtime=1800.07 cores=1,3,5,7
/proc/7576/stat : 7576 (bsolo3.0.17) R 7574 7576 5948 0 -1 4202496 507955 0 0 0 179855 152 0 0 20 0 1 0 342561262 2079322112 506931 33554432000 134512640 135840783 4290430976 4290408336 134586540 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7576/statm: 507647 506931 347 325 0 506583 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 2030588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1801.02
CPU time (s): 1800.08
CPU user time (s): 1798.55
CPU system time (s): 1.53077
CPU usage (%): 99.9482
Max. virtual memory (cumulated for all children) (KiB): 2030588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.55
system time used= 1.53077
maximum resident set size= 2027724
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 507958
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 816
involuntary context switches= 1844

runsolver used 3.80142 second user time and 9.62354 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-04 00:59:16
IDJOB=3741853
IDBENCH=90113
IDSOLVER=2318
FILE ID=node119/3741853-1338764356
RUNJOBID= node119-1338748763-5965
PBS_JOBID= 14636790
Free space on /tmp= 70844 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K87.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741853-1338764356/watcher-3741853-1338764356 -o /tmp/evaluation-result-3741853-1338764356/solver-3741853-1338764356 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741853-1338764356.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 800363f05bcd3a7fdae42567bbf8c0cf
RANDOM SEED=541286858

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27682728 kB
Buffers:          429244 kB
Cached:          3187016 kB
SwapCached:         1936 kB
Active:          2286440 kB
Inactive:        2056708 kB
Active(anon):     722436 kB
Inactive(anon):     6616 kB
Active(file):    1564004 kB
Inactive(file):  2050092 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:              7040 kB
Writeback:             0 kB
AnonPages:        732204 kB
Mapped:            13120 kB
Shmem:                 0 kB
Slab:             706068 kB
SReclaimable:     148208 kB
SUnreclaim:       557860 kB
KernelStack:        1456 kB
PageTables:         5408 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     845300 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70888 MiB
End job on node119 at 2012-06-04 01:29:19