Trace number 3740946

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.02 1800.41

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-91.opb
MD5SUM0d52a3bd95f65144c5f8bf26bef42f13
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables10086
Total number of constraints226240
Number of constraints which are clauses203302
Number of constraints which are cardinality constraints (but not clauses)720
Number of constraints which are nor clauses,nor cardinality constraints22218
Minimum length of a constraint2
Maximum length of a constraint231
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 232
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3740946-1338754315.opb
0.00/0.00	c File size is 9526531 bytes.
0.68/0.71	c Highest Coefficient sum: 232
0.68/0.71	c Parsing was ok!!
0.68/0.71	c Total parsing time: 0.711 s
0.68/0.75	c Var: 10086 Constr: 226608 203668/722/22218 Lit: 874972 Watch. Lit: 457248
0.68/0.75	c Obj. Vars: 0 (0 % of total variables)
9.68/9.79	c Pre-processing Time: 9.787 s
9.68/9.79	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
9.68/9.79	c        0  10086   223388   858874    3   473026  304018      0      0 9.79
9.68/9.79	c Switching off LPR mode.
1800.01/1800.40	c      102  10086   223490   861448    3   469705  334420    102     10 9.85
1800.01/1800.40	c      252  10086   223640   864595    3   469692  367863    252     25 9.93
1800.01/1800.40	c      477  10086   223865   868245    3   468889  404650    477     47 10.14
1800.01/1800.40	c      816  10086   224204   877474    3   469907  445116    816     78 10.37
1800.01/1800.40	c     1324  10086   224712   889024    3   470848  489628   1324    124 10.60
1800.01/1800.40	c     2088  10086   225476   959214    4   471445  538591   2088    191 10.92
1800.01/1800.40	c     3234  10086   226622  1029334    4   473897  592451   3234    283 11.40
1800.01/1800.40	c     4955  10086   228343  1148138    5   477302  651697   4955    401 12.34
1800.01/1800.40	c     7541  10086   230929  1446515    6   482490  716867   7541    518 14.55
1800.01/1800.40	c    11421  10086   234809  1690610    7   489119  788554  11421    618 18.47
1800.01/1800.40	c    17245  10086   240633  2055905    8   501272  867410  17245    623 27.64
1800.01/1800.40	c    25986  10086   249374  2569077   10   518958  954152  25986    545 47.65
1800.01/1800.40	c    39097  10086   262485  3377050   12   544780  500000  39097    429 91.02
1800.01/1800.40	c    58768  10086   282156  4631572   16   583592  550001  58768    273 214.98
1800.01/1800.40	c    88278  10086   311666  6490352   20   641890  605002  88278    200 439.72
1800.01/1800.40	c   132548  10086   355936 11337311   31   732002  665503 132548    261 506.99
1800.01/1800.40	c   198959  10086   422347 15132368   35   864651  732054 198959    160 1236.78
1800.01/1800.40	c Caught signal: 15
1800.01/1800.40	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.01/1800.40	c   17   237806  67206  2676029   461194 17444803 237806    132 1800.02
1800.01/1800.40	s UNKNOWN
1800.01/1800.40	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3740946-1338754315/watcher-3740946-1338754315 -o /tmp/evaluation-result-3740946-1338754315/solver-3740946-1338754315 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3740946-1338754315.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.03 1.97 3/176 22071
/proc/meminfo: memFree=27802536/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4194304 190 0 0 0 0 0 0 0 20 0 1 0 341558398 4583424 140 33554432000 134512640 135840783 4287711648 4287710564 11205176 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 1119 146 128 325 0 39 0

[startup+0.087503 s]
/proc/loadavg: 2.08 2.03 1.97 3/176 22071
/proc/meminfo: memFree=27802536/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=17404 CPUtime=0.07 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 1584 0 0 0 7 0 0 0 20 0 1 0 341558398 17821696 1520 33554432000 134512640 135840783 4287711648 4287710464 11715879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 4351 1520 592 325 0 961 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 17404

[startup+0.100336 s]
/proc/loadavg: 2.08 2.03 1.97 3/176 22071
/proc/meminfo: memFree=27802536/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=17948 CPUtime=0.09 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 1768 0 0 0 9 0 0 0 20 0 1 0 341558398 18378752 1704 33554432000 134512640 135840783 4287711648 4287710336 11715879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 4487 1705 638 325 0 1097 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17948

[startup+0.300285 s]
/proc/loadavg: 2.08 2.03 1.97 3/176 22071
/proc/meminfo: memFree=27802536/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=25864 CPUtime=0.29 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 4418 0 0 0 28 1 0 0 20 0 1 0 341558398 26484736 4354 33554432000 134512640 135840783 4287711648 4287710640 134525046 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 6466 4354 1297 325 0 3076 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25864

[startup+0.700196 s]
/proc/loadavg: 2.08 2.03 1.97 3/176 22071
/proc/meminfo: memFree=27802536/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=41420 CPUtime=0.68 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 9594 0 0 0 67 1 0 0 20 0 1 0 341558398 42414080 9530 33554432000 134512640 135840783 4287711648 4287710480 11715879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 10355 9530 2587 325 0 6965 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 41420

[startup+1.50031 s]
/proc/loadavg: 2.08 2.03 1.97 4/177 22072
/proc/meminfo: memFree=27745756/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=59132 CPUtime=1.49 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 16407 0 0 0 146 3 0 0 20 0 1 0 341558398 60551168 14017 33554432000 134512640 135840783 4287711648 4287589532 12870704 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 14783 14017 344 325 0 13719 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 59132

[startup+3.10028 s]
/proc/loadavg: 2.08 2.03 1.97 4/177 22072
/proc/meminfo: memFree=27744888/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=59132 CPUtime=3.08 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 16410 0 0 0 304 4 0 0 20 0 1 0 341558398 60551168 14020 33554432000 134512640 135840783 4287711648 4287589532 12870704 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 14783 14020 344 325 0 13719 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 59132

[startup+6.30034 s]
/proc/loadavg: 2.08 2.03 1.97 4/177 22072
/proc/meminfo: memFree=27744880/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=59132 CPUtime=6.28 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 16414 0 0 0 622 6 0 0 20 0 1 0 341558398 60551168 14024 33554432000 134512640 135840783 4287711648 4287589532 12870704 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 14783 14024 344 325 0 13719 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 59132

[startup+12.7003 s]
/proc/loadavg: 2.07 2.02 1.97 4/177 22072
/proc/meminfo: memFree=27755688/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=49496 CPUtime=12.69 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 17509 0 0 0 1261 8 0 0 20 0 1 0 341558398 50683904 11626 33554432000 134512640 135840783 4287711648 4287711008 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 12374 11626 347 325 0 11310 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 49496

[startup+25.5004 s]
/proc/loadavg: 2.12 2.04 1.98 4/177 22072
/proc/meminfo: memFree=27743392/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=60360 CPUtime=25.49 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 20225 0 0 0 2540 9 0 0 20 0 1 0 341558398 61808640 14342 33554432000 134512640 135840783 4287711648 4287711008 134551285 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 15090 14342 347 325 0 14026 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 60360

[startup+51.1004 s]
/proc/loadavg: 2.08 2.03 1.98 4/177 22072
/proc/meminfo: memFree=27732076/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=70172 CPUtime=51.08 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 22686 0 0 0 5098 10 0 0 20 0 1 0 341558398 71856128 16803 33554432000 134512640 135840783 4287711648 4287711008 134551175 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 17543 16803 347 325 0 16479 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 70172

[startup+102.3 s]
/proc/loadavg: 2.03 2.03 1.98 4/177 22072
/proc/meminfo: memFree=27709368/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=83696 CPUtime=102.28 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 26048 0 0 0 10216 12 0 0 20 0 1 0 341558398 85704704 20165 33554432000 134512640 135840783 4287711648 4287710900 11721291 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 20924 20165 347 325 0 19860 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 83696

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 1.98 4/177 22072
/proc/meminfo: memFree=27694904/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=92972 CPUtime=162.23 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 28420 0 0 0 16209 14 0 0 20 0 1 0 341558398 95203328 22511 33554432000 134512640 135840783 4287711648 4287711008 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 23243 22511 347 325 0 22179 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 92972

[startup+222.307 s]
/proc/loadavg: 2.00 2.02 1.98 4/177 22072
/proc/meminfo: memFree=27683524/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=100000 CPUtime=222.22 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 30169 0 0 0 22206 16 0 0 20 0 1 0 341558398 102400000 24259 33554432000 134512640 135840783 4287711648 4287711008 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 25000 24259 347 325 0 23936 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 100000

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 1.98 4/177 22073
/proc/meminfo: memFree=27673468/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=106232 CPUtime=282.21 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 31737 0 0 0 28203 18 0 0 20 0 1 0 341558398 108781568 25827 33554432000 134512640 135840783 4287711648 4287710880 11718330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 26558 25827 347 325 0 25494 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 106232

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22073
/proc/meminfo: memFree=27659940/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=114720 CPUtime=342.18 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 33862 0 0 0 34200 18 0 0 20 0 1 0 341558398 117473280 27944 33554432000 134512640 135840783 4287711648 4287711008 134550820 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 28680 27944 347 325 0 27616 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 114720

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22073
/proc/meminfo: memFree=27649664/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=121616 CPUtime=402.18 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 35570 0 0 0 40198 20 0 0 20 0 1 0 341558398 124534784 29649 33554432000 134512640 135840783 4287711648 4287711008 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 30404 29649 347 325 0 29340 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 121616

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22073
/proc/meminfo: memFree=27631856/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=134216 CPUtime=462.17 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 38725 0 0 0 46195 22 0 0 20 0 1 0 341558398 137437184 32804 33554432000 134512640 135840783 4287711648 4287711008 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 33554 32804 347 325 0 32490 0
Current children cumulated CPU time (s) 462.17
Current children cumulated vsize (KiB) 134216

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/178 22076
/proc/meminfo: memFree=27555080/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=194472 CPUtime=522.16 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 53791 0 0 0 52190 26 0 0 20 0 1 0 341558398 199139328 47870 33554432000 134512640 135840783 4287711648 4287711008 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 48618 47870 347 325 0 47554 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 194472

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22077
/proc/meminfo: memFree=27527860/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=202160 CPUtime=582.13 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 55747 0 0 0 58185 28 0 0 20 0 1 0 341558398 207011840 49792 33554432000 134512640 135840783 4287711648 4287711004 10246330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 50540 49792 347 325 0 49476 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 202160

[startup+642.3 s]

################
# More data... #
################

[startup+882.307 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22079
/proc/meminfo: memFree=27406888/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=226692 CPUtime=882.08 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 61890 0 0 0 88175 33 0 0 20 0 1 0 341558398 232132608 55928 33554432000 134512640 135840783 4287711648 4287711008 134551353 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 56673 55928 347 325 0 55609 0
Current children cumulated CPU time (s) 882.08
Current children cumulated vsize (KiB) 226692

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22079
/proc/meminfo: memFree=27386216/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=230804 CPUtime=942.05 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 62931 0 0 0 94171 34 0 0 20 0 1 0 341558398 236343296 56956 33554432000 134512640 135840783 4287711648 4287711008 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 57701 56956 347 325 0 56637 0
Current children cumulated CPU time (s) 942.05
Current children cumulated vsize (KiB) 230804

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22079
/proc/meminfo: memFree=27361752/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=234916 CPUtime=1002.04 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 63976 0 0 0 100170 34 0 0 20 0 1 0 341558398 240553984 58001 33554432000 134512640 135840783 4287711648 4287711008 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 58729 58001 347 325 0 57665 0
Current children cumulated CPU time (s) 1002.04
Current children cumulated vsize (KiB) 234916

[startup+1062.3 s]
/proc/loadavg: 2.04 2.01 1.98 4/177 22079
/proc/meminfo: memFree=27324924/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=238500 CPUtime=1062.03 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 64870 0 0 0 106168 35 0 0 20 0 1 0 341558398 244224000 58895 33554432000 134512640 135840783 4287711648 4287711008 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 59625 58895 347 325 0 58561 0
Current children cumulated CPU time (s) 1062.03
Current children cumulated vsize (KiB) 238500

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 1.98 4/178 22082
/proc/meminfo: memFree=27294640/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=243008 CPUtime=1122.03 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 65998 0 0 0 112167 36 0 0 20 0 1 0 341558398 248840192 60023 33554432000 134512640 135840783 4287711648 4287710928 11718316 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 60752 60023 347 325 0 59688 0
Current children cumulated CPU time (s) 1122.03
Current children cumulated vsize (KiB) 243008

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22083
/proc/meminfo: memFree=27270992/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=246192 CPUtime=1182.02 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 66799 0 0 0 118165 37 0 0 20 0 1 0 341558398 252100608 60824 33554432000 134512640 135840783 4287711648 4287710836 11710493 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 61548 60824 347 325 0 60484 0
Current children cumulated CPU time (s) 1182.02
Current children cumulated vsize (KiB) 246192

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22083
/proc/meminfo: memFree=27253056/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=250040 CPUtime=1242.01 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 67744 0 0 0 124164 37 0 0 20 0 1 0 341558398 256040960 61769 33554432000 134512640 135840783 4287711648 4287711008 134551646 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 62510 61769 347 325 0 61446 0
Current children cumulated CPU time (s) 1242.01
Current children cumulated vsize (KiB) 250040

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22083
/proc/meminfo: memFree=27216476/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=254816 CPUtime=1302 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 68925 0 0 0 130162 38 0 0 20 0 1 0 341558398 260931584 62950 33554432000 134512640 135840783 4287711648 4287710960 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 63704 62950 347 325 0 62640 0
Current children cumulated CPU time (s) 1302
Current children cumulated vsize (KiB) 254816

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.98 4/177 22083
/proc/meminfo: memFree=27191588/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=258000 CPUtime=1361.98 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 69735 0 0 0 136159 39 0 0 20 0 1 0 341558398 264192000 63747 33554432000 134512640 135840783 4287711648 4287711008 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 64500 63747 347 325 0 63436 0
Current children cumulated CPU time (s) 1361.98
Current children cumulated vsize (KiB) 258000

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22122
/proc/meminfo: memFree=27566864/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=260652 CPUtime=1421.98 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 70424 0 0 0 142158 40 0 0 20 0 1 0 341558398 266907648 64436 33554432000 134512640 135840783 4287711648 4287710884 11710558 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 65163 64436 347 325 0 64099 0
Current children cumulated CPU time (s) 1421.98
Current children cumulated vsize (KiB) 260652

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22123
/proc/meminfo: memFree=27564548/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=263304 CPUtime=1481.96 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 71066 0 0 0 148155 41 0 0 20 0 1 0 341558398 269623296 65078 33554432000 134512640 135840783 4287711648 4287711008 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 65826 65078 347 325 0 64762 0
Current children cumulated CPU time (s) 1481.96
Current children cumulated vsize (KiB) 263304

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22123
/proc/meminfo: memFree=27561576/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=266088 CPUtime=1541.95 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 71757 0 0 0 154154 41 0 0 20 0 1 0 341558398 272474112 65769 33554432000 134512640 135840783 4287711648 4287711008 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 66522 65769 347 325 0 65458 0
Current children cumulated CPU time (s) 1541.95
Current children cumulated vsize (KiB) 266088

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22123
/proc/meminfo: memFree=27558752/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=269268 CPUtime=1601.94 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 72576 0 0 0 160152 42 0 0 20 0 1 0 341558398 275730432 66583 33554432000 134512640 135840783 4287711648 4287711008 134550863 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 67317 66583 347 325 0 66253 0
Current children cumulated CPU time (s) 1601.94
Current children cumulated vsize (KiB) 269268

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22161
/proc/meminfo: memFree=27579316/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=272980 CPUtime=1661.93 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 73516 0 0 0 166150 43 0 0 20 0 1 0 341558398 279531520 67523 33554432000 134512640 135840783 4287711648 4287711008 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 68245 67523 347 325 0 67181 0
Current children cumulated CPU time (s) 1661.93
Current children cumulated vsize (KiB) 272980

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/178 22164
/proc/meminfo: memFree=27497844/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=277088 CPUtime=1721.92 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 74543 0 0 0 172148 44 0 0 20 0 1 0 341558398 283738112 68550 33554432000 134512640 135840783 4287711648 4287711008 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 69272 68550 347 325 0 68208 0
Current children cumulated CPU time (s) 1721.92
Current children cumulated vsize (KiB) 277088

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 22165
/proc/meminfo: memFree=27442732/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=281464 CPUtime=1781.91 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 75606 0 0 0 178146 45 0 0 20 0 1 0 341558398 288219136 69612 33554432000 134512640 135840783 4287711648 4287711008 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 70366 69612 347 325 0 69302 0
Current children cumulated CPU time (s) 1781.91
Current children cumulated vsize (KiB) 281464



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.06 2.02 1.99 3/177 22165
/proc/meminfo: memFree=27437616/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=282656 CPUtime=1800.01 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 75910 0 0 0 179955 46 0 0 20 0 1 0 341558398 289439744 69910 33554432000 134512640 135840783 4287711648 4287711008 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 70664 69910 347 325 0 69600 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 282656

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.06 2.02 1.99 3/177 22165
/proc/meminfo: memFree=27437616/32873648 swapFree=6864/6864
[pid=22071] ppid=22069 vsize=282656 CPUtime=1800.01 cores=1,3,5,7
/proc/22071/stat : 22071 (bsolo3.0.17) R 22069 22071 20253 0 -1 4202496 75910 0 0 0 179955 46 0 0 20 0 1 0 341558398 289439744 69910 33554432000 134512640 135840783 4287711648 4287711008 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/22071/statm: 70664 69910 347 325 0 69600 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 282656

Child status: 15
Real time (s): 1800.41
CPU time (s): 1800.02
CPU user time (s): 1799.56
CPU system time (s): 0.466929
CPU usage (%): 99.9787
Max. virtual memory (cumulated for all children) (KiB): 282656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.56
system time used= 0.466929
maximum resident set size= 279640
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 75913
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 144
involuntary context switches= 1848

runsolver used 3.33149 second user time and 9.57554 second system time

The end

Launcher Data 

Begin job on node113 at 2012-06-03 22:11:56
IDJOB=3740946
IDBENCH=89703
IDSOLVER=2318
FILE ID=node113/3740946-1338754315
RUNJOBID= node113-1338748314-20270
PBS_JOBID= 14636785
Free space on /tmp= 70956 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-91.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3740946-1338754315/watcher-3740946-1338754315 -o /tmp/evaluation-result-3740946-1338754315/solver-3740946-1338754315 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3740946-1338754315.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0d52a3bd95f65144c5f8bf26bef42f13
RANDOM SEED=132106386

node113.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27802536 kB
Buffers:          519352 kB
Cached:          3499324 kB
SwapCached:         2028 kB
Active:          1904552 kB
Inactive:        2277512 kB
Active(anon):     162960 kB
Inactive(anon):     1912 kB
Active(file):    1741592 kB
Inactive(file):  2275600 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67099708 kB
Dirty:             15916 kB
Writeback:             0 kB
AnonPages:        167904 kB
Mapped:            12564 kB
Shmem:                 0 kB
Slab:             752212 kB
SReclaimable:     196012 kB
SUnreclaim:       556200 kB
KernelStack:        1448 kB
PageTables:         4124 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     283408 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70948 MiB
End job on node113 at 2012-06-03 22:41:58