Trace number 3741724

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.04 1800.62

General information on the benchmark

Name/OPT-BIGINT-LIN/
heinz/normalized-stp3d.opb
MD5SUM1cc8070e576e6483e1f532bdbbfa41dd
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables204880
Total number of constraints159488
Number of constraints which are clauses129232
Number of constraints which are cardinality constraints (but not clauses)5805
Number of constraints which are nor clauses,nor cardinality constraints24451
Minimum length of a constraint2
Maximum length of a constraint120
Number of terms in the objective function 75648
Biggest coefficient in the objective function 100303
Number of bits for the biggest coefficient in the objective function 17
Sum of the numbers in the objective function 7576266096
Number of bits of the sum of numbers in the objective function 33
Biggest number in a constraint 100303
Number of bits of the biggest number in a constraint 17
Biggest sum of numbers in a constraint 7576266096
Number of bits of the biggest sum of numbers33
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741724-1338762760.opb
0.00/0.00	c File size is 9110192 bytes.
0.03/0.07	c Coefficients are big enough for not using lower bounding.
0.09/0.91	c Highest Coefficient sum: 7.57627e+09
0.09/0.91	c Parsing was ok!!
0.09/0.91	c Total parsing time: 0.912 s
0.91/1.00	c Var: 204880 Constr: 187573 132866/54707/0 Lit: 920592 Watch. Lit: 711194
0.91/1.00	c Obj. Vars: 75648 (36.9231 % of total variables)
37.81/38.87	c Pre-processing Time: 38.858 s
1800.03/1800.60	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1800.03/1800.60	c        0 172239   157564   814275    5   633000  500000      0      0 38.86
1800.03/1800.60	c      101 172239   157665   816496    5   633202  550001    101      2 38.95
1800.03/1800.60	c      254 172239   157818   821806    5   633508  605002    254      6 39.05
1800.03/1800.60	c      480 172239   158044   827133    5   633960  665503    480     12 39.35
1800.03/1800.60	c      818 172239   158382   838473    5   634636  732054    818     20 39.51
1800.03/1800.60	c     1327 172239   158891   853509    5   635654  805260   1327     33 40.10
1800.03/1800.60	c     2090 172239   159654   877150    5   637180  885787   2090     49 41.85
1800.03/1800.60	c     3236 172239   160800   926756    5   639472  974366   3236     73 44.25
1800.03/1800.60	c     4957 172239   162521  1016037    6   642914  500000   4957    109 45.37
1800.03/1800.60	c     7541 171935   165105  1060273    6   648079  550001   7541    145 51.79
1800.03/1800.60	c    11421 171931   168985  1314267    7   655838  605002  11421    205 55.47
1800.03/1800.60	c    17243 171930   174807  1562033    8   667481  665503  17243    268 64.25
1800.03/1800.60	c    25981 171921   183545  1863840   10   684954  732054  25981    317 81.77
1800.03/1800.60	c    39091 171921   196655  3079583   15   711174  805260  39091    372 105.07
1800.03/1800.60	c    58761 171921   216325  5758539   26   750514  885787  58761    392 149.57
1800.03/1800.60	c    88274 171918   245838  8323112   33   809537  974366  88274    422 208.88
1800.03/1800.60	c   132548 171917   290112 15950564   54   898084  500000 132548    366 361.99
1800.03/1800.60	c   198958 171915   356522 36257559  101  1030903  550001 198958    293 677.18
1800.03/1800.60	c   298581 171912   456145 81908249  179  1230148  605002 298581    181 1646.22
1800.03/1800.60	c Caught signal: 15
1800.03/1800.60	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.03/1800.60	c   18   311729 132878  6954427   469293 85637234 311729    173 1800.03
1800.03/1800.60	s UNKNOWN
1800.03/1800.60	c Total time: 1800.03 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741724-1338762760/watcher-3741724-1338762760 -o /tmp/evaluation-result-3741724-1338762760/solver-3741724-1338762760 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741724-1338762760.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4194304 138 0 0 0 0 0 0 0 20 0 1 0 342402913 4583424 89 33554432000 134512640 135840783 4289715232 4289714148 11205176 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 1119 108 90 325 0 39 0

[startup+0.0393919 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=23776 CPUtime=0.03 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 1219 0 0 0 3 0 0 0 20 0 1 0 342402913 24346624 1115 33554432000 134512640 135840783 4289715232 4289713936 1582375 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 5944 1115 454 325 0 2655 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23776

[startup+0.103273 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=20268 CPUtime=0.09 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 2658 0 0 0 9 0 0 0 20 0 1 0 342402913 20754432 2426 33554432000 134512640 135840783 4289715232 4289714224 134525286 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 5067 2426 660 325 0 1778 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20268

[startup+0.919562 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=45336 CPUtime=0.91 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 13616 0 0 0 89 2 0 0 20 0 1 0 342402913 46424064 10399 33554432000 134512640 135840783 4289715232 4289714608 12153904 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 11334 10399 338 325 0 10270 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 45336

[startup+1.00359 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=78140 CPUtime=0.99 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21030 0 0 0 96 3 0 0 20 0 1 0 342402913 80015360 18176 33554432000 134512640 135840783 4289715232 4289714796 134551888 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19535 18176 344 325 0 18471 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 78140

[startup+1.56517 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=79652 CPUtime=1.55 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21210 0 0 0 152 3 0 0 20 0 1 0 342402913 81563648 18356 33554432000 134512640 135840783 4289715232 4287255788 12153904 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19913 18356 344 325 0 18849 0
Current children cumulated CPU time (s) 1.55
Current children cumulated vsize (KiB) 79652

[startup+3.56532 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=79652 CPUtime=3.55 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21210 0 0 0 352 3 0 0 20 0 1 0 342402913 81563648 18356 33554432000 134512640 135840783 4289715232 4287255788 12153904 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19913 18356 344 325 0 18849 0
Current children cumulated CPU time (s) 3.55
Current children cumulated vsize (KiB) 79652

[startup+7.56517 s]
/proc/loadavg: 4.81 3.27 2.48 3/177 22703
/proc/meminfo: memFree=26647316/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=79652 CPUtime=7.55 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21210 0 0 0 751 4 0 0 20 0 1 0 342402913 81563648 18356 33554432000 134512640 135840783 4289715232 4287255788 12153904 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19913 18356 344 325 0 18849 0
Current children cumulated CPU time (s) 7.55
Current children cumulated vsize (KiB) 79652

[startup+33.5662 s]
/proc/loadavg: 4.38 3.22 2.47 3/178 22704
/proc/meminfo: memFree=26574040/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=79652 CPUtime=33.55 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21212 0 0 0 3345 10 0 0 20 0 1 0 342402913 81563648 18358 33554432000 134512640 135840783 4289715232 4287255788 12153904 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19913 18358 344 325 0 18849 0
Current children cumulated CPU time (s) 33.55
Current children cumulated vsize (KiB) 79652

[startup+35.5652 s]
/proc/loadavg: 4.38 3.22 2.47 3/178 22704
/proc/meminfo: memFree=26574040/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=79652 CPUtime=35.54 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 21212 0 0 0 3544 10 0 0 20 0 1 0 342402913 81563648 18358 33554432000 134512640 135840783 4289715232 4287255316 1569034 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 19913 18358 344 325 0 18849 0
Current children cumulated CPU time (s) 35.54
Current children cumulated vsize (KiB) 79652

[startup+51.5573 s]
/proc/loadavg: 3.29 3.09 2.46 8/178 22705
/proc/meminfo: memFree=26557080/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=84208 CPUtime=51.53 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 24722 0 0 0 5133 20 0 0 20 0 1 0 342402913 86228992 19532 33554432000 134512640 135840783 4289715232 4289714592 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 21052 19532 349 325 0 19988 0
Current children cumulated CPU time (s) 51.53
Current children cumulated vsize (KiB) 84208

[startup+103.565 s]
/proc/loadavg: 2.51 2.90 2.43 3/177 22705
/proc/meminfo: memFree=26514132/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=106420 CPUtime=103.54 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 30294 0 0 0 10332 22 0 0 20 0 1 0 342402913 108974080 25104 33554432000 134512640 135840783 4289715232 4289714368 1579934 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 26605 25104 349 325 0 25541 0
Current children cumulated CPU time (s) 103.54
Current children cumulated vsize (KiB) 106420

[startup+292.925 s]
/proc/loadavg: 2.51 2.90 2.43 3/177 22705
/proc/meminfo: memFree=26514132/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=246496 CPUtime=292.87 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 65319 0 0 0 29250 37 0 0 20 0 1 0 342402913 252411904 60129 33554432000 134512640 135840783 4289715232 4289714592 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 61624 60129 349 325 0 60560 0
Current children cumulated CPU time (s) 292.87
Current children cumulated vsize (KiB) 246496

[startup+293 s]
/proc/loadavg: 2.51 2.90 2.43 3/177 22705
/proc/meminfo: memFree=26514132/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=246628 CPUtime=292.95 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 65346 0 0 0 29258 37 0 0 20 0 1 0 342402913 252547072 60156 33554432000 134512640 135840783 4289715232 4289714592 134551079 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 61657 60156 349 325 0 60593 0
Current children cumulated CPU time (s) 292.95
Current children cumulated vsize (KiB) 246628

[startup+293.1 s]
/proc/loadavg: 2.51 2.90 2.43 3/177 22705
/proc/meminfo: memFree=26514132/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=246760 CPUtime=293.05 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 65357 0 0 0 29268 37 0 0 20 0 1 0 342402913 252682240 60167 33554432000 134512640 135840783 4289715232 4289714528 134572040 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 61690 60167 349 325 0 60626 0
Current children cumulated CPU time (s) 293.05
Current children cumulated vsize (KiB) 246760

[startup+342.3 s]
/proc/loadavg: 2.01 2.40 2.33 3/177 22706
/proc/meminfo: memFree=26265172/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=270836 CPUtime=342.24 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 71389 0 0 0 34184 40 0 0 20 0 1 0 342402913 277336064 66199 33554432000 134512640 135840783 4289715232 4289714368 1579934 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 67709 66199 349 325 0 66645 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 270836

[startup+402.307 s]
/proc/loadavg: 2.06 2.34 2.31 3/177 22745
/proc/meminfo: memFree=27519012/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=297980 CPUtime=402.23 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 78169 0 0 0 40180 43 0 0 20 0 1 0 342402913 305131520 72979 33554432000 134512640 135840783 4289715232 4289714592 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 74495 72979 349 325 0 73431 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 297980

[startup+462.3 s]
/proc/loadavg: 2.17 2.32 2.30 3/178 22748
/proc/meminfo: memFree=27385844/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=327372 CPUtime=462.18 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 85570 0 0 0 46172 46 0 0 20 0 1 0 342402913 335228928 80333 33554432000 134512640 135840783 4289715232 4289714592 134550921 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 81843 80333 349 325 0 80779 0
Current children cumulated CPU time (s) 462.18
Current children cumulated vsize (KiB) 327372

[startup+522.3 s]
/proc/loadavg: 2.06 2.26 2.28 3/177 22748
/proc/meminfo: memFree=27228028/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=352800 CPUtime=522.14 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 91982 0 0 0 52166 48 0 0 20 0 1 0 342402913 361267200 86701 33554432000 134512640 135840783 4289715232 4289714592 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 88200 86701 349 325 0 87136 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 352800

[startup+582.3 s]
/proc/loadavg: 2.02 2.21 2.26 3/177 22748
/proc/meminfo: memFree=27121044/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=397536 CPUtime=582.11 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 103198 0 0 0 58158 53 0 0 20 0 1 0 342402913 407076864 97869 33554432000 134512640 135840783 4289715232 4289702096 134586540 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 99384 97869 349 325 0 98320 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 397536

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.09 2.19 3/177 22749
/proc/meminfo: memFree=26741620/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=652960 CPUtime=821.99 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 167194 0 0 0 82127 72 0 0 20 0 1 0 342402913 668631040 162117 33554432000 134512640 135840783 4289715232 4289714584 5556432 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 163240 162117 349 325 0 162176 0
Current children cumulated CPU time (s) 821.99
Current children cumulated vsize (KiB) 652960

[startup+882.3 s]
/proc/loadavg: 2.00 2.07 2.17 3/177 22749
/proc/meminfo: memFree=26701224/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=692564 CPUtime=881.98 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 177097 0 0 0 88122 76 0 0 20 0 1 0 342402913 709185536 172020 33554432000 134512640 135840783 4289715232 4289714532 1587787 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 173141 172020 349 325 0 172077 0
Current children cumulated CPU time (s) 881.98
Current children cumulated vsize (KiB) 692564

[startup+942.3 s]
/proc/loadavg: 2.00 2.05 2.16 3/177 22749
/proc/meminfo: memFree=26571920/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=736468 CPUtime=941.98 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 188075 0 0 0 94118 80 0 0 20 0 1 0 342402913 754143232 182998 33554432000 134512640 135840783 4289715232 4289714592 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 184117 182998 349 325 0 183053 0
Current children cumulated CPU time (s) 941.98
Current children cumulated vsize (KiB) 736468

[startup+1002.3 s]
/proc/loadavg: 2.00 2.04 2.15 3/177 22750
/proc/meminfo: memFree=26520240/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=775704 CPUtime=1001.97 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 197867 0 0 0 100113 84 0 0 20 0 1 0 342402913 794320896 192790 33554432000 134512640 135840783 4289715232 4289714512 1584826 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 193926 192790 349 325 0 192862 0
Current children cumulated CPU time (s) 1001.97
Current children cumulated vsize (KiB) 775704

[startup+1062.31 s]
/proc/loadavg: 2.00 2.03 2.14 3/178 22753
/proc/meminfo: memFree=26476604/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=819164 CPUtime=1061.96 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 208723 0 0 0 106108 88 0 0 20 0 1 0 342402913 838823936 203646 33554432000 134512640 135840783 4289715232 4289714592 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 204791 203646 349 325 0 203727 0
Current children cumulated CPU time (s) 1061.96
Current children cumulated vsize (KiB) 819164

[startup+1122.3 s]
/proc/loadavg: 2.00 2.02 2.13 3/177 22753
/proc/meminfo: memFree=26435056/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=860640 CPUtime=1121.94 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 219086 0 0 0 112101 93 0 0 20 0 1 0 342402913 881295360 214009 33554432000 134512640 135840783 4289715232 4289714592 134551330 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 215160 214009 349 325 0 214096 0
Current children cumulated CPU time (s) 1121.94
Current children cumulated vsize (KiB) 860640

[startup+1182.3 s]
/proc/loadavg: 2.00 2.02 2.12 3/177 22753
/proc/meminfo: memFree=26401576/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=894000 CPUtime=1181.94 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 227450 0 0 0 118096 98 0 0 20 0 1 0 342402913 915456000 222373 33554432000 134512640 135840783 4289715232 4289714592 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 223500 222373 349 325 0 222436 0
Current children cumulated CPU time (s) 1181.94
Current children cumulated vsize (KiB) 894000

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.10 3/177 22753
/proc/meminfo: memFree=26370080/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=925824 CPUtime=1241.93 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 235396 0 0 0 124092 101 0 0 20 0 1 0 342402913 948043776 230319 33554432000 134512640 135840783 4289715232 4289714592 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 231456 230319 349 325 0 230392 0
Current children cumulated CPU time (s) 1241.93
Current children cumulated vsize (KiB) 925824

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.09 3/177 22754
/proc/meminfo: memFree=26339948/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=955672 CPUtime=1301.92 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 242858 0 0 0 130088 104 0 0 20 0 1 0 342402913 978608128 237781 33554432000 134512640 135840783 4289715232 4289714592 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 238918 237781 349 325 0 237854 0
Current children cumulated CPU time (s) 1301.92
Current children cumulated vsize (KiB) 955672

[startup+1362.3 s]
/proc/loadavg: 2.03 2.02 2.09 3/177 22754
/proc/meminfo: memFree=26309940/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=986248 CPUtime=1361.91 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 250492 0 0 0 136084 107 0 0 20 0 1 0 342402913 1009917952 245415 33554432000 134512640 135840783 4289715232 4289705920 1582375 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 246562 245415 349 325 0 245498 0
Current children cumulated CPU time (s) 1361.91
Current children cumulated vsize (KiB) 986248

[startup+1422.3 s]
/proc/loadavg: 2.06 2.03 2.09 3/177 22754
/proc/meminfo: memFree=26279312/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1016508 CPUtime=1421.91 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 258069 0 0 0 142080 111 0 0 20 0 1 0 342402913 1040904192 252992 33554432000 134512640 135840783 4289715232 4289714592 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 254127 252992 349 325 0 253063 0
Current children cumulated CPU time (s) 1421.91
Current children cumulated vsize (KiB) 1016508

[startup+1482.3 s]
/proc/loadavg: 2.02 2.02 2.08 3/177 22754
/proc/meminfo: memFree=26243008/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1052600 CPUtime=1481.88 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 267100 0 0 0 148074 114 0 0 20 0 1 0 342402913 1077862400 262006 33554432000 134512640 135840783 4289715232 4289714592 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 263150 262006 349 325 0 262086 0
Current children cumulated CPU time (s) 1481.88
Current children cumulated vsize (KiB) 1052600

[startup+1542.3 s]
/proc/loadavg: 2.00 2.02 2.08 3/177 22754
/proc/meminfo: memFree=26210548/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1084836 CPUtime=1541.85 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 275219 0 0 0 154067 118 0 0 20 0 1 0 342402913 1110872064 270077 33554432000 134512640 135840783 4289715232 4289714592 134550797 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 271209 270077 349 325 0 270145 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 1084836

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.07 3/177 22755
/proc/meminfo: memFree=26176848/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1117728 CPUtime=1601.83 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 283501 0 0 0 160061 122 0 0 20 0 1 0 342402913 1144553472 278312 33554432000 134512640 135840783 4289715232 4289714592 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 279432 278312 349 325 0 278368 0
Current children cumulated CPU time (s) 1601.83
Current children cumulated vsize (KiB) 1117728

[startup+1662.3 s]
/proc/loadavg: 2.11 2.03 2.07 3/178 22758
/proc/meminfo: memFree=26149256/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1145536 CPUtime=1661.78 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 290499 0 0 0 166053 125 0 0 20 0 1 0 342402913 1173028864 285264 33554432000 134512640 135840783 4289715232 4289714148 1577103 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 286384 285264 349 325 0 285320 0
Current children cumulated CPU time (s) 1661.78
Current children cumulated vsize (KiB) 1145536

[startup+1722.31 s]
/proc/loadavg: 2.04 2.03 2.07 3/178 22780
/proc/meminfo: memFree=26130900/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1162768 CPUtime=1721.77 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 294854 0 0 0 172049 128 0 0 20 0 1 0 342402913 1190674432 289572 33554432000 134512640 135840783 4289715232 4289714592 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 290692 289572 349 325 0 289628 0
Current children cumulated CPU time (s) 1721.77
Current children cumulated vsize (KiB) 1162768

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 2.06 3/177 22780
/proc/meminfo: memFree=26082596/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1182444 CPUtime=1781.73 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 299801 0 0 0 178043 130 0 0 20 0 1 0 342402913 1210822656 294476 33554432000 134512640 135840783 4289715232 4289714592 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 295611 294476 349 325 0 294547 0
Current children cumulated CPU time (s) 1781.73
Current children cumulated vsize (KiB) 1182444



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.09 2.04 2.07 3/177 22780
/proc/meminfo: memFree=26053548/32873648 swapFree=6864/6864
[pid=22703] ppid=22701 vsize=1188176 CPUtime=1800.03 cores=1,3,5,7
/proc/22703/stat : 22703 (bsolo3.0.17) R 22701 22703 20253 0 -1 4202496 301263 0 0 0 179872 131 0 0 20 0 1 0 342402913 1216692224 295922 33554432000 134512640 135840783 4289715232 4289714592 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/22703/statm: 297044 295922 349 325 0 295980 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1188176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.62
CPU time (s): 1800.04
CPU user time (s): 1798.72
CPU system time (s): 1.3218
CPU usage (%): 99.9682
Max. virtual memory (cumulated for all children) (KiB): 1188176

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.72
system time used= 1.3218
maximum resident set size= 1183688
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 301266
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 550
involuntary context switches= 1957

runsolver used 2.88056 second user time and 8.11777 second system time

The end

Launcher Data 

Begin job on node113 at 2012-06-04 00:32:41
IDJOB=3741724
IDBENCH=89904
IDSOLVER=2318
FILE ID=node113/3741724-1338762760
RUNJOBID= node113-1338748314-20270
PBS_JOBID= 14636785
Free space on /tmp= 70956 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/OPT-BIGINT-LIN/heinz/normalized-stp3d.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741724-1338762760/watcher-3741724-1338762760 -o /tmp/evaluation-result-3741724-1338762760/solver-3741724-1338762760 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741724-1338762760.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1cc8070e576e6483e1f532bdbbfa41dd
RANDOM SEED=1577485441

node113.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26648124 kB
Buffers:          537208 kB
Cached:          3509928 kB
SwapCached:         2028 kB
Active:          3032524 kB
Inactive:        2284032 kB
Active(anon):    1268872 kB
Inactive(anon):     1912 kB
Active(file):    1763652 kB
Inactive(file):  2282120 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67099708 kB
Dirty:             21328 kB
Writeback:             0 kB
AnonPages:       1273768 kB
Mapped:            12608 kB
Shmem:                 0 kB
Slab:             768216 kB
SReclaimable:     211336 kB
SUnreclaim:       556880 kB
KernelStack:        1448 kB
PageTables:         6292 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1390336 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70912 MiB
End job on node113 at 2012-06-04 01:02:43