Trace number 3733473

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.07 1800.51

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/
MIPLIB/miplib2003/normalized-mps-v2-20-10-a1c1s1.opb
MD5SUMdaeaeaee67028e931b0f5195f178e9b3
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables107520
Total number of constraints3312
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints3312
Minimum length of a constraint50
Maximum length of a constraint820
Number of terms in the objective function 41280
Biggest coefficient in the objective function 1342177280000000
Number of bits for the biggest coefficient in the objective function 51
Sum of the numbers in the objective function 260295726093315792
Number of bits of the sum of numbers in the objective function 58
Biggest number in a constraint 1342177280000000
Number of bits of the biggest number in a constraint 51
Biggest sum of numbers in a constraint 260295726093315792
Number of bits of the biggest sum of numbers58
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3733473-1338695911.opb
0.00/0.00	c File size is 4990137 bytes.
0.00/0.04	c Coefficients are big enough for not using lower bounding.
0.38/0.41	c Highest Coefficient sum: 2.60296e+17
0.38/0.41	c Parsing was ok!!
0.38/0.41	c Total parsing time: 0.407 s
0.38/0.43	c Var: 107520 Constr: 4560 0/0/4560 Lit: 438520 Watch. Lit: 64453
0.38/0.43	c Obj. Vars: 41280 (38.3929 % of total variables)
1.99/2.01	c Pre-processing Time: 2.004 s
1800.06/1800.50	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1800.06/1800.50	c        0  73244     4560   436055   95   359763  872110      0      0 2.00
1800.06/1800.50	c      101  73244     4661   440439   94   367207  959322    101     48 2.08
1800.06/1800.50	c      251  73244     4811   443941   92   367439  500000    251    119 2.10
1800.06/1800.50	c      476  73244     5036   457041   90   368024  550001    476    208 2.28
1800.06/1800.50	c      815  73244     5375   484857   90   368619  605002    815    332 2.45
1800.06/1800.50	c     1324  73244     5884   520838   88   369461  665503   1324    492 2.69
1800.06/1800.50	c     2088  73244     6648   564374   84   371042  732054   2088    708 2.95
1800.06/1800.50	c     3235  73244     7795   637337   81   378189  805260   3235    979 3.30
1800.06/1800.50	c     4956  73244     9516   827600   86   381623  885787   4956   1275 3.89
1800.06/1800.50	c     7540  73244    12100  1026920   84   386704  974366   7540   1718 4.39
1800.06/1800.50	c    11419  73244    15979  1267356   79   394386  500000  11419   1965 5.81
1800.06/1800.50	c    17241  73244    21801  2247360  103   406121  550001  17241   2269 7.60
1800.06/1800.50	c    25978  73244    30538  2756105   90   425357  605002  25978   2520 10.30
1800.06/1800.50	c    39088  73244    43648  4099173   93   451699  665503  39088   2791 14.00
1800.06/1800.50	c    58758  73244    63318  5497240   86   491040  732054  58758   2734 21.49
1800.06/1800.50	c    88269  73244    92829 13400634  144   552200  805260  88269   1737 50.80
1800.06/1800.50	c   132539  73244   137099 20787301  151   641054  885787 132539   1842 71.92
1800.06/1800.50	c   198950  73244   203510 28672718  140   772083  974366 198950   1934 102.87
1800.06/1800.50	c   298570  73244   303130 39183219  129   968935  500000 298570   1614 184.88
1800.06/1800.50	c   448006  73241   452566 49273588  108  1267147  550001 448006    807 555.08
1800.06/1800.50	c   672164  73239   105114 15310552  145   571932  605002 100554    676 993.85
1800.06/1800.50	c Caught signal: 15
1800.06/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.06/1800.50	c   20   914971  75184  4264148   347921 37888601 343361    508 1800.07
1800.06/1800.50	s UNKNOWN
1800.06/1800.50	c Total time: 1800.07 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3733473-1338695911/watcher-3733473-1338695911 -o /tmp/evaluation-result-3733473-1338695911/solver-3733473-1338695911 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3733473-1338695911.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.84 3.22 2.46 3/179 9393
/proc/meminfo: memFree=28699824/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4194304 206 0 0 0 0 0 0 0 20 0 1 0 335715919 4583424 156 33554432000 134512640 135840783 4286934448 4286933788 7173464 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 1119 157 136 325 0 39 0

[startup+0.0108951 s]
/proc/loadavg: 4.84 3.22 2.46 3/179 9393
/proc/meminfo: memFree=28699824/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=17532 CPUtime=0 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 520 0 0 0 0 0 0 0 20 0 1 0 335715919 17952768 456 33554432000 134512640 135840783 4286934448 4286933152 1692967 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 4383 458 342 325 0 2100 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 17532

[startup+0.100285 s]
/proc/loadavg: 4.84 3.22 2.46 3/179 9393
/proc/meminfo: memFree=28699824/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=15260 CPUtime=0.08 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 2412 0 0 0 8 0 0 0 20 0 1 0 335715919 15626240 2180 33554432000 134512640 135840783 4286934448 4286931744 1692967 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 3815 2180 665 325 0 1532 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 15260

[startup+0.300273 s]
/proc/loadavg: 4.84 3.22 2.46 3/179 9393
/proc/meminfo: memFree=28699824/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=21084 CPUtime=0.28 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 4612 0 0 0 28 0 0 0 20 0 1 0 335715919 21590016 4126 33554432000 134512640 135840783 4286934448 4286933440 134524931 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 5271 4127 1239 325 0 2988 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 21084

[startup+0.700286 s]
/proc/loadavg: 4.84 3.22 2.46 3/179 9393
/proc/meminfo: memFree=28699824/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=36004 CPUtime=0.68 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 9637 0 0 0 67 1 0 0 20 0 1 0 335715919 36868096 7851 33554432000 134512640 135840783 4286934448 4285643324 12272688 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 9001 7851 345 325 0 7937 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 36004

[startup+1.50029 s]
/proc/loadavg: 4.84 3.22 2.46 3/180 9394
/proc/meminfo: memFree=28669312/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=39936 CPUtime=1.48 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 11672 0 0 0 145 3 0 0 20 0 1 0 335715919 40894464 8833 33554432000 134512640 135840783 4286934448 4285535584 134546676 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 9984 8833 347 325 0 8920 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 39936

[startup+3.1003 s]
/proc/loadavg: 4.84 3.22 2.46 3/180 9394
/proc/meminfo: memFree=28663096/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=41528 CPUtime=3.09 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 12109 0 0 0 303 6 0 0 20 0 1 0 335715919 42524672 9270 33554432000 134512640 135840783 4286934448 4286933808 134551063 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 10382 9270 350 325 0 9318 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41528

[startup+6.30025 s]
/proc/loadavg: 4.62 3.20 2.45 3/180 9394
/proc/meminfo: memFree=28658820/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=50680 CPUtime=6.29 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 14384 0 0 0 622 7 0 0 20 0 1 0 335715919 51896320 11545 33554432000 134512640 135840783 4286934448 4286933760 134551356 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 12670 11545 350 325 0 11606 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 50680

[startup+12.7002 s]
/proc/loadavg: 4.41 3.18 2.45 3/180 9394
/proc/meminfo: memFree=28626968/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=81520 CPUtime=12.69 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 22104 0 0 0 1260 9 0 0 20 0 1 0 335715919 83476480 19265 33554432000 134512640 135840783 4286934448 4286932144 1692967 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 20380 19265 350 325 0 19316 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 81520

[startup+25.5002 s]
/proc/loadavg: 3.87 3.12 2.44 3/180 9394
/proc/meminfo: memFree=28571596/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=133660 CPUtime=25.48 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 35141 0 0 0 2537 11 0 0 20 0 1 0 335715919 136867840 32302 33554432000 134512640 135840783 4286934448 4286928816 1692967 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 33415 32302 350 325 0 32351 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 133660

[startup+51.1003 s]
/proc/loadavg: 3.23 3.03 2.43 3/180 9394
/proc/meminfo: memFree=28485932/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=213084 CPUtime=51.08 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 55012 0 0 0 5092 16 0 0 20 0 1 0 335715919 218198016 52173 33554432000 134512640 135840783 4286934448 4286933808 134550808 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 53271 52173 350 325 0 52207 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 213084

[startup+102.307 s]
/proc/loadavg: 2.49 2.85 2.41 3/180 9398
/proc/meminfo: memFree=28264432/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=416616 CPUtime=102.28 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 105923 0 0 0 10200 28 0 0 20 0 1 0 335715919 426614784 103082 33554432000 134512640 135840783 4286934448 4286933808 134551058 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 104154 103082 350 325 0 103090 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 416616

[startup+162.3 s]
/proc/loadavg: 2.19 2.71 2.38 3/180 9421
/proc/meminfo: memFree=28137368/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=544220 CPUtime=162.23 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 137839 0 0 0 16187 36 0 0 20 0 1 0 335715919 557281280 134976 33554432000 134512640 135840783 4286934448 4286933760 134551175 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 136055 134976 350 325 0 134991 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 544220

[startup+222.3 s]
/proc/loadavg: 2.07 2.58 2.35 3/179 9421
/proc/meminfo: memFree=28061012/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=620132 CPUtime=222.2 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 156824 0 0 0 22176 44 0 0 20 0 1 0 335715919 635015168 153955 33554432000 134512640 135840783 4286934448 4286933760 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 155033 153955 350 325 0 153969 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 620132

[startup+282.3 s]
/proc/loadavg: 2.02 2.47 2.33 3/179 9421
/proc/meminfo: memFree=28032660/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=648096 CPUtime=282.19 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 163820 0 0 0 28170 49 0 0 20 0 1 0 335715919 663650304 160951 33554432000 134512640 135840783 4286934448 4286933760 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 162024 160951 350 325 0 160960 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 648096

[startup+342.3 s]
/proc/loadavg: 2.01 2.38 2.30 3/179 9421
/proc/meminfo: memFree=28018164/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=662272 CPUtime=342.18 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 167378 0 0 0 34166 52 0 0 20 0 1 0 335715919 678166528 164508 33554432000 134512640 135840783 4286934448 4286933760 134550884 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 165568 164508 350 325 0 164504 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 662272

[startup+402.3 s]
/proc/loadavg: 2.00 2.31 2.28 3/179 9422
/proc/meminfo: memFree=28007792/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=672876 CPUtime=402.18 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 170017 0 0 0 40162 56 0 0 20 0 1 0 335715919 689025024 167147 33554432000 134512640 135840783 4286934448 4286933760 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 168219 167147 350 325 0 167155 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 672876

[startup+462.3 s]
/proc/loadavg: 2.00 2.25 2.26 3/179 9422
/proc/meminfo: memFree=27997404/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=683344 CPUtime=462.15 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 172660 0 0 0 46156 59 0 0 20 0 1 0 335715919 699744256 169773 33554432000 134512640 135840783 4286934448 4286933760 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 170836 169773 350 325 0 169772 0
Current children cumulated CPU time (s) 462.15
Current children cumulated vsize (KiB) 683344

[startup+522.3 s]
/proc/loadavg: 2.05 2.22 2.25 3/179 9422
/proc/meminfo: memFree=27966928/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=694208 CPUtime=522.11 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 175418 0 0 0 52149 62 0 0 20 0 1 0 335715919 710868992 172492 33554432000 134512640 135840783 4286934448 4286933760 134550863 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 173552 172492 350 325 0 172488 0
Current children cumulated CPU time (s) 522.11
Current children cumulated vsize (KiB) 694208

[startup+582.3 s]
/proc/loadavg: 2.02 2.17 2.23 3/179 9422
/proc/meminfo: memFree=27918504/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=742752 CPUtime=582.1 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 187532 0 0 0 58143 67 0 0 20 0 1 0 335715919 760578048 184606 33554432000 134512640 135840783 4286934448 4286933760 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 185688 184606 350 325 0 184624 0
Current children cumulated CPU time (s) 582.1
Current children cumulated vsize (KiB) 742752

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.05 2.16 3/179 9426
/proc/meminfo: memFree=27751392/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=882.05 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224748 0 0 0 88123 82 0 0 20 0 1 0 335715919 910594048 221247 33554432000 134512640 135840783 4286934448 4286933800 7620816 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221247 350 325 0 221249 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 889252

[startup+942.3 s]
/proc/loadavg: 2.00 2.04 2.14 3/179 9426
/proc/meminfo: memFree=27751392/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=942.04 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224748 0 0 0 94122 82 0 0 20 0 1 0 335715919 910594048 221247 33554432000 134512640 135840783 4286934448 4286933584 1690325 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221247 350 325 0 221249 0
Current children cumulated CPU time (s) 942.04
Current children cumulated vsize (KiB) 889252

[startup+1002.3 s]
/proc/loadavg: 2.05 2.05 2.14 3/179 9427
/proc/meminfo: memFree=27751268/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1002.03 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224750 0 0 0 100121 82 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550782 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1002.03
Current children cumulated vsize (KiB) 889252

[startup+1062.3 s]
/proc/loadavg: 2.06 2.05 2.13 3/179 9427
/proc/meminfo: memFree=27751008/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1062.01 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224754 0 0 0 106119 82 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1062.01
Current children cumulated vsize (KiB) 889252

[startup+1122.3 s]
/proc/loadavg: 2.02 2.04 2.12 3/179 9427
/proc/meminfo: memFree=27751284/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1121.96 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224796 0 0 0 112114 82 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933760 134551776 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1121.96
Current children cumulated vsize (KiB) 889252

[startup+1182.3 s]
/proc/loadavg: 2.00 2.03 2.11 3/179 9427
/proc/meminfo: memFree=27751324/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1181.95 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 118112 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933760 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1181.95
Current children cumulated vsize (KiB) 889252

[startup+1242.3 s]
/proc/loadavg: 2.00 2.02 2.10 3/179 9427
/proc/meminfo: memFree=27751448/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1241.94 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 124111 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1241.94
Current children cumulated vsize (KiB) 889252

[startup+1302.3 s]
/proc/loadavg: 2.00 2.02 2.09 3/180 9431
/proc/meminfo: memFree=27750980/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1301.94 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 130111 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1301.94
Current children cumulated vsize (KiB) 889252

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.08 3/179 9431
/proc/meminfo: memFree=27751120/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1361.92 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 136109 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1361.92
Current children cumulated vsize (KiB) 889252

[startup+1422.31 s]
/proc/loadavg: 2.00 2.01 2.08 3/179 9431
/proc/meminfo: memFree=27750996/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1421.92 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 142109 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933760 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1421.92
Current children cumulated vsize (KiB) 889252

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.07 3/179 9431
/proc/meminfo: memFree=27751120/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1481.9 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 148107 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1481.9
Current children cumulated vsize (KiB) 889252

[startup+1542.3 s]
/proc/loadavg: 2.04 2.01 2.07 2/177 9432
/proc/meminfo: memFree=27956428/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1541.9 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 154107 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933760 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1541.9
Current children cumulated vsize (KiB) 889252

[startup+1602.3 s]
/proc/loadavg: 2.07 2.02 2.07 3/178 9470
/proc/meminfo: memFree=27834712/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1601.89 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 160106 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1601.89
Current children cumulated vsize (KiB) 889252

[startup+1662.3 s]
/proc/loadavg: 2.02 2.02 2.06 3/179 9471
/proc/meminfo: memFree=27369704/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1661.88 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 166105 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933800 7620816 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1661.88
Current children cumulated vsize (KiB) 889252

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.06 3/179 9471
/proc/meminfo: memFree=27153572/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1721.87 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 172104 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1721.87
Current children cumulated vsize (KiB) 889252

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/179 9471
/proc/meminfo: memFree=26716224/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1781.86 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 178103 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1781.86
Current children cumulated vsize (KiB) 889252



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.05 3/179 9471
/proc/meminfo: memFree=26622108/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1800.06 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 179923 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 889252

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.05 3/179 9471
/proc/meminfo: memFree=26622108/32873844 swapFree=7380/7380
[pid=9393] ppid=9391 vsize=889252 CPUtime=1800.06 cores=1,3,5,7
/proc/9393/stat : 9393 (bsolo3.0.17) R 9391 9393 7079 0 -1 4202496 224811 0 0 0 179923 83 0 0 20 0 1 0 335715919 910594048 221249 33554432000 134512640 135840783 4286934448 4286933808 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9393/statm: 222313 221249 350 325 0 221249 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 889252

Child status: 15
Real time (s): 1800.51
CPU time (s): 1800.07
CPU user time (s): 1799.24
CPU system time (s): 0.834873
CPU usage (%): 99.9757
Max. virtual memory (cumulated for all children) (KiB): 891552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.24
system time used= 0.834873
maximum resident set size= 887288
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 224814
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 186
involuntary context switches= 1844

runsolver used 3.62045 second user time and 10.4664 second system time

The end

Launcher Data 

Begin job on node133 at 2012-06-03 05:58:31
IDJOB=3733473
IDBENCH=2504
IDSOLVER=2318
FILE ID=node133/3733473-1338695911
RUNJOBID= node133-1338678627-7099
PBS_JOBID= 14636680
Free space on /tmp= 70472 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-a1c1s1.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3733473-1338695911/watcher-3733473-1338695911 -o /tmp/evaluation-result-3733473-1338695911/solver-3733473-1338695911 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3733473-1338695911.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= daeaeaee67028e931b0f5195f178e9b3
RANDOM SEED=780320650

node133.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.540
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28700776 kB
Buffers:          393092 kB
Cached:          2740116 kB
SwapCached:          676 kB
Active:          1520980 kB
Inactive:        1761436 kB
Active(anon):     140356 kB
Inactive(anon):    10228 kB
Active(file):    1380624 kB
Inactive(file):  1751208 kB
Unevictable:        7380 kB
Mlocked:            7380 kB
SwapTotal:      67108856 kB
SwapFree:       67107040 kB
Dirty:             17652 kB
Writeback:             0 kB
AnonPages:        154924 kB
Mapped:            11800 kB
Shmem:                 0 kB
Slab:             747928 kB
SReclaimable:     189436 kB
SUnreclaim:       558492 kB
KernelStack:        1512 kB
PageTables:         4300 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     263656 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70468 MiB
End job on node133 at 2012-06-03 06:28:34