Trace number 3743605

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.12 1800.65

General information on the benchmark

Name/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null50mast_rapportOE2.0_TMAX60_K67_cod2.opb
MD5SUMcbe19c75f2e679c0a1949db29fa1022e
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-50552
Best CPU time to get the best result obtained on this benchmark1800.05
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables40937
Total number of constraints41436
Number of constraints which are clauses40882
Number of constraints which are cardinality constraints (but not clauses)67
Number of constraints which are nor clauses,nor cardinality constraints487
Minimum length of a constraint1
Maximum length of a constraint8416
Number of terms in the objective function 389
Biggest coefficient in the objective function 10946
Number of bits for the biggest coefficient in the objective function 14
Sum of the numbers in the objective function 2788485
Number of bits of the sum of numbers in the objective function 22
Biggest number in a constraint 10946
Number of bits of the biggest number in a constraint 14
Biggest sum of numbers in a constraint 2788485
Number of bits of the biggest sum of numbers22
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3743605-1338788382.opb
0.00/0.00	c File size is 2494487 bytes.
0.00/0.00	c Coefficients are big enough for not using lower bounding.
0.19/0.23	c Highest Coefficient sum: 2.78848e+06
0.19/0.23	c Parsing was ok!!
0.19/0.23	c Total parsing time: 0.229 s
0.19/0.25	c Var: 40937 Constr: 41436 40882/553/1 Lit: 223219 Watch. Lit: 131066
0.19/0.25	c Obj. Vars: 389 (0.950241 % of total variables)
19.39/19.48	c Pre-processing Time: 19.482 s
1800.07/1800.60	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1800.07/1800.60	c        0  33369    33985   194712    5   113284  570877      0      0 19.48
1800.07/1800.60	c      101  33369    34086   240824    7   113509  627965    101      5 19.58
1800.07/1800.60	c      254  33369    34239   268480    7   113811  690762    254     12 19.73
1800.07/1800.60	c      479  33369    34464   301691    8   114261  759839    479     24 19.94
1800.07/1800.60	c      821  33369    34806   362734   10   114942  835823    821     39 20.56
1800.07/1800.60	c     1329  33369    35314   432310   12   115959  919406   1329     62 21.19
1800.07/1800.60	c     2093  33369    36078   621093   17   117487  500000   2093     94 22.14
1800.07/1800.60	c     3240  33369    37225   837271   22   119779  550001   3240    138 23.47
1800.07/1800.60	c     4961  33369    38946  1188044   30   123222  605002   4961    195 25.36
1800.07/1800.60	c     7546  33369    41531  1776216   42   128393  665503   7546    256 29.43
1800.07/1800.60	c    11426  33369    45411  2544857   56   136151  732054  11426    335 34.06
1800.07/1800.60	c    17248  33369    51233  3793908   74   147802  805260  17248    420 40.97
1800.07/1800.60	c    25986  33369    59971  5249350   87   165279  885787  25986    501 51.77
1800.07/1800.60	c    39098  33369    73083  7913136  108   191499  974366  39098    502 77.88
1800.07/1800.60	c    58768  33369    92753 11078903  119   230837  500000  58768    538 109.07
1800.07/1800.60	c    88278  33369   122263 22028556  180   289858  550001  88278    418 210.70
1800.07/1800.60	c   132549  33369   166534 35474926  213   378400  605002 132549    277 477.39
1800.07/1800.60	c   198960  33369   232945 51189689  219   511222  665503 198960    210 946.19
1800.07/1800.60	c   298580  33369   332565 77073774  231   710464  732054 298580    171 1745.76
1800.07/1800.60	c Caught signal: 15
1800.07/1800.60	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.07/1800.60	c   18   301975 136646  1961197   335960 77779422 301975    167 1800.08
1800.07/1800.60	s UNKNOWN
1800.07/1800.60	c Total time: 1800.08 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743605-1338788382/watcher-3743605-1338788382 -o /tmp/evaluation-result-3743605-1338788382/solver-3743605-1338788382 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3743605-1338788382.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.87 1.98 1.93 3/176 30256
/proc/meminfo: memFree=28662900/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=7132 CPUtime=0 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 471 0 0 0 0 0 0 0 20 0 1 0 344966729 7303168 408 33554432000 134512640 135840783 4286791024 4286789712 2106663 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 1783 408 329 325 0 109 0

[startup+0.0968521 s]
/proc/loadavg: 1.87 1.98 1.93 3/176 30256
/proc/meminfo: memFree=28662900/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=11360 CPUtime=0.08 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 1826 0 0 0 8 0 0 0 20 0 1 0 344966729 11632640 1723 33554432000 134512640 135840783 4286791024 4286789840 2106663 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 2840 1723 592 325 0 1166 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 11360

[startup+0.100259 s]
/proc/loadavg: 1.87 1.98 1.93 3/176 30256
/proc/meminfo: memFree=28662900/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=11632 CPUtime=0.09 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 1876 0 0 0 9 0 0 0 20 0 1 0 344966729 11911168 1773 33554432000 134512640 135840783 4286791024 4286789840 2106545 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 2908 1774 602 325 0 1234 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 11632

[startup+0.300248 s]
/proc/loadavg: 1.87 1.98 1.93 3/176 30256
/proc/meminfo: memFree=28662900/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20180 CPUtime=0.28 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 4928 0 0 0 28 0 0 0 20 0 1 0 344966729 20664320 4136 33554432000 134512640 135840783 4286791024 4286298860 9180208 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5045 4136 344 325 0 3981 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 20180

[startup+0.700228 s]
/proc/loadavg: 1.87 1.98 1.93 3/176 30256
/proc/meminfo: memFree=28662900/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20180 CPUtime=0.68 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 4932 0 0 0 68 0 0 0 20 0 1 0 344966729 20664320 4140 33554432000 134512640 135840783 4286791024 4286298496 2104222 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5045 4140 344 325 0 3981 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 20180

[startup+1.50025 s]
/proc/loadavg: 1.87 1.98 1.93 3/177 30257
/proc/meminfo: memFree=28647608/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20840 CPUtime=1.49 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 5114 0 0 0 148 1 0 0 20 0 1 0 344966729 21340160 4322 33554432000 134512640 135840783 4286791024 4286298436 2093298 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5210 4322 344 325 0 4146 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 20840

[startup+3.10028 s]
/proc/loadavg: 1.87 1.98 1.93 3/177 30257
/proc/meminfo: memFree=28645864/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20840 CPUtime=3.09 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 5116 0 0 0 308 1 0 0 20 0 1 0 344966729 21340160 4324 33554432000 134512640 135840783 4286791024 4286298496 2104222 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5210 4324 344 325 0 4146 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 20840

[startup+6.30028 s]
/proc/loadavg: 1.88 1.98 1.93 3/177 30257
/proc/meminfo: memFree=28645988/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20840 CPUtime=6.29 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 5116 0 0 0 628 1 0 0 20 0 1 0 344966729 21340160 4324 33554432000 134512640 135840783 4286791024 4286298720 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5210 4324 344 325 0 4146 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 20840

[startup+12.7003 s]
/proc/loadavg: 1.89 1.98 1.93 3/177 30257
/proc/meminfo: memFree=28644788/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=20840 CPUtime=12.68 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 5116 0 0 0 1267 1 0 0 20 0 1 0 344966729 21340160 4324 33554432000 134512640 135840783 4286791024 4286298720 134551595 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 5210 4324 344 325 0 4146 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 20840

[startup+25.5004 s]
/proc/loadavg: 1.91 1.98 1.93 3/178 30261
/proc/meminfo: memFree=28632016/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=32720 CPUtime=25.48 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 8721 0 0 0 2544 4 0 0 20 0 1 0 344966729 33505280 7367 33554432000 134512640 135840783 4286791024 4286790260 2112103 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 8180 7367 349 325 0 7116 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 32720

[startup+51.1004 s]
/proc/loadavg: 1.94 1.98 1.93 3/178 30261
/proc/meminfo: memFree=28569736/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=85340 CPUtime=51.06 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 21904 0 0 0 5099 7 0 0 20 0 1 0 344966729 87388160 20526 33554432000 134512640 135840783 4286791024 4286790384 134551353 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 21335 20526 349 325 0 20271 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 85340

[startup+102.3 s]
/proc/loadavg: 1.97 1.98 1.93 3/177 30261
/proc/meminfo: memFree=28459800/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=155828 CPUtime=102.22 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 39536 0 0 0 10210 12 0 0 20 0 1 0 344966729 159567872 38118 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 38957 38118 349 325 0 37893 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 155828

[startup+162.3 s]
/proc/loadavg: 1.99 1.98 1.93 3/177 30261
/proc/meminfo: memFree=28301584/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=248708 CPUtime=162.17 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 62787 0 0 0 16199 18 0 0 20 0 1 0 344966729 254676992 61370 33554432000 134512640 135840783 4286791024 4286790384 134550913 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 62177 61370 349 325 0 61113 0
Current children cumulated CPU time (s) 162.17
Current children cumulated vsize (KiB) 248708

[startup+222.307 s]
/proc/loadavg: 1.99 1.98 1.93 3/177 30261
/proc/meminfo: memFree=28160252/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=315864 CPUtime=222.17 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 79592 0 0 0 22193 24 0 0 20 0 1 0 344966729 323444736 78175 33554432000 134512640 135840783 4286791024 4286790160 2104222 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 78966 78175 349 325 0 77902 0
Current children cumulated CPU time (s) 222.17
Current children cumulated vsize (KiB) 315864

[startup+282.3 s]
/proc/loadavg: 1.99 1.98 1.93 3/177 30261
/proc/meminfo: memFree=28077944/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=360080 CPUtime=282.16 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 90648 0 0 0 28187 29 0 0 20 0 1 0 344966729 368721920 89231 33554432000 134512640 135840783 4286791024 4286790384 134551175 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 90020 89234 349 325 0 88956 0
Current children cumulated CPU time (s) 282.16
Current children cumulated vsize (KiB) 360080

[startup+342.3 s]
/proc/loadavg: 1.99 1.98 1.93 3/177 30262
/proc/meminfo: memFree=28003764/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=404476 CPUtime=342.15 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 101740 0 0 0 34181 34 0 0 20 0 1 0 344966729 414183424 100323 33554432000 134512640 135840783 4286791024 4286790384 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 101119 100323 349 325 0 100055 0
Current children cumulated CPU time (s) 342.15
Current children cumulated vsize (KiB) 404476

[startup+402.3 s]
/proc/loadavg: 2.05 2.00 1.94 3/177 30262
/proc/meminfo: memFree=27933952/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=445632 CPUtime=402.14 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 112031 0 0 0 40176 38 0 0 20 0 1 0 344966729 456327168 110614 33554432000 134512640 135840783 4286791024 4286790320 134572689 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 111408 110614 349 325 0 110344 0
Current children cumulated CPU time (s) 402.14
Current children cumulated vsize (KiB) 445632

[startup+462.3 s]
/proc/loadavg: 2.10 2.02 1.94 3/177 30262
/proc/meminfo: memFree=27865420/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=476248 CPUtime=462.1 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 119701 0 0 0 46170 40 0 0 20 0 1 0 344966729 487677952 118251 33554432000 134512640 135840783 4286791024 4286790384 134550823 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 119062 118251 349 325 0 117998 0
Current children cumulated CPU time (s) 462.1
Current children cumulated vsize (KiB) 476248

[startup+522.3 s]
/proc/loadavg: 2.03 2.01 1.94 3/177 30262
/proc/meminfo: memFree=27807168/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=502864 CPUtime=522.05 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 126412 0 0 0 52161 44 0 0 20 0 1 0 344966729 514932736 124916 33554432000 134512640 135840783 4286791024 4286790384 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 125716 124916 349 325 0 124652 0
Current children cumulated CPU time (s) 522.05
Current children cumulated vsize (KiB) 502864

[startup+582.3 s]
/proc/loadavg: 2.01 2.00 1.94 3/177 30262
/proc/meminfo: memFree=27730440/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=538664 CPUtime=582 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 135409 0 0 0 58152 48 0 0 20 0 1 0 344966729 551591936 133868 33554432000 134512640 135840783 4286791024 4286790384 134551182 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 134666 133868 349 325 0 133602 0
Current children cumulated CPU time (s) 582
Current children cumulated vsize (KiB) 538664

[startup+642.3 s]

################
# More data... #
################

[startup+882.307 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30266
/proc/meminfo: memFree=27418064/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=667428 CPUtime=881.91 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 167660 0 0 0 88129 62 0 0 20 0 1 0 344966729 683446272 166071 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 166857 166071 349 325 0 165793 0
Current children cumulated CPU time (s) 881.91
Current children cumulated vsize (KiB) 667428

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30267
/proc/meminfo: memFree=27346296/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=689468 CPUtime=941.9 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 173146 0 0 0 94126 64 0 0 20 0 1 0 344966729 706015232 171557 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 172367 171557 349 325 0 171303 0
Current children cumulated CPU time (s) 941.9
Current children cumulated vsize (KiB) 689468

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30267
/proc/meminfo: memFree=27271428/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=713488 CPUtime=1001.89 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 179145 0 0 0 100122 67 0 0 20 0 1 0 344966729 730611712 177556 33554432000 134512640 135840783 4286791024 4286790384 134551330 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 178372 177556 349 325 0 177308 0
Current children cumulated CPU time (s) 1001.89
Current children cumulated vsize (KiB) 713488

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30267
/proc/meminfo: memFree=26996548/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=740104 CPUtime=1061.88 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 185820 0 0 0 106118 70 0 0 20 0 1 0 344966729 757866496 184231 33554432000 134512640 135840783 4286791024 4286790384 134551074 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 185026 184231 349 325 0 183962 0
Current children cumulated CPU time (s) 1061.88
Current children cumulated vsize (KiB) 740104

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30267
/proc/meminfo: memFree=26827688/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=758884 CPUtime=1121.87 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 190506 0 0 0 112114 73 0 0 20 0 1 0 344966729 777097216 188917 33554432000 134512640 135840783 4286791024 4286790384 134550896 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 189721 188917 349 325 0 188657 0
Current children cumulated CPU time (s) 1121.87
Current children cumulated vsize (KiB) 758884

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30267
/proc/meminfo: memFree=26766832/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=780240 CPUtime=1181.86 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 195857 0 0 0 118111 75 0 0 20 0 1 0 344966729 798965760 194268 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 195060 194268 349 325 0 193996 0
Current children cumulated CPU time (s) 1181.86
Current children cumulated vsize (KiB) 780240

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/178 30271
/proc/meminfo: memFree=26688484/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=808012 CPUtime=1241.85 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 202790 0 0 0 124107 78 0 0 20 0 1 0 344966729 827404288 201201 33554432000 134512640 135840783 4286791024 4286790384 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 202003 201201 349 325 0 200939 0
Current children cumulated CPU time (s) 1241.85
Current children cumulated vsize (KiB) 808012

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/178 30294
/proc/meminfo: memFree=26618080/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=826180 CPUtime=1301.84 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 207318 0 0 0 130105 79 0 0 20 0 1 0 344966729 846008320 205729 33554432000 134512640 135840783 4286791024 4286790384 134551186 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 206545 205729 349 325 0 205481 0
Current children cumulated CPU time (s) 1301.84
Current children cumulated vsize (KiB) 826180

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/177 30294
/proc/meminfo: memFree=26553884/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=849856 CPUtime=1361.83 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 213256 0 0 0 136101 82 0 0 20 0 1 0 344966729 870252544 211667 33554432000 134512640 135840783 4286791024 4286790384 134551353 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 212464 211667 349 325 0 211400 0
Current children cumulated CPU time (s) 1361.83
Current children cumulated vsize (KiB) 849856

[startup+1422.3 s]
/proc/loadavg: 2.06 2.01 1.95 3/177 30294
/proc/meminfo: memFree=26499352/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=873772 CPUtime=1421.83 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 219219 0 0 0 142098 85 0 0 20 0 1 0 344966729 894742528 217630 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 218443 217630 349 325 0 217379 0
Current children cumulated CPU time (s) 1421.83
Current children cumulated vsize (KiB) 873772

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 1.95 3/177 30294
/proc/meminfo: memFree=26457104/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=885420 CPUtime=1481.82 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 222132 0 0 0 148095 87 0 0 20 0 1 0 344966729 906670080 220543 33554432000 134512640 135840783 4286791024 4286790384 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 221355 220543 349 325 0 220291 0
Current children cumulated CPU time (s) 1481.82
Current children cumulated vsize (KiB) 885420

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.95 3/176 30294
/proc/meminfo: memFree=26412844/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=898672 CPUtime=1541.81 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 225456 0 0 0 154093 88 0 0 20 0 1 0 344966729 920240128 223867 33554432000 134512640 135840783 4286791024 4286790384 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 224668 223867 349 325 0 223604 0
Current children cumulated CPU time (s) 1541.81
Current children cumulated vsize (KiB) 898672

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/177 30295
/proc/meminfo: memFree=26368444/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=917400 CPUtime=1601.79 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 230122 0 0 0 160089 90 0 0 20 0 1 0 344966729 939417600 228533 33554432000 134512640 135840783 4286791024 4286790376 12781776 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 229350 228533 349 325 0 228286 0
Current children cumulated CPU time (s) 1601.79
Current children cumulated vsize (KiB) 917400

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/177 30295
/proc/meminfo: memFree=26267508/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=986284 CPUtime=1661.79 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 247342 0 0 0 166084 95 0 0 20 0 1 0 344966729 1009954816 245753 33554432000 134512640 135840783 4286791024 4286790320 134572684 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 246571 245753 349 325 0 245507 0
Current children cumulated CPU time (s) 1661.79
Current children cumulated vsize (KiB) 986284

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/177 30295
/proc/meminfo: memFree=26205260/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=1022740 CPUtime=1721.78 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 256486 0 0 0 172080 98 0 0 20 0 1 0 344966729 1047285760 254897 33554432000 134512640 135840783 4286791024 4286790376 12781753 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 255685 254897 349 325 0 254621 0
Current children cumulated CPU time (s) 1721.78
Current children cumulated vsize (KiB) 1022740

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/177 30295
/proc/meminfo: memFree=26167316/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=1036840 CPUtime=1781.77 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 260003 0 0 0 178077 100 0 0 20 0 1 0 344966729 1061724160 258414 33554432000 134512640 135840783 4286791024 4286790384 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 259210 258414 349 325 0 258146 0
Current children cumulated CPU time (s) 1781.77
Current children cumulated vsize (KiB) 1036840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.95 2/175 30296
/proc/meminfo: memFree=27639392/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=1040148 CPUtime=1800.07 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 260821 0 0 0 179907 100 0 0 20 0 1 0 344966729 1065111552 259232 33554432000 134512640 135840783 4286791024 4286790384 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 260037 259232 349 325 0 258973 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1040148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.95 2/175 30296
/proc/meminfo: memFree=27639392/32873844 swapFree=6872/6872
[pid=30256] ppid=30254 vsize=1040148 CPUtime=1800.07 cores=1,3,5,7
/proc/30256/stat : 30256 (bsolo3.0.17) R 30254 30256 30003 0 -1 4202496 260821 0 0 0 179907 100 0 0 20 0 1 0 344966729 1065111552 259232 33554432000 134512640 135840783 4286791024 4286790384 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/30256/statm: 260037 259232 349 325 0 258973 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1040148

Child status: 15
Real time (s): 1800.65
CPU time (s): 1800.12
CPU user time (s): 1799.07
CPU system time (s): 1.04884
CPU usage (%): 99.9709
Max. virtual memory (cumulated for all children) (KiB): 1040148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.07
system time used= 1.04884
maximum resident set size= 1036928
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 260824
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 267
involuntary context switches= 1887

runsolver used 4.22236 second user time and 9.14261 second system time

The end

Launcher Data 

Begin job on node106 at 2012-06-04 07:39:42
IDJOB=3743605
IDBENCH=91894
IDSOLVER=2318
FILE ID=node106/3743605-1338788382
RUNJOBID= node106-1338784775-30020
PBS_JOBID= 14636852
Free space on /tmp= 70856 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/sroussel/BA/normalized-BA_RDC4.dot_fibo_20null50mast_rapportOE2.0_TMAX60_K67_cod2.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743605-1338788382/watcher-3743605-1338788382 -o /tmp/evaluation-result-3743605-1338788382/solver-3743605-1338788382 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3743605-1338788382.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cbe19c75f2e679c0a1949db29fa1022e
RANDOM SEED=531676097

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28662908 kB
Buffers:          330824 kB
Cached:          3003824 kB
SwapCached:         2004 kB
Active:          1070244 kB
Inactive:        2286224 kB
Active(anon):      19196 kB
Inactive(anon):     4984 kB
Active(file):    1051048 kB
Inactive(file):  2281240 kB
Unevictable:        6872 kB
Mlocked:            6872 kB
SwapTotal:      67108856 kB
SwapFree:       67100580 kB
Dirty:             18256 kB
Writeback:             0 kB
AnonPages:         26800 kB
Mapped:            10376 kB
Shmem:                 0 kB
Slab:             714288 kB
SReclaimable:     156196 kB
SUnreclaim:       558092 kB
KernelStack:        1456 kB
PageTables:         3704 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     142564 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70848 MiB
End job on node106 at 2012-06-04 08:09:45