Trace number 3743827

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.14 1800.75

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Large/
normalized-minisat100_16_6_7_ic.opb
MD5SUMa2354293496c014ad5960b8fe1959c3f
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark22900311
Best CPU time to get the best result obtained on this benchmark1800.77
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1000400
Total number of constraints2000307
Number of constraints which are clauses980300
Number of constraints which are cardinality constraints (but not clauses)7
Number of constraints which are nor clauses,nor cardinality constraints1020000
Minimum length of a constraint2
Maximum length of a constraint4950
Number of terms in the objective function 29800
Biggest coefficient in the objective function 143877824
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 182044199866
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 143877824
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 182044199866
Number of bits of the biggest sum of numbers38
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3743827-1338798162.opb
0.00/0.00	c File size is 102218042 bytes.
0.00/0.04	c Coefficients are big enough for not using lower bounding.
12.68/12.76	c Highest Coefficient sum: 1.82044e+11
12.68/12.76	c Parsing was ok!!
12.68/12.76	c Total parsing time: 12.754 s
13.49/13.52	c Var: 1000400 Constr: 2030014 1044654/10/985350 Lit: 8001400 Watch. Lit: 6026858
13.49/13.52	c Obj. Vars: 29800 (2.97881 % of total variables)
196.04/196.13	c Pre-processing Time: 196.069 s
1800.09/1800.70	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1800.09/1800.70	c        0 1000100  1970608  7881604    3  5907577  500000      0      0 196.07
1800.09/1800.70	c      105 1000100  1970713  8396935    4  5908175  550001    105      0 198.18
1800.09/1800.70	c      256 1000100  1970864  8467568    4  5908469  605002    256      1 202.45
1800.09/1800.70	c      481 1000100  1971089  8509620    4  5908935  665503    481      1 267.38
1800.09/1800.70	c      819 1000100  1971427  8553037    4  5909553  732054    819      2 294.56
1800.09/1800.70	c     1330 1000100  1971938 10685701    5  5910641  805260   1330      4 297.10
1800.09/1800.70	c     2095 1000100  1972703 11228602    5  5912159  885787   2095      6 315.08
1800.09/1800.70	c     3241 1000100  1973849 12088405    6  5914393  974366   3241      9 352.34
1800.09/1800.70	c     4963 1000100  1975571 20255242   10  5917826  500000   4963     13 356.13
1800.09/1800.70	c     7549 1000100  1978157 32958658   16  5923064  550001   7549     20 362.32
1800.09/1800.70	c    11429 1000100  1982037 51831075   26  5930819  605002  11429     28 396.79
1800.09/1800.70	c    17251 1000100  1987859 80315654   40  5942462  665503  17251     38 448.31
1800.09/1800.70	c    25989 1000100  1996597 122828130   61  5959946  732054  25989     46 562.40
1800.09/1800.70	c    39099 1000100  2009707 158660092   78  5986143  805260  39099     51 758.72
1800.09/1800.70	c    58771 1000100  2029379 197043622   97  6025426  885787  58771     65 896.23
1800.09/1800.70	c    88281 1000100  2058889 216310631  105  6084450  974366  88281     69 1264.06
1800.09/1800.70	c Caught signal: 15
1800.09/1800.70	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.09/1800.70	c   15    91736  12652  1479945  2062344 217494930  91736     50 1800.10
1800.09/1800.70	s UNKNOWN
1800.09/1800.70	c Total time: 1800.1 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743827-1338798162/watcher-3743827-1338798162 -o /tmp/evaluation-result-3743827-1338798162/solver-3743827-1338798162 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3743827-1338798162.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 2/176 30842
/proc/meminfo: memFree=28302644/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4194304 185 0 0 0 0 0 0 0 20 0 1 0 345944924 4583424 135 33554432000 134512640 135840783 4293254816 4293253732 7232056 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 1119 138 119 325 0 39 0

[startup+0.049564 s]
/proc/loadavg: 2.00 2.01 2.00 2/176 30842
/proc/meminfo: memFree=28302644/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=114924 CPUtime=0.04 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 1286 0 0 0 4 0 0 0 20 0 1 0 345944924 117682176 1182 33554432000 134512640 135840783 4293254816 4293253968 134524170 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 28731 1182 462 325 0 2711 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 114924

[startup+0.100223 s]
/proc/loadavg: 2.00 2.01 2.00 2/176 30842
/proc/meminfo: memFree=28302644/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=107780 CPUtime=0.09 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 1594 0 0 0 9 0 0 0 20 0 1 0 345944924 110366720 1490 33554432000 134512640 135840783 4293254816 4293253712 134539206 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 26945 1490 582 325 0 925 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 107780

[startup+0.300214 s]
/proc/loadavg: 2.00 2.01 2.00 2/176 30842
/proc/meminfo: memFree=28302644/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=116716 CPUtime=0.28 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 4391 0 0 0 28 0 0 0 20 0 1 0 345944924 119517184 4160 33554432000 134512640 135840783 4293254816 4293254016 134527442 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 29179 4161 1036 325 0 3159 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 116716

[startup+0.700227 s]
/proc/loadavg: 2.00 2.01 2.00 2/176 30842
/proc/meminfo: memFree=28302644/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=133520 CPUtime=0.69 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 9777 0 0 0 67 2 0 0 20 0 1 0 345944924 136724480 9291 33554432000 134512640 135840783 4293254816 4293253756 134521272 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 33380 9292 1964 325 0 7360 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 133520

[startup+1.50025 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 30843
/proc/meminfo: memFree=28260840/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=167560 CPUtime=1.48 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 20233 0 0 0 145 3 0 0 20 0 1 0 345944924 171581440 19126 33554432000 134512640 135840783 4293254816 4293253552 7775527 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 41890 19126 3708 325 0 15870 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 167560

[startup+3.10023 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 30843
/proc/meminfo: memFree=28203664/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=232032 CPUtime=3.09 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 39292 0 0 0 302 7 0 0 20 0 1 0 345944924 237600768 38082 33554432000 134512640 135840783 4293254816 4293252992 7635000 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 58008 38083 7157 325 0 31988 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 232032

[startup+6.30023 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 30843
/proc/meminfo: memFree=28094784/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=327280 CPUtime=6.28 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 69477 0 0 0 616 12 0 0 20 0 1 0 345944924 335134720 69542 33554432000 134512640 135840783 4293254816 4293253504 7775527 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 81820 69542 13766 325 0 55800 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 327280

[startup+12.7002 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 30843
/proc/meminfo: memFree=27986176/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=423364 CPUtime=12.68 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 104881 0 0 0 1250 18 0 0 20 0 1 0 345944924 433524736 104946 33554432000 134512640 135840783 4293254816 4293253964 8513896 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 105841 104946 25153 325 0 79821 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 423364

[startup+25.5002 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 30843
/proc/meminfo: memFree=27759824/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=558496 CPUtime=25.49 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 147263 0 0 0 2519 30 0 0 20 0 1 0 345944924 571899904 135599 33554432000 134512640 135840783 4293254816 4281249132 7304240 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 139624 135599 344 325 0 138560 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 558496

[startup+51.1002 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 30843
/proc/meminfo: memFree=27759824/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=558496 CPUtime=51.07 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 147263 0 0 0 5071 36 0 0 20 0 1 0 345944924 571899904 135599 33554432000 134512640 135840783 4293254816 4281248992 134550779 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 139624 135599 344 325 0 138560 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 558496

[startup+102.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/176 30843
/proc/meminfo: memFree=27756600/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=558496 CPUtime=102.26 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 147263 0 0 0 10175 51 0 0 20 0 1 0 345944924 571899904 135599 33554432000 134512640 135840783 4293254816 4281248992 134551084 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 139624 135599 344 325 0 138560 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 558496

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 30844
/proc/meminfo: memFree=27753092/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=558496 CPUtime=162.24 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 147268 0 0 0 16157 67 0 0 20 0 1 0 345944924 571899904 135599 33554432000 134512640 135840783 4293254816 4281249132 7304240 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 139624 135599 344 325 0 138560 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 558496

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30844
/proc/meminfo: memFree=27722860/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=579780 CPUtime=222.2 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 153404 0 0 0 22145 75 0 0 20 0 1 0 345944924 593694720 142323 33554432000 134512640 135840783 4293254816 4293254176 134550624 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 144945 142323 348 325 0 143881 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 579780

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30844
/proc/meminfo: memFree=27716192/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=582024 CPUtime=282.18 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 153961 0 0 0 28143 75 0 0 20 0 1 0 345944924 595992576 142874 33554432000 134512640 135840783 4293254816 4293254176 134550542 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 145506 142874 348 325 0 144442 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 582024

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30845
/proc/meminfo: memFree=27678648/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=616704 CPUtime=342.13 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 162670 0 0 0 34136 77 0 0 20 0 1 0 345944924 631504896 151543 33554432000 134512640 135840783 4293254816 4293254176 134551646 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 154176 151543 348 325 0 153112 0
Current children cumulated CPU time (s) 342.13
Current children cumulated vsize (KiB) 616704

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30845
/proc/meminfo: memFree=27126380/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=1166044 CPUtime=402.09 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 300041 0 0 0 40107 102 0 0 20 0 1 0 345944924 1194029056 288902 33554432000 134512640 135840783 4293254816 4293254176 134550804 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 291511 288902 348 325 0 290447 0
Current children cumulated CPU time (s) 402.09
Current children cumulated vsize (KiB) 1166044

[startup+462.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 30848
/proc/meminfo: memFree=26729600/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=1556404 CPUtime=462.07 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 397647 0 0 0 46084 123 0 0 20 0 1 0 345944924 1593757696 386499 33554432000 134512640 135840783 4293254816 4293254176 134550764 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 389101 386499 348 325 0 388037 0
Current children cumulated CPU time (s) 462.07
Current children cumulated vsize (KiB) 1556404

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30848
/proc/meminfo: memFree=26493292/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=1790176 CPUtime=522.03 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 456093 0 0 0 52069 134 0 0 20 0 1 0 345944924 1833140224 444940 33554432000 134512640 135840783 4293254816 4293254176 134551048 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 447544 444940 348 325 0 446480 0
Current children cumulated CPU time (s) 522.03
Current children cumulated vsize (KiB) 1790176

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30848
/proc/meminfo: memFree=26161000/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=2115508 CPUtime=582.01 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 537416 0 0 0 58052 149 0 0 20 0 1 0 345944924 2166280192 526252 33554432000 134512640 135840783 4293254816 4293254176 134550791 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 528877 526252 348 325 0 527813 0
Current children cumulated CPU time (s) 582.01
Current children cumulated vsize (KiB) 2115508

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30850
/proc/meminfo: memFree=25361932/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=2895684 CPUtime=821.92 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 732482 0 0 0 82006 186 0 0 20 0 1 0 345944924 2965180416 721301 33554432000 134512640 135840783 4293254816 4293254176 134551081 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 723921 721301 348 325 0 722857 0
Current children cumulated CPU time (s) 821.92
Current children cumulated vsize (KiB) 2895684

[startup+882.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 30850
/proc/meminfo: memFree=25287560/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=2970548 CPUtime=881.9 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 751188 0 0 0 87998 192 0 0 20 0 1 0 345944924 3041841152 740006 33554432000 134512640 135840783 4293254816 4293254176 134550878 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/30842/statm: 742637 740006 348 325 0 741573 0
Current children cumulated CPU time (s) 881.9
Current children cumulated vsize (KiB) 2970548

[startup+942.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 30851
/proc/meminfo: memFree=25264400/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=2990204 CPUtime=941.88 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 756106 0 0 0 93994 194 0 0 20 0 1 0 345944924 3061968896 744924 33554432000 134512640 135840783 4293254816 4293254176 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 747551 744924 348 325 0 746487 0
Current children cumulated CPU time (s) 941.88
Current children cumulated vsize (KiB) 2990204

[startup+1002.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 30851
/proc/meminfo: memFree=25205404/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3039784 CPUtime=1001.87 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 768536 0 0 0 99987 200 0 0 20 0 1 0 345944924 3112738816 757343 33554432000 134512640 135840783 4293254816 4293249328 134574700 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 759946 757343 348 325 0 758882 0
Current children cumulated CPU time (s) 1001.87
Current children cumulated vsize (KiB) 3039784

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 30854
/proc/meminfo: memFree=25151236/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3089652 CPUtime=1061.84 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 781004 0 0 0 105980 204 0 0 20 0 1 0 345944924 3163803648 769804 33554432000 134512640 135840783 4293254816 4293254176 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 772413 769804 348 325 0 771349 0
Current children cumulated CPU time (s) 1061.84
Current children cumulated vsize (KiB) 3089652

[startup+1122.31 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 30893
/proc/meminfo: memFree=25349292/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3137396 CPUtime=1121.83 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 792953 0 0 0 111976 207 0 0 20 0 1 0 345944924 3212693504 781745 33554432000 134512640 135840783 4293254816 4293254176 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 784349 781745 348 325 0 783285 0
Current children cumulated CPU time (s) 1121.83
Current children cumulated vsize (KiB) 3137396

[startup+1182.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 30893
/proc/meminfo: memFree=25285212/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3180412 CPUtime=1181.82 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 803683 0 0 0 117972 210 0 0 20 0 1 0 345944924 3256741888 792475 33554432000 134512640 135840783 4293254816 4293254176 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 795103 792475 348 325 0 794039 0
Current children cumulated CPU time (s) 1181.82
Current children cumulated vsize (KiB) 3180412

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30894
/proc/meminfo: memFree=25189388/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3219748 CPUtime=1241.8 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 813527 0 0 0 123966 214 0 0 20 0 1 0 345944924 3297021952 802312 33554432000 134512640 135840783 4293254816 4293254176 134550878 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 804937 802312 348 325 0 803873 0
Current children cumulated CPU time (s) 1241.8
Current children cumulated vsize (KiB) 3219748

[startup+1302.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 30894
/proc/meminfo: memFree=25147504/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3235804 CPUtime=1301.78 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 817553 0 0 0 129964 214 0 0 20 0 1 0 345944924 3313463296 806338 33554432000 134512640 135840783 4293254816 4293254176 134550705 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 808951 806338 348 325 0 807887 0
Current children cumulated CPU time (s) 1301.78
Current children cumulated vsize (KiB) 3235804

[startup+1362.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 30894
/proc/meminfo: memFree=25126452/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3237820 CPUtime=1361.78 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 818042 0 0 0 135963 215 0 0 20 0 1 0 345944924 3315527680 806827 33554432000 134512640 135840783 4293254816 4293254112 134571925 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 809455 806827 348 325 0 808391 0
Current children cumulated CPU time (s) 1361.78
Current children cumulated vsize (KiB) 3237820

[startup+1422.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 30894
/proc/meminfo: memFree=25109988/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3239024 CPUtime=1421.77 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 818363 0 0 0 141962 215 0 0 20 0 1 0 345944924 3316760576 807145 33554432000 134512640 135840783 4293254816 4293254176 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 809756 807145 348 325 0 808692 0
Current children cumulated CPU time (s) 1421.77
Current children cumulated vsize (KiB) 3239024

[startup+1482.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 30894
/proc/meminfo: memFree=25072196/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3240084 CPUtime=1481.76 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 818641 0 0 0 147961 215 0 0 20 0 1 0 345944924 3317846016 807419 33554432000 134512640 135840783 4293254816 4293254112 134571866 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 810021 807419 348 325 0 808957 0
Current children cumulated CPU time (s) 1481.76
Current children cumulated vsize (KiB) 3240084

[startup+1542.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 30895
/proc/meminfo: memFree=25053996/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3241148 CPUtime=1541.74 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 818886 0 0 0 153959 215 0 0 20 0 1 0 345944924 3318935552 807653 33554432000 134512640 135840783 4293254816 4293254176 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 810287 807653 348 325 0 809223 0
Current children cumulated CPU time (s) 1541.74
Current children cumulated vsize (KiB) 3241148

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30895
/proc/meminfo: memFree=25035052/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3243052 CPUtime=1601.72 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 819368 0 0 0 159957 215 0 0 20 0 1 0 345944924 3320885248 808133 33554432000 134512640 135840783 4293254816 4293254176 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 810763 808133 348 325 0 809699 0
Current children cumulated CPU time (s) 1601.72
Current children cumulated vsize (KiB) 3243052

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 30898
/proc/meminfo: memFree=24996880/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3244252 CPUtime=1661.72 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 819689 0 0 0 165956 216 0 0 20 0 1 0 345944924 3322114048 808454 33554432000 134512640 135840783 4293254816 4293253952 7773245 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 811063 808454 348 325 0 809999 0
Current children cumulated CPU time (s) 1661.72
Current children cumulated vsize (KiB) 3244252

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 30898
/proc/meminfo: memFree=24962196/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3246812 CPUtime=1721.7 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 820326 0 0 0 171954 216 0 0 20 0 1 0 345944924 3324735488 809091 33554432000 134512640 135840783 4293254816 4293254084 7772804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 811703 809091 348 325 0 810639 0
Current children cumulated CPU time (s) 1721.7
Current children cumulated vsize (KiB) 3246812

[startup+1782.31 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 30898
/proc/meminfo: memFree=24885964/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3248816 CPUtime=1781.69 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 820831 0 0 0 177953 216 0 0 20 0 1 0 345944924 3326787584 809591 33554432000 134512640 135840783 4293254816 4293254176 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 812204 809591 348 325 0 811140 0
Current children cumulated CPU time (s) 1781.69
Current children cumulated vsize (KiB) 3248816



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.7 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 30898
/proc/meminfo: memFree=24878120/32873844 swapFree=6872/6872
[pid=30842] ppid=30840 vsize=3249084 CPUtime=1800.09 cores=0,2,4,6
/proc/30842/stat : 30842 (bsolo3.0.17) R 30840 30842 30003 0 -1 4202496 820879 0 0 0 179793 216 0 0 20 0 1 0 345944924 3327062016 809637 33554432000 134512640 135840783 4293254816 4293254112 134572033 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/30842/statm: 812271 809637 348 325 0 811207 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 3249084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.75
CPU time (s): 1800.14
CPU user time (s): 1797.94
CPU system time (s): 2.19967
CPU usage (%): 99.9663
Max. virtual memory (cumulated for all children) (KiB): 3249084

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1797.94
system time used= 2.19966
maximum resident set size= 3238548
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 820882
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 314
involuntary context switches= 3763

runsolver used 4.84126 second user time and 7.75482 second system time

The end

Launcher Data 

Begin job on node106 at 2012-06-04 10:22:44
IDJOB=3743827
IDBENCH=92633
IDSOLVER=2318
FILE ID=node106/3743827-1338798162
RUNJOBID= node106-1338784775-30019
PBS_JOBID= 14636852
Free space on /tmp= 70732 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Large/normalized-minisat100_16_6_7_ic.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743827-1338798162/watcher-3743827-1338798162 -o /tmp/evaluation-result-3743827-1338798162/solver-3743827-1338798162 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3743827-1338798162.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a2354293496c014ad5960b8fe1959c3f
RANDOM SEED=1168309835

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28302644 kB
Buffers:          341860 kB
Cached:          3160128 kB
SwapCached:         2004 kB
Active:          1404908 kB
Inactive:        2302508 kB
Active(anon):     202844 kB
Inactive(anon):     4984 kB
Active(file):    1202064 kB
Inactive(file):  2297524 kB
Unevictable:        6872 kB
Mlocked:            6872 kB
SwapTotal:      67108856 kB
SwapFree:       67100580 kB
Dirty:            106344 kB
Writeback:             0 kB
AnonPages:        212480 kB
Mapped:            10364 kB
Shmem:                 0 kB
Slab:             722228 kB
SReclaimable:     163976 kB
SUnreclaim:       558252 kB
KernelStack:        1448 kB
PageTables:         4396 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     327692 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    178176 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70752 MiB
End job on node106 at 2012-06-04 10:52:47