Trace number 3739623

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.06 1800.52

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12048_4-unsat.opb
MD5SUMe20086c85095d65afe65e19d07ad3aeb
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark33.9148
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables28798
Total number of constraints99736
Number of constraints which are clauses99264
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints472
Minimum length of a constraint1
Maximum length of a constraint69
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 28
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 397
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3739623-1338748763.opb
0.00/0.00	c File size is 2994149 bytes.
0.18/0.25	c Highest Coefficient sum: 397
0.18/0.25	c Parsing was ok!!
0.18/0.25	c Total parsing time: 0.251 s
0.18/0.28	c Var: 28798 Constr: 99736 99264/0/472 Lit: 239805 Watch. Lit: 222090
0.18/0.28	c Obj. Vars: 0 (0 % of total variables)
1.48/1.53	c Pre-processing Time: 1.529 s
1.48/1.53	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.48/1.53	c        0   6530    17827    46286    2    41268   22844      0      0 1.53
1.48/1.53	c Switching off LPR mode.
1800.04/1800.50	c      100   6530    17927    53473    2    42473   25129    100     62 1.60
1800.04/1800.50	c      250   6530    18077    61358    3    42952   27642    250    150 1.66
1800.04/1800.50	c      475   6530    18302    72903    3    43430   30407    475    263 1.80
1800.04/1800.50	c      815   6530    18642    98287    5    44120   33448    815    419 1.94
1800.04/1800.50	c     1323   6530    19150   149894    7    45168   36793   1323    608 2.17
1800.04/1800.50	c     2087   6530    19914   198019    9    46699   40473   2087    823 2.53
1800.04/1800.50	c     3234   6530    21061   283564   13    49023   44521   3234   1058 3.05
1800.04/1800.50	c     4957   6530    22784   421288   18    52462   48974   4957   1286 3.85
1800.04/1800.50	c     7543   6530    25370   633997   24    57650   53872   7543   1504 5.01
1800.04/1800.50	c    11426   6530    29253   965919   33    65403   59260  11426   1624 7.03
1800.04/1800.50	c    17248   6530    35075  1568754   44    77067   65187  17248   1635 10.55
1800.04/1800.50	c    25986   6530    43813  2484344   56    94571   71706  25986   1524 17.05
1800.04/1800.50	c    39098   6530    56925  4100862   72   120806   78877  39098   1214 32.20
1800.04/1800.50	c    58768   6530    76595  7267484   94   160100   86765  58768    953 61.65
1800.04/1800.50	c    88280   6530   106107 11768326  110   219105   95442  88280    635 138.84
1800.04/1800.50	c   132552   6530    47227  5237563  110   101387  104987  29400    479 276.18
1800.04/1800.50	c   198962   6530   113637 19919995  175   234184  115486  95810    426 466.04
1800.04/1800.50	c   298582   6530    91208 20323539  222   189278  127035  73381    345 864.58
1800.04/1800.50	c   448018   6530   107059 21193023  197   221023  139739  89232    329 1358.62
1800.04/1800.50	c Caught signal: 15
1800.04/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.04/1800.50	c   19   557337 135799   819843    71897  9762852  54070    309 1800.05
1800.04/1800.50	s UNKNOWN
1800.04/1800.50	c Total time: 1800.05 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739623-1338748763/watcher-3739623-1338748763 -o /tmp/evaluation-result-3739623-1338748763/solver-3739623-1338748763 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739623-1338748763.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.93 1.40 1.74 3/171 5983
/proc/meminfo: memFree=28562156/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=23104 CPUtime=0 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 442 0 0 0 0 0 0 0 20 0 1 0 341002009 23658496 379 33554432000 134512640 135840783 4291363616 4291362448 2499879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 5776 379 323 325 0 3981 0

[startup+0.0633941 s]
/proc/loadavg: 0.93 1.40 1.74 3/171 5983
/proc/meminfo: memFree=28562156/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=11256 CPUtime=0.05 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 1560 0 0 0 5 0 0 0 20 0 1 0 341002009 11526144 1497 33554432000 134512640 135840783 4291363616 4291362320 2499879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 2814 1499 504 325 0 1019 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 11256

[startup+0.100239 s]
/proc/loadavg: 0.93 1.40 1.74 3/171 5983
/proc/meminfo: memFree=28562156/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=13044 CPUtime=0.09 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 2118 0 0 0 9 0 0 0 20 0 1 0 341002009 13357056 2055 33554432000 134512640 135840783 4291363616 4291362320 2499879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 3261 2056 619 325 0 1466 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13044

[startup+0.300229 s]
/proc/loadavg: 0.93 1.40 1.74 3/171 5983
/proc/meminfo: memFree=28562156/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=25060 CPUtime=0.28 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 6242 0 0 0 28 0 0 0 20 0 1 0 341002009 25661440 5408 33554432000 134512640 135840783 4291363616 4291017132 14824496 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 6265 5408 344 325 0 5201 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 25060

[startup+0.70019 s]
/proc/loadavg: 0.93 1.40 1.74 3/171 5983
/proc/meminfo: memFree=28562156/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=25192 CPUtime=0.69 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 6266 0 0 0 68 1 0 0 20 0 1 0 341002009 25796608 5432 33554432000 134512640 135840783 4291363616 4291017132 14824496 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 6298 5432 344 325 0 5234 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25192

[startup+1.50025 s]
/proc/loadavg: 0.93 1.40 1.74 3/177 5993
/proc/meminfo: memFree=28513972/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=25192 CPUtime=1.48 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 6334 0 0 0 147 1 0 0 20 0 1 0 341002009 25796608 5443 33554432000 134512640 135840783 4291363616 4291016708 2486626 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 6298 5443 345 325 0 5234 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 25192

[startup+3.10027 s]
/proc/loadavg: 1.02 1.41 1.75 3/177 5993
/proc/meminfo: memFree=28511988/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=25220 CPUtime=3.09 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 6460 0 0 0 307 2 0 0 20 0 1 0 341002009 25825280 5456 33554432000 134512640 135840783 4291363616 4291362896 2502286 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 6305 5456 349 325 0 5241 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 25220

[startup+6.30026 s]
/proc/loadavg: 1.02 1.41 1.75 3/177 5993
/proc/meminfo: memFree=28511972/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=25616 CPUtime=6.28 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 6572 0 0 0 626 2 0 0 20 0 1 0 341002009 26230784 5560 33554432000 134512640 135840783 4291363616 4291362896 2502286 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 6404 5560 349 325 0 5340 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 25616

[startup+12.7003 s]
/proc/loadavg: 1.17 1.43 1.75 3/177 5993
/proc/meminfo: memFree=28500064/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=38156 CPUtime=12.67 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 9713 0 0 0 1265 2 0 0 20 0 1 0 341002009 39071744 8701 33554432000 134512640 135840783 4291363616 4291360448 2499879 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 9539 8701 349 325 0 8475 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 38156

[startup+25.5004 s]
/proc/loadavg: 1.29 1.45 1.75 3/177 5993
/proc/meminfo: memFree=28455160/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=59804 CPUtime=25.46 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 15139 0 0 0 2542 4 0 0 20 0 1 0 341002009 61239296 14120 33554432000 134512640 135840783 4291363616 4291362976 134551312 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 14951 14120 349 325 0 13887 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 59804

[startup+51.1004 s]
/proc/loadavg: 1.53 1.49 1.75 3/178 5996
/proc/meminfo: memFree=28372776/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=97168 CPUtime=51.06 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 24479 0 0 0 5098 8 0 0 20 0 1 0 341002009 99500032 23460 33554432000 134512640 135840783 4291363616 4291362868 2494648 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 24292 23460 349 325 0 23228 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 97168

[startup+102.3 s]
/proc/loadavg: 1.89 1.59 1.77 3/177 5996
/proc/meminfo: memFree=28248092/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=143508 CPUtime=102.26 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 36035 0 0 0 10212 14 0 0 20 0 1 0 341002009 146952192 35016 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 35877 35016 349 325 0 34813 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 143508

[startup+162.3 s]
/proc/loadavg: 1.95 1.66 1.78 3/177 5996
/proc/meminfo: memFree=28148920/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=185152 CPUtime=162.24 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 46451 0 0 0 16206 18 0 0 20 0 1 0 341002009 189595648 45432 33554432000 134512640 135840783 4291363616 4291362976 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 46288 45432 349 325 0 45224 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 185152

[startup+222.307 s]
/proc/loadavg: 1.98 1.72 1.79 3/177 5996
/proc/meminfo: memFree=28056640/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=223544 CPUtime=222.24 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 56065 0 0 0 22201 23 0 0 20 0 1 0 341002009 228909056 55040 33554432000 134512640 135840783 4291363616 4291362976 134551186 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 55886 55040 349 325 0 54822 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 223544

[startup+282.3 s]
/proc/loadavg: 1.99 1.77 1.80 3/177 5996
/proc/meminfo: memFree=27987600/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=247228 CPUtime=282.18 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 62142 0 0 0 28192 26 0 0 20 0 1 0 341002009 253161472 60952 33554432000 134512640 135840783 4291363616 4291362976 134551475 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 61807 60952 349 325 0 60743 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 247228

[startup+342.3 s]
/proc/loadavg: 1.99 1.81 1.82 3/177 5997
/proc/meminfo: memFree=27920856/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=247228 CPUtime=342.12 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 62189 0 0 0 34186 26 0 0 20 0 1 0 341002009 253161472 60952 33554432000 134512640 135840783 4291363616 4291362976 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 61807 60952 349 325 0 60743 0
Current children cumulated CPU time (s) 342.12
Current children cumulated vsize (KiB) 247228

[startup+402.3 s]
/proc/loadavg: 1.99 1.84 1.82 3/177 5997
/proc/meminfo: memFree=27870016/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=247228 CPUtime=402.11 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 62189 0 0 0 40185 26 0 0 20 0 1 0 341002009 253161472 60952 33554432000 134512640 135840783 4291363616 4291362976 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 61807 60952 349 325 0 60743 0
Current children cumulated CPU time (s) 402.11
Current children cumulated vsize (KiB) 247228

[startup+462.3 s]
/proc/loadavg: 1.99 1.87 1.83 3/177 5997
/proc/meminfo: memFree=27789912/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=273208 CPUtime=462.1 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 68705 0 0 0 46180 30 0 0 20 0 1 0 341002009 279764992 67468 33554432000 134512640 135840783 4291363616 4291362752 2499058 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 68302 67468 349 325 0 67238 0
Current children cumulated CPU time (s) 462.1
Current children cumulated vsize (KiB) 273208

[startup+522.3 s]
/proc/loadavg: 1.99 1.89 1.83 3/177 5997
/proc/meminfo: memFree=27708144/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=304248 CPUtime=522.1 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 76460 0 0 0 52175 35 0 0 20 0 1 0 341002009 311549952 75223 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 76062 75223 349 325 0 74998 0
Current children cumulated CPU time (s) 522.1
Current children cumulated vsize (KiB) 304248

[startup+582.3 s]
/proc/loadavg: 1.99 1.90 1.84 3/177 5997
/proc/meminfo: memFree=27634888/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=335872 CPUtime=582.09 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 84345 0 0 0 58170 39 0 0 20 0 1 0 341002009 343932928 83108 33554432000 134512640 135840783 4291363616 4291362976 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 83968 83108 349 325 0 82904 0
Current children cumulated CPU time (s) 582.09
Current children cumulated vsize (KiB) 335872

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.03 1.97 1.87 3/177 6001
/proc/meminfo: memFree=27415576/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=403824 CPUtime=822.05 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 101479 0 0 0 82158 47 0 0 20 0 1 0 341002009 413515776 100105 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 100956 100105 349 325 0 99892 0
Current children cumulated CPU time (s) 822.05
Current children cumulated vsize (KiB) 403824

[startup+882.307 s]
/proc/loadavg: 2.01 1.97 1.88 3/177 6001
/proc/meminfo: memFree=27380484/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=403824 CPUtime=882.05 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 101479 0 0 0 88158 47 0 0 20 0 1 0 341002009 413515776 100105 33554432000 134512640 135840783 4291363616 4291362976 134551182 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 100956 100105 349 325 0 99892 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 403824

[startup+942.3 s]
/proc/loadavg: 2.00 1.97 1.89 3/177 6002
/proc/meminfo: memFree=27353576/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=403824 CPUtime=942.03 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 101479 0 0 0 94156 47 0 0 20 0 1 0 341002009 413515776 100105 33554432000 134512640 135840783 4291363616 4291362976 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 100956 100105 349 325 0 99892 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 403824

[startup+1002.3 s]
/proc/loadavg: 2.00 1.97 1.89 3/177 6002
/proc/meminfo: memFree=27325980/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=403824 CPUtime=1002 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 101513 0 0 0 100152 48 0 0 20 0 1 0 341002009 413515776 100105 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 100956 100105 349 325 0 99892 0
Current children cumulated CPU time (s) 1002
Current children cumulated vsize (KiB) 403824

[startup+1062.3 s]
/proc/loadavg: 2.00 1.97 1.90 3/177 6002
/proc/meminfo: memFree=27299976/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=410688 CPUtime=1061.95 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 103293 0 0 0 106146 49 0 0 20 0 1 0 341002009 420544512 101841 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 102672 101841 349 325 0 101608 0
Current children cumulated CPU time (s) 1061.95
Current children cumulated vsize (KiB) 410688

[startup+1122.3 s]
/proc/loadavg: 2.00 1.97 1.90 3/177 6002
/proc/meminfo: memFree=27243060/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=444284 CPUtime=1121.93 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 111671 0 0 0 112140 53 0 0 20 0 1 0 341002009 454946816 110219 33554432000 134512640 135840783 4291363616 4291362976 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 111071 110219 349 325 0 110007 0
Current children cumulated CPU time (s) 1121.93
Current children cumulated vsize (KiB) 444284

[startup+1182.3 s]
/proc/loadavg: 2.00 1.97 1.91 3/177 6002
/proc/meminfo: memFree=27187012/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1181.93 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 118136 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1181.93
Current children cumulated vsize (KiB) 481236

[startup+1242.3 s]
/proc/loadavg: 2.00 1.97 1.91 3/178 6006
/proc/meminfo: memFree=27168900/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1241.92 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 124135 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1241.92
Current children cumulated vsize (KiB) 481236

[startup+1302.3 s]
/proc/loadavg: 2.03 1.99 1.91 3/178 6028
/proc/meminfo: memFree=27149260/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1301.91 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 130134 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362928 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1301.91
Current children cumulated vsize (KiB) 481236

[startup+1362.3 s]
/proc/loadavg: 2.01 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27113976/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1361.9 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 136133 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1361.9
Current children cumulated vsize (KiB) 481236

[startup+1422.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27075412/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1421.9 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 142133 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134550942 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1421.9
Current children cumulated vsize (KiB) 481236

[startup+1482.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27044164/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1481.88 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 148131 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1481.88
Current children cumulated vsize (KiB) 481236

[startup+1542.31 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6029
/proc/meminfo: memFree=27019240/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1541.88 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 154131 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1541.88
Current children cumulated vsize (KiB) 481236

[startup+1602.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6029
/proc/meminfo: memFree=26995956/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=481236 CPUtime=1601.86 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 121065 0 0 0 160129 57 0 0 20 0 1 0 341002009 492785664 119465 33554432000 134512640 135840783 4291363616 4291362976 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 120309 119465 349 325 0 119245 0
Current children cumulated CPU time (s) 1601.86
Current children cumulated vsize (KiB) 481236

[startup+1662.3 s]
/proc/loadavg: 2.03 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26957792/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=496860 CPUtime=1661.86 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 124967 0 0 0 166127 59 0 0 20 0 1 0 341002009 508784640 123367 33554432000 134512640 135840783 4291363616 4291362968 1419444 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 124215 123367 349 325 0 123151 0
Current children cumulated CPU time (s) 1661.86
Current children cumulated vsize (KiB) 496860

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26907228/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=526636 CPUtime=1721.84 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 132409 0 0 0 172121 63 0 0 20 0 1 0 341002009 539275264 130809 33554432000 134512640 135840783 4291363616 4291362968 1419449 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 131659 130809 349 325 0 130595 0
Current children cumulated CPU time (s) 1721.84
Current children cumulated vsize (KiB) 526636

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26881128/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=534180 CPUtime=1781.84 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 134458 0 0 0 178119 65 0 0 20 0 1 0 341002009 547000320 132697 33554432000 134512640 135840783 4291363616 4291362976 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 133545 132697 349 325 0 132481 0
Current children cumulated CPU time (s) 1781.84
Current children cumulated vsize (KiB) 534180



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26881748/32873844 swapFree=7112/7112
[pid=5983] ppid=5981 vsize=534180 CPUtime=1800.04 cores=1,3,5,7
/proc/5983/stat : 5983 (bsolo3.0.17) R 5981 5983 5948 0 -1 4202496 134458 0 0 0 179939 65 0 0 20 0 1 0 341002009 547000320 132697 33554432000 134512640 135840783 4291363616 4291362976 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/5983/statm: 133545 132697 349 325 0 132481 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 534180

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.52
CPU time (s): 1800.06
CPU user time (s): 1799.4
CPU system time (s): 0.665898
CPU usage (%): 99.9747
Max. virtual memory (cumulated for all children) (KiB): 534824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.4
system time used= 0.665898
maximum resident set size= 531432
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 134461
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 205
involuntary context switches= 1870

runsolver used 3.61145 second user time and 10.1944 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-03 20:39:23
IDJOB=3739623
IDBENCH=73869
IDSOLVER=2318
FILE ID=node119/3739623-1338748763
RUNJOBID= node119-1338748763-5965
PBS_JOBID= 14636790
Free space on /tmp= 70896 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12048_4-unsat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739623-1338748763/watcher-3739623-1338748763 -o /tmp/evaluation-result-3739623-1338748763/solver-3739623-1338748763 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739623-1338748763.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e20086c85095d65afe65e19d07ad3aeb
RANDOM SEED=1111250848

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28569016 kB
Buffers:          410496 kB
Cached:          3058464 kB
SwapCached:         1936 kB
Active:          1494728 kB
Inactive:        1980772 kB
Active(anon):       2504 kB
Inactive(anon):     6624 kB
Active(file):    1492224 kB
Inactive(file):  1974148 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:             13232 kB
Writeback:             0 kB
AnonPages:         12308 kB
Mapped:            10976 kB
Shmem:                 0 kB
Slab:             690592 kB
SReclaimable:     132584 kB
SUnreclaim:       558008 kB
KernelStack:        1384 kB
PageTables:         3964 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104136 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70880 MiB
End job on node119 at 2012-06-03 21:09:26