Trace number 3740998

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.04 1800.51

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-76.opb
MD5SUMf030651c159d27eae553d070b0927366
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1408.44
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables12587
Total number of constraints283937
Number of constraints which are clauses255125
Number of constraints which are cardinality constraints (but not clauses)903
Number of constraints which are nor clauses,nor cardinality constraints27909
Minimum length of a constraint2
Maximum length of a constraint270
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 271
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3740998-1338754732.opb
0.00/0.00	c File size is 12187273 bytes.
0.89/0.96	c Highest Coefficient sum: 271
0.89/0.96	c Parsing was ok!!
0.89/0.96	c Total parsing time: 0.952 s
0.99/1.01	c Var: 12587 Constr: 284398 255583/906/27909 Lit: 1098535 Watch. Lit: 573848
0.99/1.01	c Obj. Vars: 0 (0 % of total variables)
14.68/14.79	c Pre-processing Time: 14.783 s
14.78/14.80	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
14.78/14.80	c        0  12587   280342  1078258    3   593645  381749      0      0 14.78
14.78/14.80	c Switching off LPR mode.
1800.03/1800.50	c      100  12587   280442  1080889    3   590084  419924    100      6 14.86
1800.03/1800.50	c      252  12587   280594  1084706    3   590066  461917    252     16 15.08
1800.03/1800.50	c      477  12587   280819  1088994    3   589772  508109    477     31 15.30
1800.03/1800.50	c      816  12587   281158  1099204    3   589601  558920    816     52 15.67
1800.03/1800.50	c     1324  12587   281666  1131832    4   589323  614813   1324     82 16.11
1800.03/1800.50	c     2087  12587   282429  1150349    4   590281  676295   2087    124 16.73
1800.03/1800.50	c     3233  12587   283575  1202538    4   591599  743925   3233    183 17.64
1800.03/1800.50	c     4954  12587   285296  1313331    4   594377  818318   4954    257 19.26
1800.03/1800.50	c     7538  12587   287880  1434370    4   599874  900150   7538    353 21.31
1800.03/1800.50	c    11417  12587   291759  1666966    5   604425  990166  11417    430 26.55
1800.03/1800.50	c    17240  12587   297582  2013975    6   615247  500000  17240    537 32.07
1800.03/1800.50	c    25978  12587   306320  2569360    8   632690  550001  25978    602 43.10
1800.03/1800.50	c    39088  12586   319430  3475538   10   658591  605002  39088    511 76.39
1800.03/1800.50	c    58759  12586   339101  4723130   13   699335  665503  58759    623 94.30
1800.03/1800.50	c    88269  12586   368611  6783220   18   758086  732054  88269    403 219.01
1800.03/1800.50	c   132540  12585   412882  9539334   23   845025  805260 132540    253 522.60
1800.03/1800.50	c   198954  12584   479296 13946188   29   977705  885787 198954    157 1259.59
1800.03/1800.50	c   298574  12584   578916 27431368   47  1180518  974366 298574    210 1417.36
1800.03/1800.50	c Caught signal: 15
1800.03/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.03/1800.50	c   18   325022  92308  4056475   605364 29177769 325022    180 1800.03
1800.03/1800.50	s UNKNOWN
1800.03/1800.50	c Total time: 1800.03 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3740998-1338754732/watcher-3740998-1338754732 -o /tmp/evaluation-result-3740998-1338754732/solver-3740998-1338754732 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3740998-1338754732.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 2/176 6854
/proc/meminfo: memFree=28402420/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=2888 CPUtime=0 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4194304 104 0 0 0 0 0 0 0 20 0 1 0 341598912 2957312 56 33554432000 134512640 135840783 4290265744 4290263728 5489604 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 722 61 47 325 0 35 0

[startup+0.098958 s]
/proc/loadavg: 1.92 1.98 1.99 2/176 6854
/proc/meminfo: memFree=28402420/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=20276 CPUtime=0.09 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 1661 0 0 0 9 0 0 0 20 0 1 0 341598912 20762624 1598 33554432000 134512640 135840783 4290265744 4290264652 2384704 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 5069 1598 612 325 0 1029 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20276

[startup+0.100235 s]
/proc/loadavg: 1.92 1.98 1.99 2/176 6854
/proc/meminfo: memFree=28402420/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=20276 CPUtime=0.09 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 1677 0 0 0 9 0 0 0 20 0 1 0 341598912 20762624 1614 33554432000 134512640 135840783 4290265744 4290264640 134539151 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 5069 1614 615 325 0 1029 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20276

[startup+0.300188 s]
/proc/loadavg: 1.92 1.98 1.99 2/176 6854
/proc/meminfo: memFree=28402420/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=27784 CPUtime=0.29 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 4192 0 0 0 29 0 0 0 20 0 1 0 341598912 28450816 4129 33554432000 134512640 135840783 4290265744 4290264892 6740347 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 6946 4129 1241 325 0 2906 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27784

[startup+0.700191 s]
/proc/loadavg: 1.92 1.98 1.99 2/176 6854
/proc/meminfo: memFree=28402420/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=42384 CPUtime=0.68 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 9040 0 0 0 68 0 0 0 20 0 1 0 341598912 43401216 8977 33554432000 134512640 135840783 4290265744 4290264640 134539102 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 10596 8977 2449 325 0 6556 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 42384

[startup+1.50023 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28354828/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=73032 CPUtime=1.48 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 20529 0 0 0 145 3 0 0 20 0 1 0 341598912 74784768 17490 33554432000 134512640 135840783 4290265744 4290113628 1680432 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 18258 17490 344 325 0 17194 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 73032

[startup+3.10023 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28332864/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=73032 CPUtime=3.09 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 20532 0 0 0 304 5 0 0 20 0 1 0 341598912 74784768 17493 33554432000 134512640 135840783 4290265744 4290113628 1680432 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 18258 17493 344 325 0 17194 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 73032

[startup+6.30023 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28332492/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=73032 CPUtime=6.28 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 20536 0 0 0 621 7 0 0 20 0 1 0 341598912 74784768 17497 33554432000 134512640 135840783 4290265744 4290113628 1680432 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 18258 17497 344 325 0 17194 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 73032

[startup+12.7002 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28331880/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=73164 CPUtime=12.68 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 20542 0 0 0 1257 11 0 0 20 0 1 0 341598912 74919936 17503 33554432000 134512640 135840783 4290265744 4290113616 134545221 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 18291 17503 344 325 0 17227 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 73164

[startup+25.5002 s]
/proc/loadavg: 1.95 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28341172/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=62908 CPUtime=25.48 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 22383 0 0 0 2535 13 0 0 20 0 1 0 341598912 64417792 14951 33554432000 134512640 135840783 4290265744 4290265104 134550817 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/6854/statm: 15727 14951 347 325 0 14663 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 62908

[startup+51.1003 s]
/proc/loadavg: 1.96 1.98 1.99 3/177 6855
/proc/meminfo: memFree=28316572/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=80936 CPUtime=51.07 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 26885 0 0 0 5092 15 0 0 20 0 1 0 341598912 82878464 19453 33554432000 134512640 135840783 4290265744 4290265104 134551455 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 20234 19453 347 325 0 19170 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 80936

[startup+102.307 s]
/proc/loadavg: 1.98 1.98 1.99 3/178 6858
/proc/meminfo: memFree=28282144/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=109568 CPUtime=102.27 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 34054 0 0 0 10209 18 0 0 20 0 1 0 341598912 112197632 26622 33554432000 134512640 135840783 4290265744 4290265104 134550887 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 27392 26622 347 325 0 26328 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 109568

[startup+162.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 6859
/proc/meminfo: memFree=28261728/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=124544 CPUtime=162.21 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 37858 0 0 0 16201 20 0 0 20 0 1 0 341598912 127533056 30401 33554432000 134512640 135840783 4290265744 4290265104 134551116 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 31136 30401 347 325 0 30072 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 124544

[startup+222.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 6859
/proc/meminfo: memFree=28244092/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=137792 CPUtime=222.18 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 41159 0 0 0 22196 22 0 0 20 0 1 0 341598912 141099008 33688 33554432000 134512640 135840783 4290265744 4290265056 134551532 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 34448 33688 347 325 0 33384 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 137792

[startup+282.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 6859
/proc/meminfo: memFree=28230576/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=147604 CPUtime=282.17 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 43617 0 0 0 28192 25 0 0 20 0 1 0 341598912 151146496 36146 33554432000 134512640 135840783 4290265744 4290265104 134551455 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 36901 36146 347 325 0 35837 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 147604

[startup+342.3 s]
/proc/loadavg: 2.11 2.02 2.00 3/177 6859
/proc/meminfo: memFree=28217232/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=155956 CPUtime=342.16 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 45723 0 0 0 34190 26 0 0 20 0 1 0 341598912 159698944 38252 33554432000 134512640 135840783 4290265744 4290265104 134550972 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 38989 38252 347 325 0 37925 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 155956

[startup+402.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 6859
/proc/meminfo: memFree=28202692/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=164440 CPUtime=402.13 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 47836 0 0 0 40185 28 0 0 20 0 1 0 341598912 168386560 40349 33554432000 134512640 135840783 4290265744 4290265104 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 41110 40349 347 325 0 40046 0
Current children cumulated CPU time (s) 402.13
Current children cumulated vsize (KiB) 164440

[startup+462.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 6860
/proc/meminfo: memFree=28189916/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=171464 CPUtime=462.12 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 49626 0 0 0 46183 29 0 0 20 0 1 0 341598912 175579136 42137 33554432000 134512640 135840783 4290265744 4290265104 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 42866 42137 347 325 0 41802 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 171464

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 6861
/proc/meminfo: memFree=28178996/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=177300 CPUtime=522.12 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 51080 0 0 0 52181 31 0 0 20 0 1 0 341598912 181555200 43591 33554432000 134512640 135840783 4290265744 4290265104 134551093 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 44325 43591 347 325 0 43261 0
Current children cumulated CPU time (s) 522.12
Current children cumulated vsize (KiB) 177300

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6861
/proc/meminfo: memFree=28164908/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=183660 CPUtime=582.11 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 52663 0 0 0 58179 32 0 0 20 0 1 0 341598912 188067840 45174 33554432000 134512640 135840783 4290265744 4290265104 134551400 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 45915 45174 347 325 0 44851 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 183660

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 6865
/proc/meminfo: memFree=28107016/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=210436 CPUtime=882.05 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 59375 0 0 0 88169 36 0 0 20 0 1 0 341598912 215486464 51873 33554432000 134512640 135840783 4290265744 4290265104 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 52609 51873 347 325 0 51545 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 210436

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6865
/proc/meminfo: memFree=28083496/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=216132 CPUtime=942.03 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 60803 0 0 0 94166 37 0 0 20 0 1 0 341598912 221319168 53290 33554432000 134512640 135840783 4290265744 4290265104 134550988 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 54033 53290 347 325 0 52969 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 216132

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6865
/proc/meminfo: memFree=28028748/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=221300 CPUtime=1002.02 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 62078 0 0 0 100164 38 0 0 20 0 1 0 341598912 226611200 54564 33554432000 134512640 135840783 4290265744 4290265104 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 55325 54564 347 325 0 54261 0
Current children cumulated CPU time (s) 1002.02
Current children cumulated vsize (KiB) 221300

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6866
/proc/meminfo: memFree=28003204/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=227000 CPUtime=1062.01 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 63534 0 0 0 106162 39 0 0 20 0 1 0 341598912 232448000 56020 33554432000 134512640 135840783 4290265744 4290265104 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 56750 56020 347 325 0 55686 0
Current children cumulated CPU time (s) 1062.01
Current children cumulated vsize (KiB) 227000

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6866
/proc/meminfo: memFree=27959008/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=231772 CPUtime=1122 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 64708 0 0 0 112160 40 0 0 20 0 1 0 341598912 237334528 57194 33554432000 134512640 135840783 4290265744 4290265104 134551501 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 57943 57194 347 325 0 56879 0
Current children cumulated CPU time (s) 1122
Current children cumulated vsize (KiB) 231772

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6866
/proc/meminfo: memFree=27885132/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=236144 CPUtime=1181.99 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 65819 0 0 0 118158 41 0 0 20 0 1 0 341598912 241811456 58305 33554432000 134512640 135840783 4290265744 4290265104 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 59036 58305 347 325 0 57972 0
Current children cumulated CPU time (s) 1181.99
Current children cumulated vsize (KiB) 236144

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6866
/proc/meminfo: memFree=27826384/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=240120 CPUtime=1241.98 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 66783 0 0 0 124156 42 0 0 20 0 1 0 341598912 245882880 59269 33554432000 134512640 135840783 4290265744 4290265104 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 60030 59269 347 325 0 58966 0
Current children cumulated CPU time (s) 1241.98
Current children cumulated vsize (KiB) 240120

[startup+1302.3 s]
/proc/loadavg: 2.10 2.03 2.01 3/178 6869
/proc/meminfo: memFree=27722064/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=294196 CPUtime=1301.98 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 80317 0 0 0 130151 47 0 0 20 0 1 0 341598912 301256704 72803 33554432000 134512640 135840783 4290265744 4290265104 134550808 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 73549 72803 347 325 0 72485 0
Current children cumulated CPU time (s) 1301.98
Current children cumulated vsize (KiB) 294196

[startup+1362.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 6870
/proc/meminfo: memFree=27611216/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=353836 CPUtime=1361.96 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 95228 0 0 0 136145 51 0 0 20 0 1 0 341598912 362328064 87714 33554432000 134512640 135840783 4290265744 4290265104 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 88459 87714 347 325 0 87395 0
Current children cumulated CPU time (s) 1361.96
Current children cumulated vsize (KiB) 353836

[startup+1422.31 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 6870
/proc/meminfo: memFree=27498520/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=424112 CPUtime=1421.93 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 112815 0 0 0 142139 54 0 0 20 0 1 0 341598912 434290688 105281 33554432000 134512640 135840783 4290265744 4290265056 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 106028 105281 347 325 0 104964 0
Current children cumulated CPU time (s) 1421.93
Current children cumulated vsize (KiB) 424112

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 6870
/proc/meminfo: memFree=27460604/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=427692 CPUtime=1481.88 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 113747 0 0 0 148133 55 0 0 20 0 1 0 341598912 437956608 106171 33554432000 134512640 135840783 4290265744 4290265104 134551330 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 106923 106171 347 325 0 105859 0
Current children cumulated CPU time (s) 1481.88
Current children cumulated vsize (KiB) 427692

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6870
/proc/meminfo: memFree=27422092/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=431668 CPUtime=1541.85 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 114791 0 0 0 154129 56 0 0 20 0 1 0 341598912 442028032 107191 33554432000 134512640 135840783 4290265744 4290265104 134551084 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 107917 107191 347 325 0 106853 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 431668

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6909
/proc/meminfo: memFree=28027180/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=436176 CPUtime=1601.84 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 115910 0 0 0 160127 57 0 0 20 0 1 0 341598912 446644224 108310 33554432000 134512640 135840783 4290265744 4290265048 1988816 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 109044 108310 347 325 0 107980 0
Current children cumulated CPU time (s) 1601.84
Current children cumulated vsize (KiB) 436176

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6910
/proc/meminfo: memFree=27971008/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=440284 CPUtime=1661.84 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 116924 0 0 0 166125 59 0 0 20 0 1 0 341598912 450850816 109324 33554432000 134512640 135840783 4290265744 4290265104 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 110071 109324 347 325 0 109007 0
Current children cumulated CPU time (s) 1661.84
Current children cumulated vsize (KiB) 440284

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6910
/proc/meminfo: memFree=27946828/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=443996 CPUtime=1721.83 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 117873 0 0 0 172124 59 0 0 20 0 1 0 341598912 454651904 110273 33554432000 134512640 135840783 4290265744 4290265104 134550933 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 110999 110273 347 325 0 109935 0
Current children cumulated CPU time (s) 1721.83
Current children cumulated vsize (KiB) 443996

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6910
/proc/meminfo: memFree=27932816/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=447972 CPUtime=1781.82 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 118858 0 0 0 178122 60 0 0 20 0 1 0 341598912 458723328 111258 33554432000 134512640 135840783 4290265744 4290265056 134551052 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 111993 111258 347 325 0 110929 0
Current children cumulated CPU time (s) 1781.82
Current children cumulated vsize (KiB) 447972



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6910
/proc/meminfo: memFree=27929716/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=449032 CPUtime=1800.03 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 119121 0 0 0 179942 61 0 0 20 0 1 0 341598912 459808768 111521 33554432000 134512640 135840783 4290265744 4290264980 5996573 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 112258 111521 347 325 0 111194 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 449032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 6910
/proc/meminfo: memFree=27929716/32873844 swapFree=7112/7112
[pid=6854] ppid=6852 vsize=449032 CPUtime=1800.03 cores=0,2,4,6
/proc/6854/stat : 6854 (bsolo3.0.17) R 6852 6854 5948 0 -1 4202496 119121 0 0 0 179942 61 0 0 20 0 1 0 341598912 459808768 111521 33554432000 134512640 135840783 4290265744 4290264980 5996573 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/6854/statm: 112258 111521 347 325 0 111194 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 449032

Child status: 15
Real time (s): 1800.51
CPU time (s): 1800.04
CPU user time (s): 1799.42
CPU system time (s): 0.613906
CPU usage (%): 99.9738
Max. virtual memory (cumulated for all children) (KiB): 449032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.42
system time used= 0.613906
maximum resident set size= 446084
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 119124
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 203
involuntary context switches= 2051

runsolver used 3.51147 second user time and 9.06562 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-03 22:18:52
IDJOB=3740998
IDBENCH=89728
IDSOLVER=2318
FILE ID=node119/3740998-1338754732
RUNJOBID= node119-1338748763-5964
PBS_JOBID= 14636790
Free space on /tmp= 70872 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-76.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3740998-1338754732/watcher-3740998-1338754732 -o /tmp/evaluation-result-3740998-1338754732/solver-3740998-1338754732 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3740998-1338754732.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f030651c159d27eae553d070b0927366
RANDOM SEED=1706084187

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28402684 kB
Buffers:          411804 kB
Cached:          3089180 kB
SwapCached:         1936 kB
Active:          1654028 kB
Inactive:        1987392 kB
Active(anon):     136012 kB
Inactive(anon):     6624 kB
Active(file):    1518016 kB
Inactive(file):  1980768 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:             18264 kB
Writeback:             8 kB
AnonPages:        145864 kB
Mapped:            13120 kB
Shmem:                 0 kB
Slab:             690832 kB
SReclaimable:     133004 kB
SUnreclaim:       557828 kB
KernelStack:        1472 kB
PageTables:         4452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     259088 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70864 MiB
End job on node119 at 2012-06-03 22:48:55