Trace number 3737917

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.11 1800.62

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_200_25_2_40.opb
MD5SUMff64c7b9cef588c95a335f732f2d905b
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400
Total number of constraints602
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints401
Minimum length of a constraint2
Maximum length of a constraint400
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 400
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)12440
Sum of products size (including duplicates)24880
Number of different products6220
Sum of products size12440

Solver Data 

0.00/0.01	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.01	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.01	c type "bsolo -h" for help
0.00/0.01	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.01	c Memory Limit set to 15500 MB
0.00/0.01	c Instance file HOME/instance-3737917-1338730075.opb
0.00/0.01	c File size is 166857 bytes.
0.00/0.04	c Highest Coefficient sum: 400
0.00/0.04	c Parsing was ok!!
0.00/0.04	c Total parsing time: 0.032 s
0.00/0.05	c Var: 12840 Constr: 25483 12640/403/12440 Lit: 88480 Watch. Lit: 75483
0.00/0.05	c Obj. Vars: 0 (0 % of total variables)
18.08/18.12	c Pre-processing Time: 18.107 s
18.08/18.12	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
18.08/18.12	c        0  12840    25483    88480    3    75483  209763      0      0 18.11
18.08/18.12	c Switching off LPR mode.
1800.10/1800.61	c      121  12840    25604   124620    4    75725  230740    121      6 18.19
1800.10/1800.61	c      316  12840    25799   177335    6    76115  253815    316     17 18.44
1800.10/1800.61	c      550  12840    26033   259652    9    76583  279197    550     29 18.52
1800.10/1800.61	c      909  12840    26392   383956   14    77301  307117    909     48 18.72
1800.10/1800.61	c     1435  12840    26918   562308   20    78353  337829   1435     74 19.19
1800.10/1800.61	c     2203  12840    27686   825736   29    79889  371612   2203    109 20.19
1800.10/1800.61	c     3357  12840    28840  1231172   42    82197  408774   3357    157 21.38
1800.10/1800.61	c     5080  12840    30563  1844919   60    85643  449652   5080    224 22.62
1800.10/1800.61	c     7666  12840    33149  2648378   79    90815  494618   7666    308 24.84
1800.10/1800.61	c    11549  12840    37032  3835508  103    98581  544080  11549    378 30.47
1800.10/1800.61	c    17372  12840    42855  5707729  133   110227  598489  17372    376 46.13
1800.10/1800.61	c    26111  12840    51594  8372396  162   127705  658338  26111    390 66.81
1800.10/1800.61	c    39223  12840    64706 12500749  193   153929  724172  39223    278 140.98
1800.10/1800.61	c    58894  12840    84377 19175988  227   193271  796590  58894    256 229.87
1800.10/1800.61	c    88405  12840   113888 29082023  255   252293  876250  88405    201 439.34
1800.10/1800.61	c   132676  12840   158159 43442194  274   340835  963876 132676    133 990.77
1800.10/1800.61	c Caught signal: 15
1800.10/1800.61	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.10/1800.61	c   16   170770  21433   269958   196253 56567794 170770     94 1800.11
1800.10/1800.61	s UNKNOWN
1800.10/1800.61	c Total time: 1800.11 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737917-1338730075/watcher-3737917-1338730075 -o /tmp/evaluation-result-3737917-1338730075/solver-3737917-1338730075 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3737917-1338730075.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 19695
/proc/meminfo: memFree=29987284/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11812 CPUtime=0 cores=0,2,4,6
/proc/19695/stat : 19695 (runsolver) D 19693 19695 18429 0 -1 4202560 41 0 0 0 0 0 0 0 20 0 1 0 339133351 12095488 50 33554432000 4194304 5436572 140734752541296 140734752537592 4883175 0 0 4096 24578 18446744071579943789 0 0 17 2 0 0 0 0 0
/proc/19695/statm: 2953 50 31 304 0 2645 0

[startup+0.0653329 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 19695
/proc/meminfo: memFree=29987284/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=0.05 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2188 0 0 0 5 0 0 0 20 0 1 0 339133351 11628544 2083 33554432000 134512640 135840783 4293788608 4293633504 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2083 343 325 0 1775 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 11356

[startup+0.100257 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 19695
/proc/meminfo: memFree=29987284/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=0.08 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2190 0 0 0 8 0 0 0 20 0 1 0 339133351 11628544 2085 33554432000 134512640 135840783 4293788608 4293633504 134551715 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2085 343 325 0 1775 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 11356

[startup+0.300192 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 19695
/proc/meminfo: memFree=29987284/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=0.28 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 28 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633504 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 11356

[startup+0.700236 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 19695
/proc/meminfo: memFree=29987284/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=0.68 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 68 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633504 134551175 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 11356

[startup+1.50024 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29979960/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=1.48 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 148 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633616 134583111 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 11356

[startup+3.10105 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29979324/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=3.08 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 308 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633644 10822704 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 11356

[startup+6.30105 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29978952/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=6.28 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 628 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633644 10822704 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 11356

[startup+12.7002 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29976528/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=11356 CPUtime=12.68 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 2191 0 0 0 1268 0 0 0 20 0 1 0 339133351 11628544 2086 33554432000 134512640 135840783 4293788608 4293633172 6316284 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 2839 2086 343 325 0 1775 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 11356

[startup+25.5011 s]
/proc/loadavg: 1.95 1.98 1.99 3/177 19735
/proc/meminfo: memFree=30431848/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=46636 CPUtime=25.47 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 11427 0 0 0 2544 3 0 0 20 0 1 0 339133351 47755264 10929 33554432000 134512640 135840783 4293788608 4293787968 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 11659 10929 347 325 0 10595 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 46636

[startup+51.1003 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 19735
/proc/meminfo: memFree=30384532/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=94204 CPUtime=51.06 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 23340 0 0 0 5099 7 0 0 20 0 1 0 339133351 96464896 22826 33554432000 134512640 135840783 4293788608 4293783136 6329639 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 23551 22826 347 325 0 22487 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 94204

[startup+102.307 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 19736
/proc/meminfo: memFree=30327412/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=149300 CPUtime=102.23 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 37137 0 0 0 10212 11 0 0 20 0 1 0 339133351 152883200 36583 33554432000 134512640 135840783 4293788608 4293787968 134551104 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 37325 36583 347 325 0 36261 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 149300

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19739
/proc/meminfo: memFree=30279908/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=198448 CPUtime=162.2 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 49434 0 0 0 16202 18 0 0 20 0 1 0 339133351 203210752 48859 33554432000 134512640 135840783 4293788608 4293787968 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 49612 48859 347 325 0 48548 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 198448

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19739
/proc/meminfo: memFree=30209928/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=252220 CPUtime=222.19 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 62889 0 0 0 22196 23 0 0 20 0 1 0 339133351 258273280 62314 33554432000 134512640 135840783 4293788608 4293787968 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 63055 62315 347 325 0 61991 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 252220

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19739
/proc/meminfo: memFree=30065080/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=294760 CPUtime=282.18 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 73531 0 0 0 28191 27 0 0 20 0 1 0 339133351 301834240 72949 33554432000 134512640 135840783 4293788608 4293787920 134550878 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 73690 72949 347 325 0 72626 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 294760

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19739
/proc/meminfo: memFree=29973480/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=340344 CPUtime=342.14 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 84973 0 0 0 34183 31 0 0 20 0 1 0 339133351 348512256 84344 33554432000 134512640 135840783 4293788608 4293787968 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 85086 84344 347 325 0 84022 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 340344

[startup+402.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19740
/proc/meminfo: memFree=29913812/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=370996 CPUtime=402.1 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 92671 0 0 0 40176 34 0 0 20 0 1 0 339133351 379899904 92002 33554432000 134512640 135840783 4293788608 4293787968 134550916 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 92749 92002 347 325 0 91685 0
Current children cumulated CPU time (s) 402.1
Current children cumulated vsize (KiB) 370996

[startup+462.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 19740
/proc/meminfo: memFree=29853596/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=406800 CPUtime=462.09 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 101616 0 0 0 46171 38 0 0 20 0 1 0 339133351 416563200 100947 33554432000 134512640 135840783 4293788608 4293787920 134551052 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 101700 100947 347 325 0 100636 0
Current children cumulated CPU time (s) 462.09
Current children cumulated vsize (KiB) 406800

[startup+522.301 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 19740
/proc/meminfo: memFree=29791000/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=438376 CPUtime=522.08 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 109506 0 0 0 52167 41 0 0 20 0 1 0 339133351 448897024 108837 33554432000 134512640 135840783 4293788608 4293787968 134551175 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 109594 108837 347 325 0 108530 0
Current children cumulated CPU time (s) 522.08
Current children cumulated vsize (KiB) 438376

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19740
/proc/meminfo: memFree=29733812/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=467972 CPUtime=582.07 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 116933 0 0 0 58162 45 0 0 20 0 1 0 339133351 479203328 116264 33554432000 134512640 135840783 4293788608 4293787968 134551312 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 116993 116264 347 325 0 115929 0
Current children cumulated CPU time (s) 582.07
Current children cumulated vsize (KiB) 467972

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19744
/proc/meminfo: memFree=29601968/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=539316 CPUtime=822.04 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 134742 0 0 0 82149 55 0 0 20 0 1 0 339133351 552259584 134073 33554432000 134512640 135840783 4293788608 4293787968 134551175 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 134829 134073 347 325 0 133765 0
Current children cumulated CPU time (s) 822.04
Current children cumulated vsize (KiB) 539316

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19744
/proc/meminfo: memFree=29572868/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=554776 CPUtime=881.99 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 138666 0 0 0 88143 56 0 0 20 0 1 0 339133351 568090624 137955 33554432000 134512640 135840783 4293788608 4293787920 134551071 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 138694 137955 347 325 0 137630 0
Current children cumulated CPU time (s) 881.99
Current children cumulated vsize (KiB) 554776

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19744
/proc/meminfo: memFree=29552188/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=564552 CPUtime=941.96 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 141147 0 0 0 94139 57 0 0 20 0 1 0 339133351 578101248 140388 33554432000 134512640 135840783 4293788608 4293787968 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 141138 140388 347 325 0 140074 0
Current children cumulated CPU time (s) 941.96
Current children cumulated vsize (KiB) 564552

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19745
/proc/meminfo: memFree=29518200/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=579480 CPUtime=1001.95 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 144894 0 0 0 100136 59 0 0 20 0 1 0 339133351 593387520 144129 33554432000 134512640 135840783 4293788608 4293787920 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 144870 144129 347 325 0 143806 0
Current children cumulated CPU time (s) 1001.95
Current children cumulated vsize (KiB) 579480

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19745
/proc/meminfo: memFree=29483976/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=600620 CPUtime=1061.94 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 150183 0 0 0 106133 61 0 0 20 0 1 0 339133351 615034880 149418 33554432000 134512640 135840783 4293788608 4293787920 134550913 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 150155 149418 347 325 0 149091 0
Current children cumulated CPU time (s) 1061.94
Current children cumulated vsize (KiB) 600620

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19745
/proc/meminfo: memFree=29462404/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=613040 CPUtime=1121.93 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 153281 0 0 0 112130 63 0 0 20 0 1 0 339133351 627752960 152516 33554432000 134512640 135840783 4293788608 4293787920 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 153260 152516 347 325 0 152196 0
Current children cumulated CPU time (s) 1121.93
Current children cumulated vsize (KiB) 613040

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19745
/proc/meminfo: memFree=29438764/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=629684 CPUtime=1181.92 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 157461 0 0 0 118127 65 0 0 20 0 1 0 339133351 644796416 156696 33554432000 134512640 135840783 4293788608 4293787968 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 157421 156696 347 325 0 156357 0
Current children cumulated CPU time (s) 1181.92
Current children cumulated vsize (KiB) 629684

[startup+1242.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 19745
/proc/meminfo: memFree=29414336/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=644348 CPUtime=1241.91 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 161118 0 0 0 124124 67 0 0 20 0 1 0 339133351 659812352 160353 33554432000 134512640 135840783 4293788608 4293787968 134551428 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 161087 160353 347 325 0 160023 0
Current children cumulated CPU time (s) 1241.91
Current children cumulated vsize (KiB) 644348

[startup+1302.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 19746
/proc/meminfo: memFree=29398648/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=652540 CPUtime=1301.91 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 163158 0 0 0 130123 68 0 0 20 0 1 0 339133351 668200960 162393 33554432000 134512640 135840783 4293788608 4293787968 134550872 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 163135 162393 347 325 0 162071 0
Current children cumulated CPU time (s) 1301.91
Current children cumulated vsize (KiB) 652540

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19749
/proc/meminfo: memFree=29385768/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=659940 CPUtime=1361.9 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 165023 0 0 0 136121 69 0 0 20 0 1 0 339133351 675778560 164258 33554432000 134512640 135840783 4293788608 4293787968 134551501 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 164985 164258 347 325 0 163921 0
Current children cumulated CPU time (s) 1361.9
Current children cumulated vsize (KiB) 659940

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19749
/proc/meminfo: memFree=29367796/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=668528 CPUtime=1421.89 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 167164 0 0 0 142119 70 0 0 20 0 1 0 339133351 684572672 166399 33554432000 134512640 135840783 4293788608 4293783264 6329639 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 167132 166399 347 325 0 166068 0
Current children cumulated CPU time (s) 1421.89
Current children cumulated vsize (KiB) 668528

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19749
/proc/meminfo: memFree=29339276/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=680944 CPUtime=1481.88 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 170261 0 0 0 148117 71 0 0 20 0 1 0 339133351 697286656 169496 33554432000 134512640 135840783 4293788608 4293787968 134551175 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 170236 169496 347 325 0 169172 0
Current children cumulated CPU time (s) 1481.88
Current children cumulated vsize (KiB) 680944

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19749
/proc/meminfo: memFree=29309148/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=694552 CPUtime=1541.87 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 173649 0 0 0 154114 73 0 0 20 0 1 0 339133351 711221248 172884 33554432000 134512640 135840783 4293788608 4293787968 134551186 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 173638 172884 347 325 0 172574 0
Current children cumulated CPU time (s) 1541.87
Current children cumulated vsize (KiB) 694552

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19750
/proc/meminfo: memFree=29281476/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=706840 CPUtime=1601.85 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 176745 0 0 0 160112 73 0 0 20 0 1 0 339133351 723804160 175971 33554432000 134512640 135840783 4293788608 4293787968 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 176710 175971 347 325 0 175646 0
Current children cumulated CPU time (s) 1601.85
Current children cumulated vsize (KiB) 706840

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19750
/proc/meminfo: memFree=29250380/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=721240 CPUtime=1661.82 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 180399 0 0 0 166106 76 0 0 20 0 1 0 339133351 738549760 179585 33554432000 134512640 135840783 4293788608 4293787968 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 180310 179585 347 325 0 179246 0
Current children cumulated CPU time (s) 1661.82
Current children cumulated vsize (KiB) 721240

[startup+1722.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 19750
/proc/meminfo: memFree=29223492/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=734716 CPUtime=1721.8 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 183765 0 0 0 172102 78 0 0 20 0 1 0 339133351 752349184 182931 33554432000 134512640 135840783 4293788608 4293787920 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 183679 182931 347 325 0 182615 0
Current children cumulated CPU time (s) 1721.8
Current children cumulated vsize (KiB) 734716

[startup+1782.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 19750
/proc/meminfo: memFree=29203528/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=745684 CPUtime=1781.78 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 186522 0 0 0 178099 79 0 0 20 0 1 0 339133351 763580416 185688 33554432000 134512640 135840783 4293788608 4293787968 134551071 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 186421 185688 347 325 0 185357 0
Current children cumulated CPU time (s) 1781.78
Current children cumulated vsize (KiB) 745684



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 19750
/proc/meminfo: memFree=29198072/32873648 swapFree=6860/6860
[pid=19695] ppid=19693 vsize=748588 CPUtime=1800.1 cores=0,2,4,6
/proc/19695/stat : 19695 (bsolo3.0.17) R 19693 19695 18429 0 -1 4202496 187227 0 0 0 179930 80 0 0 20 0 1 0 339133351 766554112 186393 33554432000 134512640 135840783 4293788608 4293787920 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/19695/statm: 187147 186393 347 325 0 186083 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 748588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.62
CPU time (s): 1800.11
CPU user time (s): 1799.3
CPU system time (s): 0.807877
CPU usage (%): 99.9719
Max. virtual memory (cumulated for all children) (KiB): 748588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.3
system time used= 0.807877
maximum resident set size= 745572
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 187230
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 357
involuntary context switches= 1859

runsolver used 3.35049 second user time and 9.30659 second system time

The end

Launcher Data 

Begin job on node124 at 2012-06-03 15:27:55
IDJOB=3737917
IDBENCH=48359
IDSOLVER=2318
FILE ID=node124/3737917-1338730075
RUNJOBID= node124-1338713740-18445
PBS_JOBID= 14636741
Free space on /tmp= 70704 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_200_25_2_40.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737917-1338730075/watcher-3737917-1338730075 -o /tmp/evaluation-result-3737917-1338730075/solver-3737917-1338730075 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3737917-1338730075.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff64c7b9cef588c95a335f732f2d905b
RANDOM SEED=228259835

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5357.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29987292 kB
Buffers:          200688 kB
Cached:          1377660 kB
SwapCached:         8268 kB
Active:           935096 kB
Inactive:        1183536 kB
Active(anon):     534284 kB
Inactive(anon):     8240 kB
Active(file):     400812 kB
Inactive(file):  1175296 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67091596 kB
Dirty:              6616 kB
Writeback:             0 kB
AnonPages:        539240 kB
Mapped:            10360 kB
Shmem:                 0 kB
Slab:             629836 kB
SReclaimable:      74428 kB
SUnreclaim:       555408 kB
KernelStack:        1464 kB
PageTables:         4776 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     655072 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    516096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70696 MiB
End job on node124 at 2012-06-03 15:57:57