Trace number 3739714

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.03 1800.62

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j1206_8-unsat.opb
MD5SUMac6696aebedde13f32e972b28b72aa2c
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark20.4299
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables33396
Total number of constraints106278
Number of constraints which are clauses105730
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints548
Minimum length of a constraint1
Maximum length of a constraint70
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 17
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 384
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3739714-1338749451.opb
0.00/0.00	c File size is 3255316 bytes.
0.19/0.28	c Highest Coefficient sum: 384
0.19/0.28	c Parsing was ok!!
0.19/0.28	c Total parsing time: 0.282 s
0.29/0.31	c Var: 33396 Constr: 106278 105730/0/548 Lit: 259799 Watch. Lit: 241021
0.29/0.31	c Obj. Vars: 0 (0 % of total variables)
5.89/5.93	c Pre-processing Time: 5.934 s
5.89/5.94	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
5.89/5.94	c        0  16134    43295   111447    2   101660   50513      0      0 5.93
5.89/5.94	c Switching off LPR mode.
1800.00/1800.60	c      100  16134    43395   117324    2   103502   55565    100     16 6.05
1800.00/1800.60	c      251  16134    43546   126664    2   103885   61122    251     40 6.17
1800.00/1800.60	c      478  16134    43773   138463    3   104370   67235    478     75 6.35
1800.00/1800.60	c      816  16134    44111   172419    3   105044   73959    816    122 6.65
1800.00/1800.60	c     1324  16134    44619   203016    4   106093   81355   1324    187 7.06
1800.00/1800.60	c     2087  16134    45382   266466    5   107616   89491   2087    266 7.82
1800.00/1800.60	c     3234  16134    46529   378640    8   109883   98441   3234    365 8.86
1800.00/1800.60	c     4956  16134    48251   554346   11   113387  108286   4956    484 10.24
1800.00/1800.60	c     7541  16134    50836   852253   16   118532  119115   7541    582 12.94
1800.00/1800.60	c    11420  16134    54715  1303441   23   126276  131027  11420    657 17.37
1800.00/1800.60	c    17242  16134    60537  2005427   33   137943  144130  17242    683 25.22
1800.00/1800.60	c    25981  16134    69276  3519784   50   155434  158544  25981    620 41.85
1800.00/1800.60	c    39093  16134    82388  5962572   72   181646  174399  39093    548 71.26
1800.00/1800.60	c    58763  16134   102058 11196469  109   220965  191839  58763    450 130.46
1800.00/1800.60	c    88276  16134   131571 17443386  132   280006  211023  88276    353 249.47
1800.00/1800.60	c   132546  16134   175841 30972554  176   368536  232126 132546    260 508.47
1800.00/1800.60	c   198958  16123   242253 50371837  207   501336  255339 198958    176 1124.59
1800.00/1800.60	c Caught signal: 15
1800.00/1800.60	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.00/1800.60	c   17   262305  65717   417180   305600 68851523 262305    145 1800.02
1800.00/1800.60	s UNKNOWN
1800.00/1800.60	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739714-1338749451/watcher-3739714-1338749451 -o /tmp/evaluation-result-3739714-1338749451/solver-3739714-1338749451 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739714-1338749451.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.90 3/177 9534
/proc/meminfo: memFree=31262892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=7868 CPUtime=0 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 472 0 0 0 0 0 0 0 20 0 1 0 341073667 8056832 408 33554432000 134512640 135840783 4293423184 4293421856 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 1967 408 329 325 0 108 0

[startup+0.103322 s]
/proc/loadavg: 2.00 2.00 1.90 3/177 9534
/proc/meminfo: memFree=31262892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=13576 CPUtime=0.09 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 2188 0 0 0 9 0 0 0 20 0 1 0 341073667 13901824 2124 33554432000 134512640 135840783 4293423184 4293422016 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 3394 2125 629 325 0 1535 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13576

[startup+0.200286 s]
/proc/loadavg: 2.00 2.00 1.90 3/177 9534
/proc/meminfo: memFree=31262892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=18620 CPUtime=0.19 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 3756 0 0 0 19 0 0 0 20 0 1 0 341073667 19066880 3652 33554432000 134512640 135840783 4293423184 4293421872 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 4655 3653 919 325 0 2796 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 18620

[startup+0.300291 s]
/proc/loadavg: 2.00 2.00 1.90 3/177 9534
/proc/meminfo: memFree=31262892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=22692 CPUtime=0.29 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 5744 0 0 0 29 0 0 0 20 0 1 0 341073667 23236608 4845 33554432000 134512640 135840783 4293423184 4293422272 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 5673 4849 340 325 0 4609 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 22692

[startup+0.700235 s]
/proc/loadavg: 2.00 2.00 1.90 3/177 9534
/proc/meminfo: memFree=31262892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=26976 CPUtime=0.69 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 6773 0 0 0 69 0 0 0 20 0 1 0 341073667 27623424 5874 33554432000 134512640 135840783 4293423184 4293021408 134551776 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 6744 5874 344 325 0 5680 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 26976

[startup+1.50021 s]
/proc/loadavg: 2.00 2.00 1.90 3/178 9535
/proc/meminfo: memFree=31224908/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=26976 CPUtime=1.48 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 6776 0 0 0 148 0 0 0 20 0 1 0 341073667 27623424 5877 33554432000 134512640 135840783 4293423184 4293021408 134551359 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 6744 5877 344 325 0 5680 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 26976

[startup+3.10022 s]
/proc/loadavg: 2.00 2.00 1.90 3/178 9535
/proc/meminfo: memFree=31224504/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=26976 CPUtime=3.09 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 6803 0 0 0 308 1 0 0 20 0 1 0 341073667 27623424 5904 33554432000 134512640 135840783 4293423184 4293021548 2782256 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 6744 5904 344 325 0 5680 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 26976

[startup+6.30026 s]
/proc/loadavg: 2.00 2.00 1.90 3/178 9535
/proc/meminfo: memFree=31222776/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=27008 CPUtime=6.28 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 7279 0 0 0 626 2 0 0 20 0 1 0 341073667 27656192 5921 33554432000 134512640 135840783 4293423184 4293422544 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 6752 5921 349 325 0 5688 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 27008

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 1.91 3/177 9535
/proc/meminfo: memFree=31211960/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=28988 CPUtime=12.68 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 7762 0 0 0 1266 2 0 0 20 0 1 0 341073667 29683712 6404 33554432000 134512640 135840783 4293423184 4293419104 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 7247 6404 349 325 0 6183 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 28988

[startup+25.5004 s]
/proc/loadavg: 2.08 2.02 1.91 3/177 9535
/proc/meminfo: memFree=31178224/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=43648 CPUtime=25.49 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 11419 0 0 0 2545 4 0 0 20 0 1 0 341073667 44695552 10061 33554432000 134512640 135840783 4293423184 4293417648 3855655 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 10912 10061 349 325 0 9848 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 43648

[startup+51.1004 s]
/proc/loadavg: 2.05 2.01 1.91 3/177 9535
/proc/meminfo: memFree=31116672/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=72164 CPUtime=51.08 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 18562 0 0 0 5101 7 0 0 20 0 1 0 341073667 73895936 17204 33554432000 134512640 135840783 4293423184 4293422536 8607952 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 18041 17204 349 325 0 16977 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 72164

[startup+102.3 s]
/proc/loadavg: 2.02 2.01 1.91 3/177 9535
/proc/meminfo: memFree=31008216/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=137168 CPUtime=102.25 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 34850 0 0 0 10211 14 0 0 20 0 1 0 341073667 140460032 33464 33554432000 134512640 135840783 4293423184 4293422544 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 34292 33464 349 325 0 33228 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 137168

[startup+162.3 s]
/proc/loadavg: 2.04 2.02 1.92 3/177 9535
/proc/meminfo: memFree=30908424/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=200788 CPUtime=162.2 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 50810 0 0 0 16198 22 0 0 20 0 1 0 341073667 205606912 49376 33554432000 134512640 135840783 4293423184 4293422320 3853214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 50197 49376 349 325 0 49133 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 200788

[startup+222.307 s]
/proc/loadavg: 2.01 2.01 1.92 3/177 9535
/proc/meminfo: memFree=30865660/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=233724 CPUtime=222.17 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 59049 0 0 0 22192 25 0 0 20 0 1 0 341073667 239333376 57592 33554432000 134512640 135840783 4293423184 4293422544 134550884 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 58431 57592 349 325 0 57367 0
Current children cumulated CPU time (s) 222.17
Current children cumulated vsize (KiB) 233724

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 1.92 3/177 9536
/proc/meminfo: memFree=30827444/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=272156 CPUtime=282.15 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 68665 0 0 0 28186 29 0 0 20 0 1 0 341073667 278687744 67208 33554432000 134512640 135840783 4293423184 4293422544 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 68039 67208 349 325 0 66975 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 272156

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9536
/proc/meminfo: memFree=30788708/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=305556 CPUtime=342.14 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 77021 0 0 0 34181 33 0 0 20 0 1 0 341073667 312889344 75564 33554432000 134512640 135840783 4293423184 4293422544 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 76389 75564 349 325 0 75325 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 305556

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9536
/proc/meminfo: memFree=30734892/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=331356 CPUtime=402.13 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 83464 0 0 0 40175 38 0 0 20 0 1 0 341073667 339308544 82007 33554432000 134512640 135840783 4293423184 4293422544 134551116 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 82839 82007 349 325 0 81775 0
Current children cumulated CPU time (s) 402.13
Current children cumulated vsize (KiB) 331356

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9536
/proc/meminfo: memFree=30688040/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=378516 CPUtime=462.11 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 95274 0 0 0 46167 44 0 0 20 0 1 0 341073667 387600384 93796 33554432000 134512640 135840783 4293423184 4293422464 3857998 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 94629 93796 349 325 0 93565 0
Current children cumulated CPU time (s) 462.11
Current children cumulated vsize (KiB) 378516

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9536
/proc/meminfo: memFree=30638964/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=427260 CPUtime=522.06 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 107498 0 0 0 52157 49 0 0 20 0 1 0 341073667 437514240 105972 33554432000 134512640 135840783 4293423184 4293422544 134551081 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 106815 105972 349 325 0 105751 0
Current children cumulated CPU time (s) 522.06
Current children cumulated vsize (KiB) 427260

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/178 9540
/proc/meminfo: memFree=30613256/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=452540 CPUtime=582 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 113886 0 0 0 58147 53 0 0 20 0 1 0 341073667 463400960 112313 33554432000 134512640 135840783 4293423184 4293422544 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 113135 112313 349 325 0 112071 0
Current children cumulated CPU time (s) 582
Current children cumulated vsize (KiB) 452540

[startup+642.3 s]

################
# More data... #
################

[startup+882.307 s]
/proc/loadavg: 2.01 2.01 1.92 3/177 9564
/proc/meminfo: memFree=30449040/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=570704 CPUtime=881.96 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 143399 0 0 0 88129 67 0 0 20 0 1 0 341073667 584400896 141826 33554432000 134512640 135840783 4293423184 4293422544 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 142676 141826 349 325 0 141612 0
Current children cumulated CPU time (s) 881.96
Current children cumulated vsize (KiB) 570704

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9564
/proc/meminfo: memFree=30388280/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=600872 CPUtime=941.94 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 150948 0 0 0 94124 70 0 0 20 0 1 0 341073667 615292928 149375 33554432000 134512640 135840783 4293423184 4293422496 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 150218 149375 349 325 0 149154 0
Current children cumulated CPU time (s) 941.94
Current children cumulated vsize (KiB) 600872

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9564
/proc/meminfo: memFree=30349716/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=636100 CPUtime=1001.94 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 159771 0 0 0 100120 74 0 0 20 0 1 0 341073667 651366400 158198 33554432000 134512640 135840783 4293423184 4293422420 3850269 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 159025 158198 349 325 0 157961 0
Current children cumulated CPU time (s) 1001.94
Current children cumulated vsize (KiB) 636100

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9564
/proc/meminfo: memFree=30329848/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=656516 CPUtime=1061.89 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 164907 0 0 0 106111 78 0 0 20 0 1 0 341073667 672272384 163289 33554432000 134512640 135840783 4293423184 4293422544 134550782 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 164129 163289 349 325 0 163065 0
Current children cumulated CPU time (s) 1061.89
Current children cumulated vsize (KiB) 656516

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9564
/proc/meminfo: memFree=30308920/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=677160 CPUtime=1121.85 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 170122 0 0 0 112104 81 0 0 20 0 1 0 341073667 693411840 168456 33554432000 134512640 135840783 4293423184 4293422544 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 169290 168456 349 325 0 168226 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 677160

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/178 9568
/proc/meminfo: memFree=30288160/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=697564 CPUtime=1181.82 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 175255 0 0 0 118099 83 0 0 20 0 1 0 341073667 714305536 173567 33554432000 134512640 135840783 4293423184 4293422480 134572295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 174391 173567 349 325 0 173327 0
Current children cumulated CPU time (s) 1181.82
Current children cumulated vsize (KiB) 697564

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 9568
/proc/meminfo: memFree=30263368/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=721944 CPUtime=1241.8 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 181338 0 0 0 124094 86 0 0 20 0 1 0 341073667 739270656 179650 33554432000 134512640 135840783 4293423184 4293422544 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 180486 179650 349 325 0 179422 0
Current children cumulated CPU time (s) 1241.8
Current children cumulated vsize (KiB) 721944

[startup+1302.3 s]
/proc/loadavg: 2.04 2.01 1.93 3/177 9568
/proc/meminfo: memFree=30221208/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=741580 CPUtime=1301.79 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 186239 0 0 0 130091 88 0 0 20 0 1 0 341073667 759377920 184551 33554432000 134512640 135840783 4293423184 4293422544 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 185395 184551 349 325 0 184331 0
Current children cumulated CPU time (s) 1301.79
Current children cumulated vsize (KiB) 741580

[startup+1362.3 s]
/proc/loadavg: 2.01 2.01 1.93 3/177 9568
/proc/meminfo: memFree=30187204/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=759720 CPUtime=1361.78 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 190769 0 0 0 136088 90 0 0 20 0 1 0 341073667 777953280 189081 33554432000 134512640 135840783 4293423184 4293422544 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 189930 189081 349 325 0 188866 0
Current children cumulated CPU time (s) 1361.78
Current children cumulated vsize (KiB) 759720

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 9568
/proc/meminfo: memFree=30166928/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=780024 CPUtime=1421.79 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 195858 0 0 0 142086 93 0 0 20 0 1 0 341073667 798744576 194170 33554432000 134512640 135840783 4293423184 4293422532 9003661 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 195006 194170 349 325 0 193942 0
Current children cumulated CPU time (s) 1421.79
Current children cumulated vsize (KiB) 780024

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 9569
/proc/meminfo: memFree=30143616/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=803296 CPUtime=1481.77 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 201662 0 0 0 148081 96 0 0 20 0 1 0 341073667 822575104 199974 33554432000 134512640 135840783 4293423184 4293422544 134551179 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 200824 199974 349 325 0 199760 0
Current children cumulated CPU time (s) 1481.77
Current children cumulated vsize (KiB) 803296

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 9569
/proc/meminfo: memFree=30120056/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=826728 CPUtime=1541.77 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 207523 0 0 0 154078 99 0 0 20 0 1 0 341073667 846569472 205835 33554432000 134512640 135840783 4293423184 4293422544 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 206682 205835 349 325 0 205618 0
Current children cumulated CPU time (s) 1541.77
Current children cumulated vsize (KiB) 826728

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 9569
/proc/meminfo: memFree=30094264/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=852424 CPUtime=1601.75 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 213971 0 0 0 160073 102 0 0 20 0 1 0 341073667 872882176 212283 33554432000 134512640 135840783 4293423184 4293422512 8994796 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 213106 212283 349 325 0 212042 0
Current children cumulated CPU time (s) 1601.75
Current children cumulated vsize (KiB) 852424

[startup+1662.3 s]
/proc/loadavg: 2.04 2.01 1.93 3/177 9569
/proc/meminfo: memFree=30076904/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=870324 CPUtime=1661.74 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 218422 0 0 0 166069 105 0 0 20 0 1 0 341073667 891211776 216734 33554432000 134512640 135840783 4293423184 4293422536 8607916 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 217581 216734 349 325 0 216517 0
Current children cumulated CPU time (s) 1661.74
Current children cumulated vsize (KiB) 870324

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 1.93 3/177 9569
/proc/meminfo: memFree=30053840/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=893452 CPUtime=1721.73 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 224224 0 0 0 172066 107 0 0 20 0 1 0 341073667 914894848 222536 33554432000 134512640 135840783 4293423184 4293422544 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 223363 222536 349 325 0 222299 0
Current children cumulated CPU time (s) 1721.73
Current children cumulated vsize (KiB) 893452

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/178 9573
/proc/meminfo: memFree=30027844/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=914912 CPUtime=1781.72 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 229591 0 0 0 178062 110 0 0 20 0 1 0 341073667 936869888 227898 33554432000 134512640 135840783 4293423184 4293422484 3861067 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 228728 227898 349 325 0 227664 0
Current children cumulated CPU time (s) 1781.72
Current children cumulated vsize (KiB) 914912



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.93 2/176 9574
/proc/meminfo: memFree=30345684/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=919952 CPUtime=1800 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 230872 0 0 0 179890 110 0 0 20 0 1 0 341073667 942030848 229163 33554432000 134512640 135840783 4293423184 4293422544 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 229988 229163 349 325 0 228924 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 919952

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.93 2/176 9574
/proc/meminfo: memFree=30345684/32873844 swapFree=8656/8656
[pid=9534] ppid=9532 vsize=919952 CPUtime=1800 cores=1,3,5,7
/proc/9534/stat : 9534 (bsolo3.0.17) R 9532 9534 9396 0 -1 4202496 230872 0 0 0 179890 110 0 0 20 0 1 0 341073667 942030848 229163 33554432000 134512640 135840783 4293423184 4293422544 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/9534/statm: 229988 229163 349 325 0 228924 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 919952

Child status: 15
Real time (s): 1800.62
CPU time (s): 1800.03
CPU user time (s): 1798.91
CPU system time (s): 1.12683
CPU usage (%): 99.9673
Max. virtual memory (cumulated for all children) (KiB): 919952

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.91
system time used= 1.12683
maximum resident set size= 916652
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 230875
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 358
involuntary context switches= 1841

runsolver used 3.85041 second user time and 10.0845 second system time

The end

Launcher Data 

Begin job on node102 at 2012-06-03 20:50:51
IDJOB=3739714
IDBENCH=74295
IDSOLVER=2318
FILE ID=node102/3739714-1338749451
RUNJOBID= node102-1338747648-9413
PBS_JOBID= 14636781
Free space on /tmp= 71164 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j1206_8-unsat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739714-1338749451/watcher-3739714-1338749451 -o /tmp/evaluation-result-3739714-1338749451/solver-3739714-1338749451 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739714-1338749451.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac6696aebedde13f32e972b28b72aa2c
RANDOM SEED=180663280

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31264016 kB
Buffers:          193976 kB
Cached:           644068 kB
SwapCached:         5520 kB
Active:           224672 kB
Inactive:         622532 kB
Active(anon):       5360 kB
Inactive(anon):     5604 kB
Active(file):     219312 kB
Inactive(file):   616928 kB
Unevictable:        8656 kB
Mlocked:            8656 kB
SwapTotal:      67108856 kB
SwapFree:       67097276 kB
Dirty:             18664 kB
Writeback:             0 kB
AnonPages:         11868 kB
Mapped:            10112 kB
Shmem:                 0 kB
Slab:             619496 kB
SReclaimable:      60596 kB
SUnreclaim:       558900 kB
KernelStack:        1464 kB
PageTables:         4196 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     126572 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71164 MiB
End job on node102 at 2012-06-03 21:20:54