Trace number 3739558

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.12 1800.66

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12046_2-sat.opb
MD5SUM8df6acf86997549eac6f2a4fde05a479
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables48158
Total number of constraints168360
Number of constraints which are clauses167568
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints792
Minimum length of a constraint1
Maximum length of a constraint67
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 15
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 432
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3739558-1338748317.opb
0.00/0.00	c File size is 5143884 bytes.
0.48/0.52	c Highest Coefficient sum: 432
0.48/0.52	c Parsing was ok!!
0.48/0.52	c Total parsing time: 0.517 s
0.48/0.56	c Var: 48158 Constr: 168360 167568/0/792 Lit: 405356 Watch. Lit: 379020
0.48/0.56	c Obj. Vars: 0 (0 % of total variables)
26.47/26.56	c Pre-processing Time: 26.546 s
26.47/26.56	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
26.47/26.56	c        0  22635    68694   172762    2   159775   74412      0      0 26.55
26.47/26.56	c Switching off LPR mode.
1800.06/1800.61	c      100  22635    68794   189463    2   161294   81854    100      3 26.87
1800.06/1800.61	c      251  22635    68945   197743    2   161926   90040    251      9 26.99
1800.06/1800.61	c      476  22635    69170   203747    2   162484   99045    476     17 27.14
1800.06/1800.61	c      815  22635    69509   217867    3   163170  108950    815     29 27.38
1800.06/1800.61	c     1326  22635    70020   259564    3   164212  119846   1326     47 27.94
1800.06/1800.61	c     2089  22635    70783   299667    4   165727  131831   2089     73 28.55
1800.06/1800.61	c     3236  22613    71930   377012    5   168013  145015   3236    108 29.70
1800.06/1800.61	c     4957  22613    73651   522533    7   171479  159517   4957    159 31.05
1800.06/1800.61	c     7541  22613    76235   692308    9   176649  175469   7541    225 33.40
1800.06/1800.61	c    11420  22613    80114  1029916   12   184415  193016  11420    309 36.88
1800.06/1800.61	c    17242  22613    85936  1598221   18   196038  212318  17242    415 41.51
1800.06/1800.61	c    25981  22613    94675  2443764   25   213563  233550  25981    516 50.31
1800.06/1800.61	c    39091  22613   107785  4113910   38   239752  256906  39091    600 65.09
1800.06/1800.61	c    58762  22608   127456  7081336   55   279100  282597  58762    653 89.91
1800.06/1800.61	c    88273  22608   156967 11518712   73   338149  310857  88273    611 144.26
1800.06/1800.61	c   132544  22608   201238 21105494  104   426654  341943 132544    425 311.59
1800.06/1800.61	c   198954  22608   267648 44373675  165   559458  376138 198954    317 626.56
1800.06/1800.61	c   298574  22608   367268 84532283  230   758757  413752 298574    267 1115.55
1800.06/1800.61	c Caught signal: 15
1800.06/1800.61	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.06/1800.61	c   18   379327  99800   621179   448021 106011110 379327    210 1800.07
1800.06/1800.61	s UNKNOWN
1800.06/1800.61	c Total time: 1800.07 s

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739558-1338748317/watcher-3739558-1338748317 -o /tmp/evaluation-result-3739558-1338748317/solver-3739558-1338748317 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739558-1338748317.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.94 1.38 1.72 2/176 20829
/proc/meminfo: memFree=27963680/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=9720 CPUtime=0 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 483 0 0 0 0 0 0 0 20 0 1 0 340958512 9953280 420 33554432000 134512640 135840783 4292126016 4292125072 134545942 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 2430 420 328 325 0 110 0

[startup+0.0209291 s]
/proc/loadavg: 0.94 1.38 1.72 2/176 20829
/proc/meminfo: memFree=27963680/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=10704 CPUtime=0.01 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 745 0 0 0 1 0 0 0 20 0 1 0 340958512 10960896 682 33554432000 134512640 135840783 4292126016 4292124720 11715879 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 2676 682 364 325 0 356 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 10704

[startup+0.100201 s]
/proc/loadavg: 0.94 1.38 1.72 2/176 20829
/proc/meminfo: memFree=27963680/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=15184 CPUtime=0.09 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 2114 0 0 0 9 0 0 0 20 0 1 0 340958512 15548416 2011 33554432000 134512640 135840783 4292126016 4292124088 11447169 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 3796 2012 581 325 0 1476 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15184

[startup+0.300199 s]
/proc/loadavg: 0.94 1.38 1.72 2/176 20829
/proc/meminfo: memFree=27963680/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=22816 CPUtime=0.28 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 4527 0 0 0 28 0 0 0 20 0 1 0 340958512 23363584 4424 33554432000 134512640 135840783 4292126016 4292124720 11715879 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 5704 4424 1065 325 0 3384 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 22816

[startup+0.700222 s]
/proc/loadavg: 0.94 1.38 1.72 2/176 20829
/proc/meminfo: memFree=27963680/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39168 CPUtime=0.68 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10240 0 0 0 68 0 0 0 20 0 1 0 340958512 40108032 8802 33554432000 134512640 135840783 4292126016 4291547072 134550782 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9792 8802 342 325 0 8728 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 39168

[startup+1.50024 s]
/proc/loadavg: 0.94 1.38 1.72 3/177 20868
/proc/meminfo: memFree=27932360/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39300 CPUtime=1.48 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10281 0 0 0 148 0 0 0 20 0 1 0 340958512 40243200 8843 33554432000 134512640 135840783 4292126016 4291547184 134583062 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9825 8843 342 325 0 8761 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 39300

[startup+3.1002 s]
/proc/loadavg: 1.02 1.39 1.73 3/177 20906
/proc/meminfo: memFree=27920804/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39300 CPUtime=3.09 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10290 0 0 0 308 1 0 0 20 0 1 0 340958512 40243200 8852 33554432000 134512640 135840783 4292126016 4291547072 134550764 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9825 8852 342 325 0 8761 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 39300

[startup+6.30019 s]
/proc/loadavg: 1.02 1.39 1.73 3/177 20944
/proc/meminfo: memFree=27911768/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39300 CPUtime=6.29 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10291 0 0 0 628 1 0 0 20 0 1 0 340958512 40243200 8853 33554432000 134512640 135840783 4292126016 4291547212 7873584 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9825 8853 342 325 0 8761 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 39300

[startup+12.7002 s]
/proc/loadavg: 1.17 1.41 1.73 3/177 20944
/proc/meminfo: memFree=27912544/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39300 CPUtime=12.68 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10296 0 0 0 1267 1 0 0 20 0 1 0 340958512 40243200 8858 33554432000 134512640 135840783 4292126016 4291547072 134551093 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9825 8858 342 325 0 8761 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 39300

[startup+25.5002 s]
/proc/loadavg: 1.30 1.43 1.73 3/177 20944
/proc/meminfo: memFree=27910056/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=39300 CPUtime=25.47 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 10318 0 0 0 2545 2 0 0 20 0 1 0 340958512 40243200 8880 33554432000 134512640 135840783 4292126016 4291547072 134551305 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/20829/statm: 9825 8880 342 325 0 8761 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 39300

[startup+51.1003 s]
/proc/loadavg: 1.54 1.47 1.74 3/177 20944
/proc/meminfo: memFree=27853456/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=56768 CPUtime=51.06 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 15356 0 0 0 5099 7 0 0 20 0 1 0 340958512 58130432 13244 33554432000 134512640 135840783 4292126016 4292125288 11710401 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 14192 13244 347 325 0 13128 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 56768

[startup+102.307 s]
/proc/loadavg: 1.81 1.56 1.75 3/177 20944
/proc/meminfo: memFree=27698996/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=133896 CPUtime=102.23 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 34668 0 0 0 10211 12 0 0 20 0 1 0 340958512 137109504 32516 33554432000 134512640 135840783 4292126016 4292122688 11715879 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 33474 32516 347 325 0 32410 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 133896

[startup+162.3 s]
/proc/loadavg: 1.92 1.63 1.76 3/177 20945
/proc/meminfo: memFree=27588708/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=189204 CPUtime=162.21 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 48505 0 0 0 16204 17 0 0 20 0 1 0 340958512 193744896 46435 33554432000 134512640 135840783 4292126016 4292125376 134550800 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 47301 46435 347 325 0 46237 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 189204

[startup+222.3 s]
/proc/loadavg: 1.97 1.70 1.77 3/177 20945
/proc/meminfo: memFree=27476520/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=236020 CPUtime=222.2 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 60218 0 0 0 22198 22 0 0 20 0 1 0 340958512 241684480 58148 33554432000 134512640 135840783 4292126016 4292125376 134551052 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 59005 58148 347 325 0 57941 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 236020

[startup+282.3 s]
/proc/loadavg: 1.99 1.75 1.78 3/177 20945
/proc/meminfo: memFree=27369412/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=287248 CPUtime=282.19 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 73039 0 0 0 28194 25 0 0 20 0 1 0 340958512 294141952 70969 33554432000 134512640 135840783 4292126016 4292125376 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 71812 70969 347 325 0 70748 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 287248

[startup+342.3 s]
/proc/loadavg: 1.99 1.80 1.79 3/177 20945
/proc/meminfo: memFree=27285508/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=330276 CPUtime=342.18 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 83790 0 0 0 34189 29 0 0 20 0 1 0 340958512 338202624 81720 33554432000 134512640 135840783 4292126016 4292125376 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 82569 81720 347 325 0 81505 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 330276

[startup+402.3 s]
/proc/loadavg: 1.99 1.83 1.80 3/177 20945
/proc/meminfo: memFree=27185192/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=391012 CPUtime=402.17 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 98951 0 0 0 40184 33 0 0 20 0 1 0 340958512 400396288 96881 33554432000 134512640 135840783 4292126016 4292125312 134571866 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 97753 96881 347 325 0 96689 0
Current children cumulated CPU time (s) 402.17
Current children cumulated vsize (KiB) 391012

[startup+462.3 s]
/proc/loadavg: 1.99 1.86 1.82 3/178 20947
/proc/meminfo: memFree=27094488/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=440936 CPUtime=462.14 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 111465 0 0 0 46177 37 0 0 20 0 1 0 340958512 451518464 109369 33554432000 134512640 135840783 4292126016 4292125376 134550814 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 110234 109369 347 325 0 109170 0
Current children cumulated CPU time (s) 462.14
Current children cumulated vsize (KiB) 440936

[startup+522.3 s]
/proc/loadavg: 1.99 1.88 1.82 3/178 20949
/proc/meminfo: memFree=26971132/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=506632 CPUtime=522.1 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 127958 0 0 0 52167 43 0 0 20 0 1 0 340958512 518791168 125814 33554432000 134512640 135840783 4292126016 4292125376 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 126658 125814 347 325 0 125594 0
Current children cumulated CPU time (s) 522.1
Current children cumulated vsize (KiB) 506632

[startup+582.3 s]
/proc/loadavg: 2.05 1.91 1.83 3/177 20949
/proc/meminfo: memFree=26851016/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=564444 CPUtime=582.04 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 142461 0 0 0 58157 47 0 0 20 0 1 0 340958512 577990656 140269 33554432000 134512640 135840783 4292126016 4292125340 5125223 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 141111 140269 347 325 0 140047 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 564444

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.01 1.97 1.86 3/176 20950
/proc/meminfo: memFree=26445920/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=763600 CPUtime=821.89 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 192386 0 0 0 82126 63 0 0 20 0 1 0 340958512 781926400 190045 33554432000 134512640 135840783 4292126016 4292125376 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 190900 190045 347 325 0 189836 0
Current children cumulated CPU time (s) 821.89
Current children cumulated vsize (KiB) 763600

[startup+882.3 s]
/proc/loadavg: 2.00 1.97 1.87 3/177 20951
/proc/meminfo: memFree=26359112/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=806224 CPUtime=881.89 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 203046 0 0 0 88122 67 0 0 20 0 1 0 340958512 825573376 200705 33554432000 134512640 135840783 4292126016 4292125376 134551285 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 201556 200705 347 325 0 200492 0
Current children cumulated CPU time (s) 881.89
Current children cumulated vsize (KiB) 806224

[startup+942.3 s]
/proc/loadavg: 2.00 1.97 1.87 3/177 20951
/proc/meminfo: memFree=26250240/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=856280 CPUtime=941.88 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 215555 0 0 0 94118 70 0 0 20 0 1 0 340958512 876830720 213214 33554432000 134512640 135840783 4292126016 4292125376 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 214070 213214 347 325 0 213006 0
Current children cumulated CPU time (s) 941.88
Current children cumulated vsize (KiB) 856280

[startup+1002.3 s]
/proc/loadavg: 2.00 1.97 1.88 3/177 20951
/proc/meminfo: memFree=26091644/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=952440 CPUtime=1001.87 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 239599 0 0 0 100111 76 0 0 20 0 1 0 340958512 975298560 237258 33554432000 134512640 135840783 4292126016 4292125376 134551186 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 238110 237258 347 325 0 237046 0
Current children cumulated CPU time (s) 1001.87
Current children cumulated vsize (KiB) 952440

[startup+1062.3 s]
/proc/loadavg: 2.05 1.99 1.89 3/177 20952
/proc/meminfo: memFree=25958880/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1042456 CPUtime=1061.86 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 262098 0 0 0 106105 81 0 0 20 0 1 0 340958512 1067474944 259757 33554432000 134512640 135840783 4292126016 4292125376 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 260614 259757 347 325 0 259550 0
Current children cumulated CPU time (s) 1061.86
Current children cumulated vsize (KiB) 1042456

[startup+1122.3 s]
/proc/loadavg: 2.02 1.99 1.90 3/178 20955
/proc/meminfo: memFree=25842400/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1130716 CPUtime=1121.85 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 284154 0 0 0 112101 84 0 0 20 0 1 0 340958512 1157853184 281813 33554432000 134512640 135840783 4292126016 4292125376 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 282679 281813 347 325 0 281615 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 1130716

[startup+1182.3 s]
/proc/loadavg: 2.08 2.00 1.91 3/177 20955
/proc/meminfo: memFree=25763944/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1153760 CPUtime=1181.84 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 289929 0 0 0 118097 87 0 0 20 0 1 0 340958512 1181450240 287588 33554432000 134512640 135840783 4292126016 4292125376 134550904 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 288440 287588 347 325 0 287376 0
Current children cumulated CPU time (s) 1181.84
Current children cumulated vsize (KiB) 1153760

[startup+1242.3 s]
/proc/loadavg: 2.03 2.00 1.91 3/177 20955
/proc/meminfo: memFree=25691308/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1186308 CPUtime=1241.83 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 298075 0 0 0 124093 90 0 0 20 0 1 0 340958512 1214779392 295734 33554432000 134512640 135840783 4292126016 4292125376 134550872 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 296577 295734 347 325 0 295513 0
Current children cumulated CPU time (s) 1241.83
Current children cumulated vsize (KiB) 1186308

[startup+1302.3 s]
/proc/loadavg: 2.01 2.00 1.91 3/177 20955
/proc/meminfo: memFree=25604536/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1224060 CPUtime=1301.83 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 307502 0 0 0 130090 93 0 0 20 0 1 0 340958512 1253437440 305161 33554432000 134512640 135840783 4292126016 4292125376 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 306015 305161 347 325 0 304951 0
Current children cumulated CPU time (s) 1301.83
Current children cumulated vsize (KiB) 1224060

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/177 20956
/proc/meminfo: memFree=25528428/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1251200 CPUtime=1361.82 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 314273 0 0 0 136085 97 0 0 20 0 1 0 340958512 1281228800 311932 33554432000 134512640 135840783 4292126016 4292125376 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 312800 311932 347 325 0 311736 0
Current children cumulated CPU time (s) 1361.82
Current children cumulated vsize (KiB) 1251200

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 1.91 3/177 20956
/proc/meminfo: memFree=25460628/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1278928 CPUtime=1421.81 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 321236 0 0 0 142082 99 0 0 20 0 1 0 340958512 1309622272 318895 33554432000 134512640 135840783 4292126016 4292125376 134551018 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 319732 318895 347 325 0 318668 0
Current children cumulated CPU time (s) 1421.81
Current children cumulated vsize (KiB) 1278928

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/177 20956
/proc/meminfo: memFree=25398532/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1306808 CPUtime=1481.8 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 328195 0 0 0 148079 101 0 0 20 0 1 0 340958512 1338171392 325854 33554432000 134512640 135840783 4292126016 4292125376 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 326702 325854 347 325 0 325638 0
Current children cumulated CPU time (s) 1481.8
Current children cumulated vsize (KiB) 1306808

[startup+1542.3 s]
/proc/loadavg: 2.05 2.01 1.91 3/177 20956
/proc/meminfo: memFree=25371904/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1333360 CPUtime=1541.78 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 334841 0 0 0 154075 103 0 0 20 0 1 0 340958512 1365360640 332500 33554432000 134512640 135840783 4292126016 4292125316 11721291 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 333340 332500 347 325 0 332276 0
Current children cumulated CPU time (s) 1541.78
Current children cumulated vsize (KiB) 1333360

[startup+1602.3 s]
/proc/loadavg: 2.02 2.01 1.91 3/177 20956
/proc/meminfo: memFree=25352712/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1352432 CPUtime=1601.77 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 339607 0 0 0 160072 105 0 0 20 0 1 0 340958512 1384890368 337266 33554432000 134512640 135840783 4292126016 4292125376 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 338108 337266 347 325 0 337044 0
Current children cumulated CPU time (s) 1601.77
Current children cumulated vsize (KiB) 1352432

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/177 20957
/proc/meminfo: memFree=25329152/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1376332 CPUtime=1661.77 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 345569 0 0 0 166069 108 0 0 20 0 1 0 340958512 1409363968 343228 33554432000 134512640 135840783 4292126016 4292125376 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 344083 343228 347 325 0 343019 0
Current children cumulated CPU time (s) 1661.77
Current children cumulated vsize (KiB) 1376332

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/178 20960
/proc/meminfo: memFree=25313412/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1391676 CPUtime=1721.76 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 349393 0 0 0 172066 110 0 0 20 0 1 0 340958512 1425076224 347052 33554432000 134512640 135840783 4292126016 4292125152 11713194 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 347919 347052 347 325 0 346855 0
Current children cumulated CPU time (s) 1721.76
Current children cumulated vsize (KiB) 1391676

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/178 20982
/proc/meminfo: memFree=25298696/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1405576 CPUtime=1781.75 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 352887 0 0 0 178064 111 0 0 20 0 1 0 340958512 1439309824 350546 33554432000 134512640 135840783 4292126016 4292125376 134550782 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 351394 350546 347 325 0 350330 0
Current children cumulated CPU time (s) 1781.75
Current children cumulated vsize (KiB) 1405576



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.91 3/178 20982
/proc/meminfo: memFree=25293364/32873648 swapFree=6864/6864
[pid=20829] ppid=20827 vsize=1411024 CPUtime=1800.06 cores=0,2,4,6
/proc/20829/stat : 20829 (bsolo3.0.17) R 20827 20829 20253 0 -1 4202496 354255 0 0 0 179894 112 0 0 20 0 1 0 340958512 1444888576 351914 33554432000 134512640 135840783 4292126016 4292125152 11713438 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/20829/statm: 352756 351914 347 325 0 351692 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 1411024

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.66
CPU time (s): 1800.12
CPU user time (s): 1798.95
CPU system time (s): 1.16682
CPU usage (%): 99.9699
Max. virtual memory (cumulated for all children) (KiB): 1411024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.95
system time used= 1.16682
maximum resident set size= 1407656
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354258
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 347
involuntary context switches= 1935

runsolver used 3.2835 second user time and 9.49056 second system time

The end

Launcher Data

Begin job on node113 at 2012-06-03 20:31:57
IDJOB=3739558
IDBENCH=73459
IDSOLVER=2318
FILE ID=node113/3739558-1338748317
RUNJOBID= node113-1338748314-20269
PBS_JOBID= 14636785
Free space on /tmp= 70968 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12046_2-sat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739558-1338748317/watcher-3739558-1338748317 -o /tmp/evaluation-result-3739558-1338748317/solver-3739558-1338748317 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739558-1338748317.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8df6acf86997549eac6f2a4fde05a479
RANDOM SEED=919715154

node113.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.026
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27964052 kB
Buffers:          518000 kB
Cached:          3480724 kB
SwapCached:         2028 kB
Active:          1744580 kB
Inactive:        2273040 kB
Active(anon):      18232 kB
Inactive(anon):     1912 kB
Active(file):    1726348 kB
Inactive(file):  2271128 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67099708 kB
Dirty:             20080 kB
Writeback:             0 kB
AnonPages:         23028 kB
Mapped:            12556 kB
Shmem:                 0 kB
Slab:             754132 kB
SReclaimable:     195944 kB
SUnreclaim:       558188 kB
KernelStack:        1432 kB
PageTables:         3948 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     138360 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70960 MiB
End job on node113 at 2012-06-03 21:01:59