Trace number 3739675

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.02 1800.51

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j1208_6-sat.opb
MD5SUM767f3c2306b702c64990fc49595a468e
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark19.772
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables20812
Total number of constraints65671
Number of constraints which are clauses65331
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints340
Minimum length of a constraint1
Maximum length of a constraint65
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 30
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 427
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.08	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.08	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.08	c type "bsolo -h" for help
0.00/0.08	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.08	c Memory Limit set to 15500 MB
0.00/0.08	c Instance file HOME/instance-3739675-1338749243.opb
0.00/0.08	c File size is 1968078 bytes.
0.11/0.24	c Highest Coefficient sum: 427
0.11/0.24	c Parsing was ok!!
0.11/0.24	c Total parsing time: 0.161 s
0.11/0.26	c Var: 20812 Constr: 65671 65331/0/340 Lit: 160218 Watch. Lit: 147201
0.11/0.26	c Obj. Vars: 0 (0 % of total variables)
0.51/0.64	c Pre-processing Time: 0.562 s
0.51/0.64	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.51/0.64	c        0   5114    12789    34291    2    30396   18144      0      0 0.56
0.51/0.64	c Switching off LPR mode.
1800.01/1800.50	c      101   5114    12890    49406    3    31401   19959    101    167 0.60
1800.01/1800.50	c      251   5114    13040    60518    4    31841   21955    251    370 0.68
1800.01/1800.50	c      477   5114    13266    73652    5    32341   24151    477    618 0.77
1800.01/1800.50	c      815   5114    13604    99228    7    33043   26567    815    899 0.91
1800.01/1800.50	c     1323   5114    14112   133664    9    34071   29224   1323   1176 1.12
1800.01/1800.50	c     2086   5114    14875   190777   12    35576   32147   2086   1424 1.46
1800.01/1800.50	c     3232   5114    16021   301764   18    37888   35362   3232   1659 1.95
1800.01/1800.50	c     4953   5114    17742   466962   26    41319   38899   4953   1780 2.78
1800.01/1800.50	c     7538   5114    20327   827152   40    46496   42789   7538   1860 4.05
1800.01/1800.50	c    11417   5114    24206  1314621   54    54258   47068  11417   1868 6.11
1800.01/1800.50	c    17240   5114    30029  2097189   69    65904   51775  17240   1883 9.15
1800.01/1800.50	c    25978   5114    38767  2885958   74    83398   56953  25978   1626 15.97
1800.01/1800.50	c    39088   5114    51877  5113472   98   109594   62649  39088   1393 28.04
1800.01/1800.50	c    58758   5114    71547  8230069  115   148928   68914  58758   1037 56.64
1800.01/1800.50	c    88269   5114    29806  3364067  112    65456   75806  17017    736 119.89
1800.01/1800.50	c   132539   5114    74076  8440317  113   154025   83387  61287    744 178.01
1800.01/1800.50	c   198949   5114    56637  7980430  140   119140   91726  43848    584 340.22
1800.01/1800.50	c   298569   5114    63789 11254292  176   133420  100899  51000    480 620.85
1800.01/1800.50	c   448004   5114   111644 18067230  161   229119  110989  98855    443 1009.56
1800.01/1800.50	c   672164   5114   114187 10490361   91   234207  122088 101398    390 1720.00
1800.01/1800.50	c Caught signal: 15
1800.01/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.01/1800.50	c   20   700366 171246  1052202   142389 16402753 129600    389 1800.02
1800.01/1800.50	s UNKNOWN
1800.01/1800.50	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739675-1338749243/watcher-3739675-1338749243 -o /tmp/evaluation-result-3739675-1338749243/solver-3739675-1338749243 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739675-1338749243.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.97 1.99 3/175 12544
/proc/meminfo: memFree=27454984/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=1524 CPUtime=0 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) D 12540 12544 12501 0 -1 4194304 47 0 0 0 0 0 0 0 20 0 1 0 341048752 1560576 2 33554432000 0 0 4288079584 140733516059704 5057063 0 0 4096 0 18446744071579943789 0 0 17 5 0 0 0 0 0
/proc/12544/statm: 381 2 0 0 0 23 0

[startup+0.058965 s]
/proc/loadavg: 1.84 1.97 1.99 3/175 12544
/proc/meminfo: memFree=27454984/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=4472 CPUtime=0 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) D 12540 12544 12501 0 -1 4194304 106 0 3 0 0 0 0 0 20 0 1 0 341048752 4579328 61 33554432000 134512640 135840783 4288077888 4288075696 10821879 0 0 4096 0 18446744071579943789 0 0 17 5 0 0 3 0 0
/proc/12544/statm: 1118 61 47 325 0 35 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 4472

[startup+0.100301 s]
/proc/loadavg: 1.84 1.97 1.99 3/175 12544
/proc/meminfo: memFree=27454984/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=7880 CPUtime=0.01 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 822 0 3 0 1 0 0 0 20 0 1 0 341048752 8069120 762 33554432000 134512640 135840783 4288077888 4288076720 11330855 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 1970 763 375 325 0 425 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 7880

[startup+0.300266 s]
/proc/loadavg: 1.84 1.97 1.99 3/175 12544
/proc/meminfo: memFree=27454984/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=18404 CPUtime=0.21 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 4364 0 3 0 21 0 0 0 20 0 1 0 341048752 18845696 3783 33554432000 134512640 135840783 4288077888 4287827260 4584496 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 4601 3783 342 325 0 3537 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 18404

[startup+0.700198 s]
/proc/loadavg: 1.84 1.97 1.99 3/175 12544
/proc/meminfo: memFree=27454984/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=18424 CPUtime=0.61 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 4428 0 3 0 60 1 0 0 20 0 1 0 341048752 18866176 3806 33554432000 134512640 135840783 4288077888 4288077248 134550670 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 4606 3806 347 325 0 3542 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 18424

[startup+1.50018 s]
/proc/loadavg: 1.84 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27413604/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=18424 CPUtime=1.41 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 4428 0 3 0 140 1 0 0 20 0 1 0 341048752 18866176 3806 33554432000 134512640 135840783 4288077888 4288077248 134550764 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 4606 3806 347 325 0 3542 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 18424

[startup+3.10018 s]
/proc/loadavg: 1.84 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27412100/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=18952 CPUtime=3 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 4539 0 3 0 299 1 0 0 20 0 1 0 341048752 19406848 3917 33554432000 134512640 135840783 4288077888 4288077184 134572295 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 4738 3917 347 325 0 3674 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 18952

[startup+6.30028 s]
/proc/loadavg: 1.85 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27403040/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=28720 CPUtime=6.2 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 6996 0 3 0 618 2 0 0 20 0 1 0 341048752 29409280 6366 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 7180 6366 347 325 0 6116 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 28720

[startup+12.7003 s]
/proc/loadavg: 1.86 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27386684/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=44296 CPUtime=12.6 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 10872 0 3 0 1257 3 0 0 20 0 1 0 341048752 45359104 10242 33554432000 134512640 135840783 4288077888 4288077248 134551048 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 11074 10242 347 325 0 10010 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 44296

[startup+25.5003 s]
/proc/loadavg: 1.89 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27339176/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=72016 CPUtime=25.38 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 17837 0 3 0 2533 5 0 0 20 0 1 0 341048752 73744384 17191 33554432000 134512640 135840783 4288077888 4288077248 134551330 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 18004 17191 347 325 0 16940 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 72016

[startup+51.1003 s]
/proc/loadavg: 1.93 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27241788/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=112556 CPUtime=50.96 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 27991 0 3 0 5088 8 0 0 20 0 1 0 341048752 115257344 27329 33554432000 134512640 135840783 4288077888 4288077248 134551048 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 28139 27329 347 325 0 27075 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 112556

[startup+102.307 s]
/proc/loadavg: 2.05 1.99 1.99 3/177 12584
/proc/meminfo: memFree=27096008/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=183724 CPUtime=102.11 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 45821 0 3 0 10197 14 0 0 20 0 1 0 341048752 188133376 45120 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 45931 45120 347 325 0 44867 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 183724

[startup+162.3 s]
/proc/loadavg: 2.02 1.99 1.99 3/178 12587
/proc/meminfo: memFree=27026076/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=200512 CPUtime=162.09 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 50089 0 3 0 16193 16 0 0 20 0 1 0 341048752 205324288 49297 33554432000 134512640 135840783 4288077888 4288077248 134550764 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 50128 49297 347 325 0 49064 0
Current children cumulated CPU time (s) 162.09
Current children cumulated vsize (KiB) 200512

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12587
/proc/meminfo: memFree=26987564/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=200512 CPUtime=222.09 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 50089 0 3 0 22193 16 0 0 20 0 1 0 341048752 205324288 49297 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 50128 49297 347 325 0 49064 0
Current children cumulated CPU time (s) 222.09
Current children cumulated vsize (KiB) 200512

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26930180/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=204116 CPUtime=282.08 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 51020 0 3 0 28191 17 0 0 20 0 1 0 341048752 209014784 50228 33554432000 134512640 135840783 4288077888 4288077248 134550804 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 51029 50228 347 325 0 49965 0
Current children cumulated CPU time (s) 282.08
Current children cumulated vsize (KiB) 204116

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26856572/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=214560 CPUtime=342.06 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 53723 0 3 0 34188 18 0 0 20 0 1 0 341048752 219709440 52833 33554432000 134512640 135840783 4288077888 4288077248 134550820 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 53640 52833 347 325 0 52576 0
Current children cumulated CPU time (s) 342.06
Current children cumulated vsize (KiB) 214560

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26798664/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=214560 CPUtime=402.05 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 53723 0 3 0 40187 18 0 0 20 0 1 0 341048752 219709440 52833 33554432000 134512640 135840783 4288077888 4288077148 11325376 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 53640 52833 347 325 0 52576 0
Current children cumulated CPU time (s) 402.05
Current children cumulated vsize (KiB) 214560

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26741540/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=234768 CPUtime=462.04 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 58763 0 3 0 46182 22 0 0 20 0 1 0 341048752 240402432 57862 33554432000 134512640 135840783 4288077888 4288077248 134550820 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 58692 57862 347 325 0 57628 0
Current children cumulated CPU time (s) 462.04
Current children cumulated vsize (KiB) 234768

[startup+522.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26661576/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=283296 CPUtime=522 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 70936 0 3 0 52172 28 0 0 20 0 1 0 341048752 290095104 70012 33554432000 134512640 135840783 4288077888 4288077248 134550764 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 70824 70012 347 325 0 69760 0
Current children cumulated CPU time (s) 522
Current children cumulated vsize (KiB) 283296

[startup+582.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12589
/proc/meminfo: memFree=26636900/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=305548 CPUtime=581.99 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 76605 0 3 0 58168 31 0 0 20 0 1 0 341048752 312881152 75574 33554432000 134512640 135840783 4288077888 4288077248 134550893 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76387 75574 347 325 0 75323 0
Current children cumulated CPU time (s) 581.99
Current children cumulated vsize (KiB) 305548

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26635952/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306504 CPUtime=881.94 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 76972 0 3 0 88163 31 0 0 20 0 1 0 341048752 313860096 75825 33554432000 134512640 135840783 4288077888 4288077248 134550972 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76626 75825 347 325 0 75562 0
Current children cumulated CPU time (s) 881.94
Current children cumulated vsize (KiB) 306504

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26597016/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306504 CPUtime=941.94 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 76972 0 3 0 94163 31 0 0 20 0 1 0 341048752 313860096 75825 33554432000 134512640 135840783 4288077888 4288077248 134551058 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76626 75825 347 325 0 75562 0
Current children cumulated CPU time (s) 941.94
Current children cumulated vsize (KiB) 306504

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26542160/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306504 CPUtime=1001.93 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 76995 0 3 0 100161 32 0 0 20 0 1 0 341048752 313860096 75825 33554432000 134512640 135840783 4288077888 4288077124 11325421 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76626 75825 347 325 0 75562 0
Current children cumulated CPU time (s) 1001.93
Current children cumulated vsize (KiB) 306504

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26499132/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306504 CPUtime=1061.92 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 76995 0 3 0 106160 32 0 0 20 0 1 0 341048752 313860096 75825 33554432000 134512640 135840783 4288077888 4288077216 15843295 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76626 75825 347 325 0 75562 0
Current children cumulated CPU time (s) 1061.92
Current children cumulated vsize (KiB) 306504

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26460320/32873844 swapFree=6612/6612
[pid=12544] ppid=12540 vsize=306536 CPUtime=1121.91 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77003 0 3 0 112159 32 0 0 20 0 1 0 341048752 313892864 75833 33554432000 134512640 135840783 4288077888 4288077188 11336267 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76634 75833 347 325 0 75570 0
Current children cumulated CPU time (s) 1121.91
Current children cumulated vsize (KiB) 306536

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12615
/proc/meminfo: memFree=26426104/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1181.9 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 118158 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550764 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1181.9
Current children cumulated vsize (KiB) 306544

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12616
/proc/meminfo: memFree=26383812/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1241.89 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 124157 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550893 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1241.89
Current children cumulated vsize (KiB) 306544

[startup+1302.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 12616
/proc/meminfo: memFree=26342760/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1301.89 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 130157 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1301.89
Current children cumulated vsize (KiB) 306544

[startup+1362.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 12619
/proc/meminfo: memFree=26342624/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1361.87 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 136155 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134551347 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1361.87
Current children cumulated vsize (KiB) 306544

[startup+1422.31 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 12619
/proc/meminfo: memFree=26342692/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1421.87 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 142155 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1421.87
Current children cumulated vsize (KiB) 306544

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12619
/proc/meminfo: memFree=26342792/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1481.85 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 148153 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550913 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1481.85
Current children cumulated vsize (KiB) 306544

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1541.84 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 154152 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550779 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1541.84
Current children cumulated vsize (KiB) 306544

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26343040/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1601.83 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 160151 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077024 11328236 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1601.83
Current children cumulated vsize (KiB) 306544

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12620
/proc/meminfo: memFree=26343040/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1661.83 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 166151 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134551646 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1661.83
Current children cumulated vsize (KiB) 306544

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12620
/proc/meminfo: memFree=26343164/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1721.82 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 172150 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134550804 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1721.82
Current children cumulated vsize (KiB) 306544

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306544 CPUtime=1781.81 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77005 0 3 0 178149 32 0 0 20 0 1 0 341048752 313901056 75835 33554432000 134512640 135840783 4288077888 4288077248 134551093 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76636 75835 347 325 0 75572 0
Current children cumulated CPU time (s) 1781.81
Current children cumulated vsize (KiB) 306544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12621
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306552 CPUtime=1800.01 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77007 0 3 0 179969 32 0 0 20 0 1 0 341048752 313909248 75837 33554432000 134512640 135840783 4288077888 4288077168 11333306 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76638 75837 347 325 0 75574 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 306552

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12621
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12544] ppid=12540 vsize=306552 CPUtime=1800.01 cores=1,3,5,7
/proc/12544/stat : 12544 (bsolo3.0.17) R 12540 12544 12501 0 -1 4202496 77007 0 3 0 179969 32 0 0 20 0 1 0 341048752 313909248 75837 33554432000 134512640 135840783 4288077888 4288077168 11333306 0 0 4096 16384 0 0 0 17 5 0 0 7 0 0
/proc/12544/statm: 76638 75837 347 325 0 75574 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 306552

Child status: 15
Real time (s): 1800.51
CPU time (s): 1800.02
CPU user time (s): 1799.7
CPU system time (s): 0.32295
CPU usage (%): 99.9728
Max. virtual memory (cumulated for all children) (KiB): 306968

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.7
system time used= 0.32295
maximum resident set size= 303764
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 77010
page faults= 3
swaps= 0
block input operations= 488
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 168
involuntary context switches= 1852

runsolver used 3.61245 second user time and 10.3244 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-03 20:47:23
IDJOB=3739675
IDBENCH=74115
IDSOLVER=2318
FILE ID=node140/3739675-1338749243
RUNJOBID= node140-1338749243-12518
PBS_JOBID= 14636796
Free space on /tmp= 70612 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j1208_6-sat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739675-1338749243/watcher-3739675-1338749243 -o /tmp/evaluation-result-3739675-1338749243/solver-3739675-1338749243 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739675-1338749243.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 767f3c2306b702c64990fc49595a468e
RANDOM SEED=1152390757

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27455892 kB
Buffers:          504240 kB
Cached:          3976232 kB
SwapCached:         1620 kB
Active:          1521516 kB
Inactive:        2968036 kB
Active(anon):       2276 kB
Inactive(anon):     9476 kB
Active(file):    1519240 kB
Inactive(file):  2958560 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:             16856 kB
Writeback:             0 kB
AnonPages:         14136 kB
Mapped:             9600 kB
Shmem:                 8 kB
Slab:             788604 kB
SReclaimable:     230052 kB
SUnreclaim:       558552 kB
KernelStack:        1376 kB
PageTables:         3924 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     103548 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70600 MiB
End job on node140 at 2012-06-03 21:17:26