Trace number 3739688

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.04 1800.72

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12047_6-sat.opb
MD5SUM937ecf63c168ba3c2555061c1a7466e0
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables33396
Total number of constraints116135
Number of constraints which are clauses115587
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints548
Minimum length of a constraint1
Maximum length of a constraint66
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 19
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 383
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3739688-1338749244.opb
0.00/0.00	c File size is 3508147 bytes.
0.28/0.32	c Highest Coefficient sum: 383
0.28/0.32	c Parsing was ok!!
0.28/0.32	c Total parsing time: 0.318 s
0.28/0.35	c Var: 33396 Constr: 116135 115587/0/548 Lit: 279347 Watch. Lit: 260039
0.28/0.35	c Obj. Vars: 0 (0 % of total variables)
5.98/6.04	c Pre-processing Time: 6.035 s
5.98/6.04	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
5.98/6.04	c        0  11842    34333    87185    2    79326   39158      0      0 6.04
5.98/6.04	c Switching off LPR mode.
1800.02/1800.71	c      100  11842    34433    91905    2    81120   43074    100     16 6.09
1800.02/1800.71	c      251  11842    34584   103455    2    81512   47382    251     40 6.20
1800.02/1800.71	c      477  11842    34810   121321    3    81973   52121    477     75 6.32
1800.02/1800.71	c      815  11842    35148   139322    3    82657   57334    815    126 6.45
1800.02/1800.71	c     1323  11842    35656   184404    5    83706   63068   1323    195 6.78
1800.02/1800.71	c     2086  11842    36419   236768    6    85229   69375   2086    293 7.10
1800.02/1800.71	c     3232  11842    37565   315304    8    87538   76313   3232    418 7.72
1800.02/1800.71	c     4953  11842    39286   479530   12    91023   83945   4953    553 8.95
1800.02/1800.71	c     7538  11842    41871   684743   16    96164   92340   7538    718 10.49
1800.02/1800.71	c    11417  11842    45750  1099191   24   103892  101575  11417    839 13.59
1800.02/1800.71	c    17239  11842    51572  1664294   32   115553  111733  17239    981 17.57
1800.02/1800.71	c    25976  11842    60309  3052177   50   133041  122907  25976    953 27.25
1800.02/1800.71	c    39086  11842    73419  5208366   70   159227  135198  39086   1023 38.19
1800.02/1800.71	c    58757  11842    93090  8555230   91   198566  148718  58757    864 67.97
1800.02/1800.71	c    88267  11842   122600 13204718  107   257601  163590  88267    764 115.46
1800.02/1800.71	c   132538  11842   166871 18227508  109   346137  179950 132538    632 209.64
1800.02/1800.71	c   198948  11842   233281 33732725  144   478975  197946 198948    462 430.58
1800.02/1800.71	c   298573  11842   125015 16617908  132   262366  217741  90682    457 652.56
1800.02/1800.71	c   448008  11842    53194  5276370   99   118785  239516  18861    344 1300.98
1800.02/1800.71	c Caught signal: 15
1800.02/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.02/1800.71	c   19   601908 150551   905279   207094 38427333 172761    334 1800.03
1800.02/1800.71	s UNKNOWN
1800.02/1800.71	c Total time: 1800.03 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739688-1338749244/watcher-3739688-1338749244 -o /tmp/evaluation-result-3739688-1338749244/solver-3739688-1338749244 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739688-1338749244.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.97 1.99 3/176 12583
/proc/meminfo: memFree=27437320/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=8124 CPUtime=0 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 487 0 0 0 0 0 0 0 20 0 1 0 341048808 8318976 423 33554432000 134512640 135840783 4293233248 4293231952 11330855 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 2031 423 329 325 0 110 0

[startup+0.0228409 s]
/proc/loadavg: 1.84 1.97 1.99 3/176 12583
/proc/meminfo: memFree=27437320/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=9252 CPUtime=0.01 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 818 0 0 0 1 0 0 0 20 0 1 0 341048808 9474048 754 33554432000 134512640 135840783 4293233248 4293231360 11190572 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 2313 755 374 325 0 392 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 9252

[startup+0.100214 s]
/proc/loadavg: 1.84 1.97 1.99 3/176 12583
/proc/meminfo: memFree=27437320/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=13412 CPUtime=0.09 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 2057 0 0 0 9 0 0 0 20 0 1 0 341048808 13733888 1993 33554432000 134512640 135840783 4293233248 4293231952 11330855 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 3353 1993 599 325 0 1432 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13412

[startup+0.300205 s]
/proc/loadavg: 1.84 1.97 1.99 3/176 12583
/proc/meminfo: memFree=27437320/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=21896 CPUtime=0.28 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 4771 0 0 0 28 0 0 0 20 0 1 0 341048808 22421504 4667 33554432000 134512640 135840783 4293233248 4293232188 12069239 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 5474 4668 1141 325 0 3553 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 21896

[startup+0.700208 s]
/proc/loadavg: 1.84 1.97 1.99 3/176 12583
/proc/meminfo: memFree=27437320/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=28464 CPUtime=0.69 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 7218 0 0 0 68 1 0 0 20 0 1 0 341048808 29147136 6257 33554432000 134512640 135840783 4293233248 4292831392 11333216 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 7116 6257 342 325 0 6052 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 28464

[startup+1.50019 s]
/proc/loadavg: 1.84 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27412472/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=28464 CPUtime=1.49 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 7219 0 0 0 148 1 0 0 20 0 1 0 341048808 29147136 6258 33554432000 134512640 135840783 4293233248 4292831520 134550779 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/12583/statm: 7116 6258 342 325 0 6052 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 28464

[startup+3.10024 s]
/proc/loadavg: 1.84 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27412108/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=28464 CPUtime=3.08 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 7225 0 0 0 307 1 0 0 20 0 1 0 341048808 29147136 6264 33554432000 134512640 135840783 4293233248 4292831612 3306544 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 7116 6264 342 325 0 6052 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 28464

[startup+6.30025 s]
/proc/loadavg: 1.85 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27401924/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=28496 CPUtime=6.28 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 7578 0 0 0 625 3 0 0 20 0 1 0 341048808 29179904 6289 33554432000 134512640 135840783 4293233248 4293232544 134572687 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 7124 6289 347 325 0 6060 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 28496

[startup+12.7002 s]
/proc/loadavg: 1.86 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27385568/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=30740 CPUtime=12.68 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 8144 0 0 0 1265 3 0 0 20 0 1 0 341048808 31477760 6855 33554432000 134512640 135840783 4293233248 4293232608 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 7685 6855 347 325 0 6621 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 30740

[startup+25.5003 s]
/proc/loadavg: 1.89 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27335936/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=51208 CPUtime=25.48 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 13243 0 0 0 2544 4 0 0 20 0 1 0 341048808 52436992 11954 33554432000 134512640 135840783 4293233248 4293232608 134586540 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 12802 11954 347 325 0 11738 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 51208

[startup+51.1003 s]
/proc/loadavg: 1.93 1.97 1.99 3/177 12584
/proc/meminfo: memFree=27239928/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=108168 CPUtime=51.08 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 27478 0 0 0 5099 9 0 0 20 0 1 0 341048808 110764032 26189 33554432000 134512640 135840783 4293233248 4293232608 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 27042 26190 347 325 0 25978 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 108168

[startup+102.306 s]
/proc/loadavg: 2.05 1.99 1.99 3/177 12584
/proc/meminfo: memFree=27095264/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=179116 CPUtime=102.27 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 45224 0 0 0 10213 14 0 0 20 0 1 0 341048808 183414784 43935 33554432000 134512640 135840783 4293233248 4293232384 11328228 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 44779 43935 347 325 0 43715 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 179116

[startup+162.3 s]
/proc/loadavg: 2.02 1.99 1.99 3/178 12587
/proc/meminfo: memFree=27025332/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=232580 CPUtime=162.22 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 58626 0 0 0 16201 21 0 0 20 0 1 0 341048808 238161920 57296 33554432000 134512640 135840783 4293233248 4293232608 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 58145 57296 347 325 0 57081 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 232580

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12587
/proc/meminfo: memFree=26987068/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=271092 CPUtime=222.16 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 68311 0 0 0 22190 26 0 0 20 0 1 0 341048808 277598208 66934 33554432000 134512640 135840783 4293233248 4293227440 134547671 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 67773 66934 347 325 0 66709 0
Current children cumulated CPU time (s) 222.16
Current children cumulated vsize (KiB) 271092

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26929064/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=326556 CPUtime=282.09 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 82220 0 0 0 28177 32 0 0 20 0 1 0 341048808 334393344 80795 33554432000 134512640 135840783 4293233248 4293232536 1419469 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 81639 80795 347 325 0 80575 0
Current children cumulated CPU time (s) 282.09
Current children cumulated vsize (KiB) 326556

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26855704/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=388456 CPUtime=342.05 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 97747 0 0 0 34166 39 0 0 20 0 1 0 341048808 397778944 96284 33554432000 134512640 135840783 4293233248 4293232608 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 97114 96284 347 325 0 96050 0
Current children cumulated CPU time (s) 342.05
Current children cumulated vsize (KiB) 388456

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26798292/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=445812 CPUtime=402.03 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 112066 0 0 0 40159 44 0 0 20 0 1 0 341048808 456511488 110603 33554432000 134512640 135840783 4293233248 4293232608 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 111453 110603 347 325 0 110389 0
Current children cumulated CPU time (s) 402.03
Current children cumulated vsize (KiB) 445812

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26740796/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=483060 CPUtime=462.02 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 121373 0 0 0 46154 48 0 0 20 0 1 0 341048808 494653440 119910 33554432000 134512640 135840783 4293233248 4293232608 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 120765 119910 347 325 0 119701 0
Current children cumulated CPU time (s) 462.02
Current children cumulated vsize (KiB) 483060

[startup+522.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12588
/proc/meminfo: memFree=26660460/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=514832 CPUtime=522.01 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 129547 0 0 0 52149 52 0 0 20 0 1 0 341048808 527187968 127865 33554432000 134512640 135840783 4293233248 4293232672 134546079 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 128708 127865 347 325 0 127644 0
Current children cumulated CPU time (s) 522.01
Current children cumulated vsize (KiB) 514832

[startup+582.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 12589
/proc/meminfo: memFree=26636900/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=514832 CPUtime=582 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 129547 0 0 0 58148 52 0 0 20 0 1 0 341048808 527187968 127865 33554432000 134512640 135840783 4293233248 4293232608 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 128708 127865 347 325 0 127644 0
Current children cumulated CPU time (s) 582
Current children cumulated vsize (KiB) 514832

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26635952/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=514832 CPUtime=881.89 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 129618 0 0 0 88137 52 0 0 20 0 1 0 341048808 527187968 127865 33554432000 134512640 135840783 4293233248 4293232608 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 128708 127865 347 325 0 127644 0
Current children cumulated CPU time (s) 881.89
Current children cumulated vsize (KiB) 514832

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26596644/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=555104 CPUtime=941.88 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 139706 0 0 0 94132 56 0 0 20 0 1 0 341048808 568426496 137953 33554432000 134512640 135840783 4293233248 4293232608 134551347 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 138776 137953 347 325 0 137712 0
Current children cumulated CPU time (s) 941.88
Current children cumulated vsize (KiB) 555104

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26541664/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=609924 CPUtime=1001.87 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 153391 0 0 0 100125 62 0 0 20 0 1 0 341048808 624562176 151638 33554432000 134512640 135840783 4293233248 4293232608 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 152481 151638 347 325 0 151417 0
Current children cumulated CPU time (s) 1001.87
Current children cumulated vsize (KiB) 609924

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26498760/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=653128 CPUtime=1061.86 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 164199 0 0 0 106120 66 0 0 20 0 1 0 341048808 668803072 162446 33554432000 134512640 135840783 4293233248 4293232608 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 163282 162446 347 325 0 162218 0
Current children cumulated CPU time (s) 1061.86
Current children cumulated vsize (KiB) 653128

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12615
/proc/meminfo: memFree=26459948/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=691280 CPUtime=1121.85 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 173740 0 0 0 112115 70 0 0 20 0 1 0 341048808 707870720 171987 33554432000 134512640 135840783 4293233248 4293232548 11336311 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 172820 171987 347 325 0 171756 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 691280

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12615
/proc/meminfo: memFree=26425732/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=726104 CPUtime=1181.84 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 182426 0 0 0 118110 74 0 0 20 0 1 0 341048808 743530496 180673 33554432000 134512640 135840783 4293233248 4293232608 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 181526 180673 347 325 0 180462 0
Current children cumulated CPU time (s) 1181.84
Current children cumulated vsize (KiB) 726104

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12616
/proc/meminfo: memFree=26383564/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=767528 CPUtime=1241.83 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 192780 0 0 0 124105 78 0 0 20 0 1 0 341048808 785948672 191027 33554432000 134512640 135840783 4293233248 4293232608 134550782 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 191882 191027 347 325 0 190818 0
Current children cumulated CPU time (s) 1241.83
Current children cumulated vsize (KiB) 767528

[startup+1302.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 12616
/proc/meminfo: memFree=26342760/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1301.83 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 202943 0 0 0 130100 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134551797 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1301.83
Current children cumulated vsize (KiB) 807192

[startup+1362.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 12619
/proc/meminfo: memFree=26342748/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1361.77 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 202989 0 0 0 136094 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134550921 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1361.77
Current children cumulated vsize (KiB) 807192

[startup+1422.31 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 12619
/proc/meminfo: memFree=26342692/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1421.72 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203037 0 0 0 142089 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134551285 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1421.72
Current children cumulated vsize (KiB) 807192

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12619
/proc/meminfo: memFree=26342792/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1481.66 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 148083 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1481.66
Current children cumulated vsize (KiB) 807192

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1541.65 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 154082 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1541.65
Current children cumulated vsize (KiB) 807192

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26343040/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1601.64 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 160081 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1601.64
Current children cumulated vsize (KiB) 807192

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12620
/proc/meminfo: memFree=26343040/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1661.63 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 166080 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1661.63
Current children cumulated vsize (KiB) 807192

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12620
/proc/meminfo: memFree=26343164/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1721.62 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 172079 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232484 11325469 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1721.62
Current children cumulated vsize (KiB) 807192

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=26342916/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1781.61 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 178078 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293232608 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1781.61
Current children cumulated vsize (KiB) 807192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 2/175 12622
/proc/meminfo: memFree=26645472/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1800.02 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 179919 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293229780 11317602 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 807192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 2/175 12622
/proc/meminfo: memFree=26645472/32873844 swapFree=6608/6608
[pid=12583] ppid=12581 vsize=807192 CPUtime=1800.02 cores=0,2,4,6
/proc/12583/stat : 12583 (bsolo3.0.17) R 12581 12583 12501 0 -1 4202496 203080 0 0 0 179919 83 0 0 20 0 1 0 341048808 826564608 200951 33554432000 134512640 135840783 4293233248 4293229780 11317602 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12583/statm: 201798 200951 347 325 0 200734 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 807192

Child status: 15
Real time (s): 1800.72
CPU time (s): 1800.04
CPU user time (s): 1799.2
CPU system time (s): 0.837872
CPU usage (%): 99.9623
Max. virtual memory (cumulated for all children) (KiB): 808132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.2
system time used= 0.837872
maximum resident set size= 804744
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 203083
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 394
involuntary context switches= 1964

runsolver used 3.47147 second user time and 8.74367 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-03 20:47:24
IDJOB=3739688
IDBENCH=74121
IDSOLVER=2318
FILE ID=node140/3739688-1338749244
RUNJOBID= node140-1338749243-12517
PBS_JOBID= 14636796
Free space on /tmp= 70604 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12047_6-sat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739688-1338749244/watcher-3739688-1338749244 -o /tmp/evaluation-result-3739688-1338749244/solver-3739688-1338749244 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739688-1338749244.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 937ecf63c168ba3c2555061c1a7466e0
RANDOM SEED=929261162

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27436956 kB
Buffers:          504264 kB
Cached:          3979844 kB
SwapCached:         1620 kB
Active:          1538876 kB
Inactive:        2969040 kB
Active(anon):      16728 kB
Inactive(anon):     9476 kB
Active(file):    1522148 kB
Inactive(file):  2959564 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:             18700 kB
Writeback:             0 kB
AnonPages:         28568 kB
Mapped:            12080 kB
Shmem:                 8 kB
Slab:             789400 kB
SReclaimable:     230564 kB
SUnreclaim:       558836 kB
KernelStack:        1472 kB
PageTables:         3712 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     139384 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70596 MiB
End job on node140 at 2012-06-03 21:17:27