Trace number 3742256

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.06 1802.75

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K199.opb
MD5SUM2cd10947adfbc402d943437a9cfa9f95
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables23681
Total number of constraints24081
Number of constraints which are clauses23882
Number of constraints which are cardinality constraints (but not clauses)199
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint199
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742256-1338768711.opb
0.00/0.00	c File size is 1645508 bytes.
0.08/0.15	c Highest Coefficient sum: 200
0.08/0.15	c Parsing was ok!!
0.08/0.15	c Total parsing time: 0.149 s
0.08/0.16	c Var: 23681 Constr: 24081 23882/199/0 Lit: 154997 Watch. Lit: 71443
0.08/0.16	c Obj. Vars: 0 (0 % of total variables)
10.68/10.70	c Pre-processing Time: 10.698 s
10.68/10.70	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
10.68/10.70	c        0  22103    22609   148310    6    68079  202903      0      0 10.70
10.68/10.70	c Switching off LPR mode.
1800.01/1800.71	c      100  22103    22709   159897    7    68279  223194    100      9 10.74
1800.01/1800.71	c      250  22103    22859   185358    8    68579  245514    250     22 10.89
1800.01/1800.71	c      475  22103    23084   215210    9    69029  270066    475     42 11.10
1800.01/1800.71	c      813  22103    23422   227908    9    69705  297073    813     70 11.47
1800.01/1800.71	c     1323  22103    23932   261751   10    70725  326781   1323    110 11.97
1800.01/1800.71	c     2086  22103    24695   314108   12    72251  359460   2086    160 12.96
1800.01/1800.71	c     3232  22103    25841   395013   15    74543  395407   3232    223 14.49
1800.01/1800.71	c     4953  22103    27562   564681   20    77985  434948   4953    298 16.57
1800.01/1800.71	c     7537  22103    30146   961690   31    83153  478443   7537    388 19.38
1800.01/1800.71	c    11416  22103    34025  1441181   42    90911  526288  11416    452 25.26
1800.01/1800.71	c    17239  22103    39848  2235730   56   102557  578917  17239    484 35.56
1800.01/1800.71	c    25980  22103    48589  4854919   99   120039  636809  25980    529 49.09
1800.01/1800.71	c    39090  22103    61699  8011522  129   146259  700490  39090    479 81.51
1800.01/1800.71	c    58760  22103    81369 15043119  184   185599  770540  58760    438 134.00
1800.01/1800.71	c    88270  22103   110879 25307989  228   244619  847595  88270    351 251.24
1800.01/1800.71	c   132540  22103   155149 48281377  311   333159  932355 132540    273 484.45
1800.01/1800.71	c   198951  22103   221560 83770742  378   465981  500000 198951    203 979.68
1800.01/1800.71	c Caught signal: 15
1800.01/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.01/1800.71	c   17   291355 187518 25108165   313964 131340549 291355    161 1800.02
1800.01/1800.71	s UNKNOWN
1800.01/1800.71	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742256-1338768711/watcher-3742256-1338768711 -o /tmp/evaluation-result-3742256-1338768711/solver-3742256-1338768711 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742256-1338768711.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.94 2.00 1.99 3/176 7856
/proc/meminfo: memFree=27075768/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=20180 CPUtime=0 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 394 0 0 0 0 0 0 0 20 0 1 0 342996745 20664320 332 33554432000 134512640 135840783 4292993472 4292993084 1309456 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 5045 346 314 325 0 3981 0

[startup+0.027091 s]
/proc/loadavg: 1.94 2.00 1.99 3/176 7856
/proc/meminfo: memFree=27075768/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=7980 CPUtime=0.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 980 0 0 0 1 0 0 0 20 0 1 0 342996745 8171520 877 33554432000 134512640 135840783 4292993472 4292992128 1582375 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 1995 877 381 325 0 529 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 7980

[startup+0.100251 s]
/proc/loadavg: 1.94 2.00 1.99 3/176 7856
/proc/meminfo: memFree=27075768/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=10436 CPUtime=0.08 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 1786 0 0 0 8 0 0 0 20 0 1 0 342996745 10686464 1683 33554432000 134512640 135840783 4292993472 4292992512 134545942 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 2609 1683 584 325 0 1143 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 10436

[startup+0.300249 s]
/proc/loadavg: 1.94 2.00 1.99 3/176 7856
/proc/meminfo: memFree=27075768/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=13700 CPUtime=0.28 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3082 0 0 0 28 0 0 0 20 0 1 0 342996745 14028800 2577 33554432000 134512640 135840783 4292993472 4292708240 134550544 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3425 2577 344 325 0 2361 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 13700

[startup+0.700262 s]
/proc/loadavg: 1.94 2.00 1.99 3/176 7856
/proc/meminfo: memFree=27075768/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=13700 CPUtime=0.69 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3082 0 0 0 68 1 0 0 20 0 1 0 342996745 14028800 2577 33554432000 134512640 135840783 4292993472 4292708240 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3425 2577 344 325 0 2361 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 13700

[startup+1.50026 s]
/proc/loadavg: 1.94 2.00 1.99 3/177 7857
/proc/meminfo: memFree=27064360/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=13700 CPUtime=1.49 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3084 0 0 0 148 1 0 0 20 0 1 0 342996745 14028800 2579 33554432000 134512640 135840783 4292993472 4292708016 1579934 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3425 2579 344 325 0 2361 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 13700

[startup+3.10025 s]
/proc/loadavg: 1.94 2.00 1.99 3/177 7857
/proc/meminfo: memFree=27062624/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=13700 CPUtime=3.09 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3084 0 0 0 308 1 0 0 20 0 1 0 342996745 14028800 2579 33554432000 134512640 135840783 4292993472 4292708240 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3425 2579 344 325 0 2361 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 13700

[startup+6.30027 s]
/proc/loadavg: 1.95 2.00 1.99 3/177 7857
/proc/meminfo: memFree=27056796/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=13700 CPUtime=6.28 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3085 0 0 0 627 1 0 0 20 0 1 0 342996745 14028800 2580 33554432000 134512640 135840783 4292993472 4292708240 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3425 2580 344 325 0 2361 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 13700

[startup+12.7002 s]
/proc/loadavg: 1.95 2.00 1.99 3/177 7857
/proc/meminfo: memFree=27046832/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=15972 CPUtime=12.68 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 3924 0 0 0 1266 2 0 0 20 0 1 0 342996745 16355328 3186 33554432000 134512640 135840783 4292993472 4292992688 134575064 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 3993 3186 349 325 0 2929 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 15972

[startup+25.5003 s]
/proc/loadavg: 1.96 2.00 1.99 3/177 7857
/proc/meminfo: memFree=27015444/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=31720 CPUtime=25.48 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 7877 0 0 0 2545 3 0 0 20 0 1 0 342996745 32481280 7139 33554432000 134512640 135840783 4292993472 4292991200 134575118 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 7930 7139 349 325 0 6866 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 31720

[startup+51.1003 s]
/proc/loadavg: 1.97 2.00 1.99 3/177 7857
/proc/meminfo: memFree=26940252/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=78712 CPUtime=51.07 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 19633 0 0 0 5102 5 0 0 20 0 1 0 342996745 80601088 18895 33554432000 134512640 135840783 4292993472 4292992768 134572899 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 19678 18895 349 325 0 18614 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 78712

[startup+102.306 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 7857
/proc/meminfo: memFree=26802904/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=158900 CPUtime=102.27 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 39671 0 0 0 10217 10 0 0 20 0 1 0 342996745 162713600 38933 33554432000 134512640 135840783 4292993472 4292974944 134586540 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 39725 38933 349 325 0 38661 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 158900

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 7857
/proc/meminfo: memFree=26658348/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=241156 CPUtime=162.26 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 60218 0 0 0 16210 16 0 0 20 0 1 0 342996745 246943744 59480 33554432000 134512640 135840783 4292993472 4292992748 1207039 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 60289 59480 349 325 0 59225 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 241156

[startup+222.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 7858
/proc/meminfo: memFree=26527184/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=312952 CPUtime=222.25 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 78194 0 0 0 22204 21 0 0 20 0 1 0 342996745 320462848 77456 33554432000 134512640 135840783 4292993472 4292992608 1579707 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 78238 77456 349 325 0 77174 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 312952

[startup+282.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 7858
/proc/meminfo: memFree=26341336/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=430328 CPUtime=282.24 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 107531 0 0 0 28195 29 0 0 20 0 1 0 342996745 440655872 106793 33554432000 134512640 135840783 4292993472 4292990112 134574704 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 107582 106793 349 325 0 106518 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 430328

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/177 7858
/proc/meminfo: memFree=26220464/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=491508 CPUtime=342.23 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 122820 0 0 0 34191 32 0 0 20 0 1 0 342996745 503304192 122082 33554432000 134512640 135840783 4292993472 4292992832 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 122877 122082 349 325 0 121813 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 491508

[startup+402.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 7858
/proc/meminfo: memFree=26119308/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=527024 CPUtime=402.22 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 131689 0 0 0 40186 36 0 0 20 0 1 0 342996745 539672576 130951 33554432000 134512640 135840783 4292993472 4292992832 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 131756 130951 349 325 0 130692 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 527024

[startup+462.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 7858
/proc/meminfo: memFree=25980456/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=611280 CPUtime=462.21 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 152765 0 0 0 46180 41 0 0 20 0 1 0 342996745 625950720 152027 33554432000 134512640 135840783 4292993472 4292992784 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 152820 152027 349 325 0 151756 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 611280

[startup+522.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/178 7862
/proc/meminfo: memFree=25863296/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=674948 CPUtime=522.2 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 168696 0 0 0 52174 46 0 0 20 0 1 0 342996745 691146752 167958 33554432000 134512640 135840783 4292993472 4292992832 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 168737 167958 349 325 0 167673 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 674948

[startup+582.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 7862
/proc/meminfo: memFree=25745532/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=723508 CPUtime=582.19 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 180808 0 0 0 58170 49 0 0 20 0 1 0 342996745 740872192 180070 33554432000 134512640 135840783 4292993472 4292992832 134550878 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 180877 180070 349 325 0 179813 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 723508

[startup+642.3 s]

################
# More data... #
################

/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 288467 0 0 0 106135 76 0 0 20 0 1 0 342996745 1181794304 287721 33554432000 134512640 135840783 4292993472 4292992824 9115856 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 288524 287721 349 325 0 287460 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 1154096

[startup+1122.3 s]
/proc/loadavg: 1.97 1.98 1.99 3/178 7906
/proc/meminfo: memFree=27066056/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1223876 CPUtime=1122.07 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 305953 0 0 0 112127 80 0 0 20 0 1 0 342996745 1253249024 305168 33554432000 134512640 135840783 4292993472 4292992784 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 305969 305168 349 325 0 304905 0
Current children cumulated CPU time (s) 1122.07
Current children cumulated vsize (KiB) 1223876

[startup+1182.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7906
/proc/meminfo: memFree=26923244/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1253356 CPUtime=1182.02 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 313371 0 0 0 118120 82 0 0 20 0 1 0 342996745 1283436544 312542 33554432000 134512640 135840783 4292993472 4292992704 1207042 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 313339 312542 349 325 0 312275 0
Current children cumulated CPU time (s) 1182.02
Current children cumulated vsize (KiB) 1253356

[startup+1242.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7906
/proc/meminfo: memFree=26802000/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1288364 CPUtime=1241.98 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 322183 0 0 0 124114 84 0 0 20 0 1 0 342996745 1319284736 321315 33554432000 134512640 135840783 4292993472 4292992832 134551063 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 322091 321315 349 325 0 321027 0
Current children cumulated CPU time (s) 1241.98
Current children cumulated vsize (KiB) 1288364

[startup+1302.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7906
/proc/meminfo: memFree=26618632/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1334780 CPUtime=1301.94 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 333784 0 0 0 130107 87 0 0 20 0 1 0 342996745 1366814720 332888 33554432000 134512640 135840783 4292993472 4292992832 134550863 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 333695 332888 349 325 0 332631 0
Current children cumulated CPU time (s) 1301.94
Current children cumulated vsize (KiB) 1334780

[startup+1362.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/176 7906
/proc/meminfo: memFree=26470364/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1393188 CPUtime=1361.89 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 348436 0 0 0 136099 90 0 0 20 0 1 0 342996745 1426624512 347497 33554432000 134512640 135840783 4292993472 4292992832 134551312 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 348297 347497 349 325 0 347233 0
Current children cumulated CPU time (s) 1361.89
Current children cumulated vsize (KiB) 1393188

[startup+1422.31 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7908
/proc/meminfo: memFree=26344896/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1445748 CPUtime=1421.85 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 361616 0 0 0 142093 92 0 0 20 0 1 0 342996745 1480445952 360647 33554432000 134512640 135840783 4292993472 4292992832 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 361437 360647 349 325 0 360373 0
Current children cumulated CPU time (s) 1421.85
Current children cumulated vsize (KiB) 1445748

[startup+1482.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7908
/proc/meminfo: memFree=26214228/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1504220 CPUtime=1481.81 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 376265 0 0 0 148084 97 0 0 20 0 1 0 342996745 1540321280 375262 33554432000 134512640 135840783 4292993472 4292992784 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 376055 375262 349 325 0 374991 0
Current children cumulated CPU time (s) 1481.81
Current children cumulated vsize (KiB) 1504220

[startup+1542.3 s]
/proc/loadavg: 2.07 2.00 2.00 3/177 7908
/proc/meminfo: memFree=26106252/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1527712 CPUtime=1541.76 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 382184 0 0 0 154078 98 0 0 20 0 1 0 342996745 1564377088 381148 33554432000 134512640 135840783 4292993472 4292992832 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 381928 381148 349 325 0 380864 0
Current children cumulated CPU time (s) 1541.76
Current children cumulated vsize (KiB) 1527712

[startup+1602.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 7908
/proc/meminfo: memFree=25948924/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1580000 CPUtime=1601.73 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 395274 0 0 0 160072 101 0 0 20 0 1 0 342996745 1617920000 394217 33554432000 134512640 135840783 4292993472 4292992832 134550741 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 395000 394217 349 325 0 393936 0
Current children cumulated CPU time (s) 1601.73
Current children cumulated vsize (KiB) 1580000

[startup+1662.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 7908
/proc/meminfo: memFree=25805856/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1625520 CPUtime=1661.7 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 406678 0 0 0 166067 103 0 0 20 0 1 0 342996745 1664532480 405599 33554432000 134512640 135840783 4292993472 4292992832 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 406380 405599 349 325 0 405316 0
Current children cumulated CPU time (s) 1661.7
Current children cumulated vsize (KiB) 1625520

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7912
/proc/meminfo: memFree=25686092/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1666760 CPUtime=1721.66 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 417017 0 0 0 172059 107 0 0 20 0 1 0 342996745 1706762240 415899 33554432000 134512640 135840783 4292993472 4292992832 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 416690 415899 349 325 0 415626 0
Current children cumulated CPU time (s) 1721.66
Current children cumulated vsize (KiB) 1666760

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7912
/proc/meminfo: memFree=25566592/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1703132 CPUtime=1781.61 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 426154 0 0 0 178051 110 0 0 20 0 1 0 342996745 1744007168 425008 33554432000 134512640 135840783 4292993472 4292992832 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 425783 425008 349 325 0 424719 0
Current children cumulated CPU time (s) 1781.61
Current children cumulated vsize (KiB) 1703132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7912
/proc/meminfo: memFree=25532584/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1713104 CPUtime=1800.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) R 7854 7856 5948 0 -1 4202496 428637 0 0 0 179890 111 0 0 20 0 1 0 342996745 1754218496 427478 33554432000 134512640 135840783 4292993472 4292992832 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 428276 427478 349 325 0 427212 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1713104

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -7856

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7912
/proc/meminfo: memFree=25532584/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1713104 CPUtime=1800.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) S 7854 7856 5948 0 -1 4202496 428638 0 0 0 179890 111 0 0 20 0 1 0 342996745 1754218496 427479 33554432000 134512640 135840783 4292993472 4292990948 4994096 0 16384 4096 16384 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 428276 427479 350 325 0 427212 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1713104

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 2/178 7913
/proc/meminfo: memFree=25530964/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1713104 CPUtime=1800.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) S 7854 7856 5948 0 -1 4202496 428638 0 0 0 179890 111 0 0 20 0 1 0 342996745 1754218496 427479 33554432000 134512640 135840783 4292993472 4292990948 4994096 0 16384 4096 16384 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 428276 427479 350 325 0 427212 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1713104

[startup+1802.6 s]
/proc/loadavg: 2.00 2.00 2.00 2/178 7913
/proc/meminfo: memFree=25530964/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1713104 CPUtime=1800.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) S 7854 7856 5948 0 -1 4202496 428638 0 0 0 179890 111 0 0 20 0 1 0 342996745 1754218496 427479 33554432000 134512640 135840783 4292993472 4292990948 4994096 0 16384 4096 16384 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 428276 427479 350 325 0 427212 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1713104

[startup+1802.7 s]
/proc/loadavg: 2.00 2.00 2.00 2/178 7913
/proc/meminfo: memFree=25530964/32873844 swapFree=7112/7112
[pid=7856] ppid=7854 vsize=1713104 CPUtime=1800.01 cores=0,2,4,6
/proc/7856/stat : 7856 (bsolo3.0.17) S 7854 7856 5948 0 -1 4202496 428638 0 0 0 179890 111 0 0 20 0 1 0 342996745 1754218496 427479 33554432000 134512640 135840783 4292993472 4292990948 4994096 0 16384 4096 16384 18446744071579510697 0 0 17 4 0 0 0 0 0
/proc/7856/statm: 428276 427479 350 325 0 427212 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1713104

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.75
CPU time (s): 1800.06
CPU user time (s): 1798.91
CPU system time (s): 1.14982
CPU usage (%): 99.8506
Max. virtual memory (cumulated for all children) (KiB): 1713104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.91
system time used= 1.14982
maximum resident set size= 1709916
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 428638
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 473
involuntary context switches= 2024

runsolver used 3.17152 second user time and 12.5151 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-04 02:11:51
IDJOB=3742256
IDBENCH=90145
IDSOLVER=2318
FILE ID=node119/3742256-1338768711
RUNJOBID= node119-1338748763-5964
PBS_JOBID= 14636790
Free space on /tmp= 70892 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K199.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742256-1338768711/watcher-3742256-1338768711 -o /tmp/evaluation-result-3742256-1338768711/solver-3742256-1338768711 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742256-1338768711.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2cd10947adfbc402d943437a9cfa9f95
RANDOM SEED=1341483831

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27075924 kB
Buffers:          429844 kB
Cached:          3141068 kB
SwapCached:         1936 kB
Active:          2890396 kB
Inactive:        2057028 kB
Active(anon):    1371640 kB
Inactive(anon):     6616 kB
Active(file):    1518756 kB
Inactive(file):  2050412 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:              8156 kB
Writeback:             0 kB
AnonPages:       1380960 kB
Mapped:            13108 kB
Shmem:                 0 kB
Slab:             705952 kB
SReclaimable:     148104 kB
SUnreclaim:       557848 kB
KernelStack:        1456 kB
PageTables:         6716 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1494700 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70884 MiB
End job on node119 at 2012-06-04 02:41:54