Trace number 3741193

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.02 1800.31

General information on the benchmark

Name/DEC-SMALLINT-LIN/heinz/
normalized-neos-820146.opb
MD5SUM04a6efcac49375b9407fbc5f15fae5c7
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables600
Total number of constraints830
Number of constraints which are clauses675
Number of constraints which are cardinality constraints (but not clauses)155
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint3
Maximum length of a constraint10
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 13
Number of bits of the biggest sum of numbers4
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741193-1338756535.opb
0.00/0.00	c File size is 31421 bytes.
0.00/0.00	c Highest Coefficient sum: 13
0.00/0.00	c Parsing was ok!!
0.00/0.00	c Total parsing time: 0.003 s
0.00/0.00	c Var: 600 Constr: 845 675/170/0 Lit: 3375 Watch. Lit: 2580
0.00/0.00	c Obj. Vars: 0 (0 % of total variables)
0.00/0.00	c Pre-processing Time: 0.005 s
0.00/0.00	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.00/0.00	c        0    375      800     2925    3     2130    2174      0      0 0.01
0.00/0.00	c Switching off LPR mode.
1800.01/1800.30	c      102    375      902     4892    5     2334    2392    102  14571 0.01
1800.01/1800.30	c      252    375     1052     7216    6     2634    2632    252  25200 0.01
1800.01/1800.30	c      478    375     1278    10813    8     3086    2896    478  29875 0.02
1800.01/1800.30	c      817    375     1617    19936   12     3764    3186    817  29178 0.03
1800.01/1800.30	c     1325    375     2125    34955   16     4780    3505   1325  27040 0.05
1800.01/1800.30	c     2090    375     2890    55712   19     6310    3856   2090  23222 0.09
1800.01/1800.30	c     3236    375     4036    90965   22     8602    4242   3236  17491 0.18
1800.01/1800.30	c     4959    375     3148    66781   21     6826    4667   2348  13774 0.36
1800.01/1800.30	c     7545    375     3134    87332   27     6798    5134   2334  10934 0.69
1800.01/1800.30	c    11427    375     4100   177120   43     8730    5648   3300   8081 1.41
1800.01/1800.30	c    17249    375     6632   275723   41    13794    6213   5832   6003 2.87
1800.01/1800.30	c    25988    375     4775   277507   58    10080    6835   3975   5452 4.77
1800.01/1800.30	c    39098    375     6547   315250   48    13624    7519   5747   4688 8.34
1800.01/1800.30	c    58769    375     5359   280860   52    11248    8271   4559   3893 15.10
1800.01/1800.30	c    88280    375     7729   464472   60    15988    9099   6929   3552 24.85
1800.01/1800.30	c   132555    375     7545   540013   71    15620   10009   6745   2906 45.61
1800.01/1800.30	c   198967    375     9245   526026   56    19020   11010   8445   2702 73.63
1800.01/1800.30	c   298592    375     9079   675677   74    18688   12112   8279   2575 115.94
1800.01/1800.30	c   448027    375    10921   736395   67    22372   13324  10121   2391 187.31
1800.01/1800.30	c   672192    375    10356   674575   65    21242   14657   9556   2228 301.61
1800.01/1800.30	c  1008435    375    14576  1045112   71    29682   16123  13776   2164 465.95
1800.01/1800.30	c  1512806    375    11871   732805   61    24272   17736  11071   2080 727.27
1800.01/1800.30	c  2269369    375    11129   875262   78    22788   19510  10329   1913 1185.92
1800.01/1800.30	c Caught signal: 15
1800.01/1800.30	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.01/1800.30	c   23  3229889 636093  4647319    18527  1280268  17727   1794 1800.02
1800.01/1800.30	s UNKNOWN
1800.01/1800.30	c Total time: 1800.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741193-1338756535/watcher-3741193-1338756535 -o /tmp/evaluation-result-3741193-1338756535/solver-3741193-1338756535 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741193-1338756535.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 12696
/proc/meminfo: memFree=27467652/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=4720 CPUtime=0 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 472 0 0 0 0 0 0 0 20 0 1 0 341779368 4833280 408 33554432000 134512640 135840783 4294328768 4294327568 1582375 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 1180 408 329 325 0 108 0

[startup+0.0537611 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 12696
/proc/meminfo: memFree=27467652/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=5356 CPUtime=0.05 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 671 0 0 0 5 0 0 0 20 0 1 0 341779368 5484544 599 33554432000 134512640 135840783 4294328768 4294328240 134552299 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 1339 599 348 325 0 275 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 5356

[startup+0.100143 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 12696
/proc/meminfo: memFree=27467652/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=5748 CPUtime=0.09 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 770 0 0 0 9 0 0 0 20 0 1 0 341779368 5885952 698 33554432000 134512640 135840783 4294328768 4294327904 1582375 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 1437 699 348 325 0 373 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5748

[startup+0.300102 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 12696
/proc/meminfo: memFree=27467652/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=6916 CPUtime=0.29 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 1054 0 0 0 29 0 0 0 20 0 1 0 341779368 7081984 982 33554432000 134512640 135840783 4294328768 4294327744 134573452 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 1729 982 348 325 0 665 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 6916

[startup+0.700099 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 12696
/proc/meminfo: memFree=27467652/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=7556 CPUtime=0.69 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 1216 0 0 0 69 0 0 0 20 0 1 0 341779368 7737344 1144 33554432000 134512640 135840783 4294328768 4294327548 7368694 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 1889 1144 348 325 0 825 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7556

[startup+1.5001 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27412728/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=8976 CPUtime=1.49 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 1571 0 0 0 149 0 0 0 20 0 1 0 341779368 9191424 1499 33554432000 134512640 135840783 4294328768 4294328072 6981804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 2244 1499 348 325 0 1180 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 8976

[startup+3.1001 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27368568/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=9372 CPUtime=3.09 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 1677 0 0 0 309 0 0 0 20 0 1 0 341779368 9596928 1605 33554432000 134512640 135840783 4294328768 4294328128 134551104 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 2343 1605 348 325 0 1279 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 9372

[startup+6.30018 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27366732/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=11432 CPUtime=6.29 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 2190 0 0 0 629 0 0 0 20 0 1 0 341779368 11706368 2118 33554432000 134512640 135840783 4294328768 4294328128 134551084 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 2858 2118 348 325 0 1794 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 11432

[startup+12.7002 s]
/proc/loadavg: 1.93 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27364920/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=12720 CPUtime=12.69 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 2527 0 0 0 1269 0 0 0 20 0 1 0 341779368 13025280 2455 33554432000 134512640 135840783 4294328768 4294328080 7377444 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 3180 2455 348 325 0 2116 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 12720

[startup+25.5002 s]
/proc/loadavg: 1.95 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27364280/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=13468 CPUtime=25.49 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 2702 0 0 0 2549 0 0 0 20 0 1 0 341779368 13791232 2630 33554432000 134512640 135840783 4294328768 4294325984 1582375 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 3367 2630 348 325 0 2303 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 13468

[startup+51.1002 s]
/proc/loadavg: 1.96 1.98 1.99 3/177 12697
/proc/meminfo: memFree=27361644/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=16284 CPUtime=51.08 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 3416 0 0 0 5108 0 0 0 20 0 1 0 341779368 16674816 3344 33554432000 134512640 135840783 4294328768 4294328128 134550808 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 4071 3344 348 325 0 3007 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 16284

[startup+102.307 s]
/proc/loadavg: 2.04 2.00 2.00 3/178 12700
/proc/meminfo: memFree=27363792/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=17536 CPUtime=102.28 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 3711 0 0 0 10228 0 0 0 20 0 1 0 341779368 17956864 3639 33554432000 134512640 135840783 4294328768 4294328120 6981840 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 4384 3639 348 325 0 3320 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 17536

[startup+162.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 12701
/proc/meminfo: memFree=27342420/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=20124 CPUtime=162.26 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 4388 0 0 0 16226 0 0 0 20 0 1 0 341779368 20606976 4306 33554432000 134512640 135840783 4294328768 4294328128 134551048 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5031 4306 348 325 0 3967 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 20124

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12701
/proc/meminfo: memFree=27300136/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22424 CPUtime=222.25 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 4973 0 0 0 22225 0 0 0 20 0 1 0 341779368 22962176 4867 33554432000 134512640 135840783 4294328768 4294328128 134551532 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5606 4867 348 325 0 4542 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 22424

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12701
/proc/meminfo: memFree=27274640/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22296 CPUtime=282.24 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 4973 0 0 0 28224 0 0 0 20 0 1 0 341779368 22831104 4849 33554432000 134512640 135840783 4294328768 4294328128 134551052 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5574 4849 348 325 0 4510 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 22296

[startup+342.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12701
/proc/meminfo: memFree=27257172/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22112 CPUtime=342.22 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 4977 0 0 0 34222 0 0 0 20 0 1 0 341779368 22642688 4803 33554432000 134512640 135840783 4294328768 4294328128 134550893 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5528 4803 348 325 0 4464 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 22112

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12701
/proc/meminfo: memFree=27242044/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22716 CPUtime=402.21 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 5113 0 0 0 40221 0 0 0 20 0 1 0 341779368 23261184 4939 33554432000 134512640 135840783 4294328768 4294328128 134550913 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5679 4939 348 325 0 4615 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 22716

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12702
/proc/meminfo: memFree=27223480/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22716 CPUtime=462.21 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 5113 0 0 0 46221 0 0 0 20 0 1 0 341779368 23261184 4939 33554432000 134512640 135840783 4294328768 4294328128 134550804 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5679 4939 348 325 0 4615 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 22716

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12702
/proc/meminfo: memFree=27209432/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=22716 CPUtime=522.2 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 5114 0 0 0 52220 0 0 0 20 0 1 0 341779368 23261184 4940 33554432000 134512640 135840783 4294328768 4294328128 134550764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 5679 4940 348 325 0 4615 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 22716

[startup+582.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 12702
/proc/meminfo: memFree=27188228/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=24980 CPUtime=582.19 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 5678 0 0 0 58219 0 0 0 20 0 1 0 341779368 25579520 5504 33554432000 134512640 135840783 4294328768 4294328128 134550884 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 6245 5504 348 325 0 5181 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 24980

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12729
/proc/meminfo: memFree=27110472/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=27720 CPUtime=882.15 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6374 0 0 0 88214 1 0 0 20 0 1 0 341779368 28385280 6196 33554432000 134512640 135840783 4294328768 4294326224 134547653 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 6930 6196 348 325 0 5866 0
Current children cumulated CPU time (s) 882.15
Current children cumulated vsize (KiB) 27720

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12729
/proc/meminfo: memFree=27098196/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=27720 CPUtime=942.14 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6374 0 0 0 94213 1 0 0 20 0 1 0 341779368 28385280 6196 33554432000 134512640 135840783 4294328768 4294328128 134550902 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 6930 6196 348 325 0 5866 0
Current children cumulated CPU time (s) 942.14
Current children cumulated vsize (KiB) 27720

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12729
/proc/meminfo: memFree=27084200/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28132 CPUtime=1002.13 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6536 0 0 0 100212 1 0 0 20 0 1 0 341779368 28807168 6298 33554432000 134512640 135840783 4294328768 4294328128 134551426 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7033 6298 348 325 0 5969 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 28132

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12729
/proc/meminfo: memFree=27072844/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28072 CPUtime=1062.12 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6537 0 0 0 106211 1 0 0 20 0 1 0 341779368 28745728 6293 33554432000 134512640 135840783 4294328768 4294327940 1577054 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7018 6293 348 325 0 5954 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 28072

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12730
/proc/meminfo: memFree=27060688/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28008 CPUtime=1122.11 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6537 0 0 0 112210 1 0 0 20 0 1 0 341779368 28680192 6277 33554432000 134512640 135840783 4294328768 4294328128 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7002 6277 348 325 0 5938 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 28008

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12730
/proc/meminfo: memFree=27047296/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28220 CPUtime=1182.1 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6615 0 0 0 118209 1 0 0 20 0 1 0 341779368 28897280 6330 33554432000 134512640 135840783 4294328768 4294328004 1577100 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7055 6330 348 325 0 5991 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 28220

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12730
/proc/meminfo: memFree=27033780/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28228 CPUtime=1242.09 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6649 0 0 0 124208 1 0 0 20 0 1 0 341779368 28905472 6332 33554432000 134512640 135840783 4294328768 4294328128 134550872 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7057 6332 348 325 0 5993 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 28228

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12733
/proc/meminfo: memFree=27017776/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28220 CPUtime=1302.09 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6649 0 0 0 130208 1 0 0 20 0 1 0 341779368 28897280 6330 33554432000 134512640 135840783 4294328768 4294328124 6981792 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7055 6330 348 325 0 5991 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 28220

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12733
/proc/meminfo: memFree=27007080/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28220 CPUtime=1362.07 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6649 0 0 0 136206 1 0 0 20 0 1 0 341779368 28897280 6330 33554432000 134512640 135840783 4294328768 4294328080 134550902 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7055 6330 348 325 0 5991 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 28220

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12734
/proc/meminfo: memFree=26997284/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28216 CPUtime=1422.07 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6649 0 0 0 142206 1 0 0 20 0 1 0 341779368 28893184 6329 33554432000 134512640 135840783 4294328768 4294328128 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7054 6329 348 325 0 5990 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 28216

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12734
/proc/meminfo: memFree=26987612/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28776 CPUtime=1482.05 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6783 0 0 0 148204 1 0 0 20 0 1 0 341779368 29466624 6463 33554432000 134512640 135840783 4294328768 4294328128 134550823 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7194 6463 348 325 0 6130 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 28776

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12734
/proc/meminfo: memFree=26978684/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28776 CPUtime=1542.04 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6783 0 0 0 154203 1 0 0 20 0 1 0 341779368 29466624 6463 33554432000 134512640 135840783 4294328768 4294327900 1207039 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7194 6463 348 325 0 6130 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 28776

[startup+1602.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 12734
/proc/meminfo: memFree=26969140/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28776 CPUtime=1602.04 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6783 0 0 0 160203 1 0 0 20 0 1 0 341779368 29466624 6463 33554432000 134512640 135840783 4294328768 4294328128 134551058 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7194 6463 348 325 0 6130 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 28776

[startup+1662.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12734
/proc/meminfo: memFree=26957608/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28776 CPUtime=1662.03 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6783 0 0 0 166202 1 0 0 20 0 1 0 341779368 29466624 6463 33554432000 134512640 135840783 4294328768 4294326464 134586660 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7194 6463 348 325 0 6130 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 28776

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 12735
/proc/meminfo: memFree=26947316/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28776 CPUtime=1722.02 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6784 0 0 0 172201 1 0 0 20 0 1 0 341779368 29466624 6463 33554432000 134512640 135840783 4294328768 4294328128 134550779 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7194 6463 348 325 0 6130 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 28776

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12735
/proc/meminfo: memFree=26939812/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28772 CPUtime=1782.01 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6784 0 0 0 178200 1 0 0 20 0 1 0 341779368 29462528 6463 33554432000 134512640 135840783 4294328768 4294327956 1577044 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7193 6463 348 325 0 6129 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 28772



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 1.99 2.00 2.00 2/175 12736
/proc/meminfo: memFree=27522248/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28768 CPUtime=1800.01 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6784 0 0 0 180000 1 0 0 20 0 1 0 341779368 29458432 6463 33554432000 134512640 135840783 4294328768 4294328128 134551321 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7192 6463 348 325 0 6128 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 28768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.3 s]
/proc/loadavg: 1.99 2.00 2.00 2/175 12736
/proc/meminfo: memFree=27522248/32873648 swapFree=7112/7112
[pid=12696] ppid=12694 vsize=28768 CPUtime=1800.01 cores=1,3,5,7
/proc/12696/stat : 12696 (bsolo3.0.17) R 12694 12696 11604 0 -1 4202496 6784 0 0 0 180000 1 0 0 20 0 1 0 341779368 29458432 6463 33554432000 134512640 135840783 4294328768 4294328128 134551321 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/12696/statm: 7192 6463 348 325 0 6128 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 28768

Child status: 15
Real time (s): 1800.31
CPU time (s): 1800.02
CPU user time (s): 1800.01
CPU system time (s): 0.013997
CPU usage (%): 99.9841
Max. virtual memory (cumulated for all children) (KiB): 28800

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.01
system time used= 0.013997
maximum resident set size= 25852
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6787
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 1860

runsolver used 3.3095 second user time and 8.95564 second system time

The end

Launcher Data 

Begin job on node126 at 2012-06-03 22:48:55
IDJOB=3741193
IDBENCH=89818
IDSOLVER=2318
FILE ID=node126/3741193-1338756535
RUNJOBID= node126-1338747103-11621
PBS_JOBID= 14636777
Free space on /tmp= 70752 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/heinz/normalized-neos-820146.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741193-1338756535/watcher-3741193-1338756535 -o /tmp/evaluation-result-3741193-1338756535/solver-3741193-1338756535 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741193-1338756535.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 04a6efcac49375b9407fbc5f15fae5c7
RANDOM SEED=1312396835

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27468544 kB
Buffers:          429112 kB
Cached:          4016716 kB
SwapCached:         9476 kB
Active:          1689724 kB
Inactive:        2849948 kB
Active(anon):      83564 kB
Inactive(anon):    12168 kB
Active(file):    1606160 kB
Inactive(file):  2837780 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67094928 kB
Dirty:             46012 kB
Writeback:             0 kB
AnonPages:         91896 kB
Mapped:            38192 kB
Shmem:                 0 kB
Slab:             728732 kB
SReclaimable:     170844 kB
SUnreclaim:       557888 kB
KernelStack:        1464 kB
PageTables:         4192 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     207104 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70772 MiB
End job on node126 at 2012-06-03 23:18:57