Trace number 3707670

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.04 1798.52

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K152.opb
MD5SUM6abb89533e60aa1ed19663db7c40a868
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables18088
Total number of constraints18394
Number of constraints which are clauses18242
Number of constraints which are cardinality constraints (but not clauses)152
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint152
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 153
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707670-1338236229.opb
0.00/0.00	c File size is 1239431 bytes.
0.00/0.09	c Highest Coefficient sum: 153
0.00/0.09	c Parsing was ok!!
0.00/0.09	c Total parsing time: 0.096 s
0.09/0.10	c Var: 18088 Constr: 18394 18242/152/0 Lit: 118290 Watch. Lit: 54570
0.09/0.10	c Obj. Vars: 0 (0 % of total variables)
8.18/8.28	c Pre-processing Time: 8.284 s
8.18/8.28	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
8.18/8.28	c        0  16557    16969   111932    6    51300  154038      0      0 8.28
8.18/8.28	c Switching off lower bounding mode.
1797.91/1798.49	c      100  16557    17082   120355    7    52600  169442    113     11 8.37
1797.91/1798.49	c      250  16557    17248   141759    8    53951  186387    279     28 8.63
1797.91/1798.49	c      476  16557    17500   226559   12    54749  205026    531     51 9.21
1797.91/1798.49	c      814  16557    17882   316489   17    56248  225529    913     82 9.90
1797.91/1798.49	c     1322  16557    18500   427540   23    61402  248082   1531    120 10.95
1797.91/1798.49	c     2085  16557    19393   583389   30    68111  272891   2424    171 12.13
1797.91/1798.49	c     3232  16557    20747   816163   39    76023  300181   3778    226 14.27
1797.91/1798.49	c     4953  16557    22743  1322636   58    87013  330200   5774    274 18.04
1797.91/1798.49	c     7537  16557    25760  2286442   88   103239  363221   8791    301 25.01
1797.91/1798.49	c    11416  16557    30193  5781272  191   121494  399544  13224    246 46.29
1797.91/1798.49	c    17239  16557    37064  9928044  267   150886  439499  20095    231 74.40
1797.91/1798.49	c    25977  16557    46979 13865721  295   193059  483449  30010    232 111.54
1797.91/1798.49	c    39087  16557    62113 21907416  352   250695  531794  45144    206 189.72
1797.91/1798.49	c    58757  16557    84998 28030286  329   338876  584974  68029    197 297.49
1797.91/1798.49	c    88267  16557   118973 42654854  358   476874  643472 102004    164 537.01
1797.91/1798.49	c   132539  16557   170052 64284739  378   673798  707820 153083    136 971.67
1797.91/1798.49	c Reducing formula size due to memory constraints
1797.91/1798.49	c Memory Limit: 1000.00 MB  Used: 1020.17 MB
1797.91/1798.49	c   198949  16557    43962  5429598  123   145229   51728  26993    128 1553.86
1797.91/1798.49	c Resources Exceeded
1797.91/1798.49	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1797.91/1798.49	c   17   240869 160066 13448147    60397 25837906  43428    133 1798.02
1797.91/1798.49	s UNKNOWN
1797.91/1798.49	c Total time: 1798.02 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707670-1338236229/watcher-3707670-1338236229 -o /tmp/evaluation-result-3707670-1338236229/solver-3707670-1338236229 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707670-1338236229.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 4665
/proc/meminfo: memFree=31125872/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=20108 CPUtime=0 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 362 0 0 0 0 0 0 0 20 0 1 0 289748363 20590592 316 33554432000 134512640 137138936 4288495616 4288494084 136525300 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 5027 316 178 642 0 4080 0

[startup+0.103702 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 4665
/proc/meminfo: memFree=31125872/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17240 CPUtime=0.09 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2155 0 0 0 9 0 0 0 20 0 1 0 289748363 17653760 1806 33554432000 134512640 137138936 4288495616 4288494296 136506636 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4310 1809 182 642 0 3666 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17240

[startup+0.200255 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 4665
/proc/meminfo: memFree=31125872/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=0.19 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2268 0 0 0 19 0 0 0 20 0 1 0 289748363 18075648 1919 33554432000 134512640 137138936 4288495616 4288277072 134542480 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1919 184 642 0 3769 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 17652

[startup+0.300219 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 4665
/proc/meminfo: memFree=31125872/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=0.29 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2268 0 0 0 29 0 0 0 20 0 1 0 289748363 18075648 1919 33554432000 134512640 137138936 4288495616 4288276772 136500388 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1919 184 642 0 3769 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17652

[startup+0.700185 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 4665
/proc/meminfo: memFree=31125872/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=0.69 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2270 0 0 0 69 0 0 0 20 0 1 0 289748363 18075648 1921 33554432000 134512640 137138936 4288495616 4288277072 134542220 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1921 184 642 0 3769 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17652

[startup+1.50018 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4666
/proc/meminfo: memFree=31117300/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=1.49 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2270 0 0 0 149 0 0 0 20 0 1 0 289748363 18075648 1921 33554432000 134512640 137138936 4288495616 4288276856 136504096 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1921 184 642 0 3769 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 17652

[startup+3.10018 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4666
/proc/meminfo: memFree=31115936/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=3.09 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2271 0 0 0 309 0 0 0 20 0 1 0 289748363 18075648 1922 33554432000 134512640 137138936 4288495616 4288277072 134542613 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1922 184 642 0 3769 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 17652

[startup+6.30018 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4666
/proc/meminfo: memFree=31110592/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=17652 CPUtime=6.29 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 2272 0 0 0 629 0 0 0 20 0 1 0 289748363 18075648 1923 33554432000 134512640 137138936 4288495616 4288277072 134542480 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 4413 1923 184 642 0 3769 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 17652

[startup+12.7002 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4666
/proc/meminfo: memFree=31092768/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=24960 CPUtime=12.68 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 4298 0 0 0 1258 10 0 0 20 0 1 0 289748363 25559040 3771 33554432000 134512640 137138936 4288495616 4288494160 134607615 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 6240 3771 192 642 0 5596 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 24960

[startup+25.5002 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 4666
/proc/meminfo: memFree=31058140/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=47744 CPUtime=25.48 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 9988 0 0 0 2517 31 0 0 20 0 1 0 289748363 48889856 9461 33554432000 134512640 137138936 4288495616 4288476384 134602746 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 11936 9463 192 642 0 11292 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 47744

[startup+51.1003 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 4666
/proc/meminfo: memFree=30980856/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=101344 CPUtime=51.08 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 23411 0 0 0 5065 43 0 0 20 0 1 0 289748363 103776256 22884 33554432000 134512640 137138936 4288495616 4288494512 134542525 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 25336 22884 192 642 0 24692 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 101344

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4666
/proc/meminfo: memFree=30835200/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=189060 CPUtime=102.28 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 45324 0 0 0 10158 70 0 0 20 0 1 0 289748363 193597440 44797 33554432000 134512640 137138936 4288495616 4288494144 134603102 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 47265 44797 192 642 0 46621 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 189060

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4666
/proc/meminfo: memFree=30701060/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=263328 CPUtime=162.27 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 63898 0 0 0 16124 103 0 0 20 0 1 0 289748363 269647872 63371 33554432000 134512640 137138936 4288495616 4288494040 134606964 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 65832 63371 192 642 0 65188 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 263328

[startup+222.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 4669
/proc/meminfo: memFree=30550316/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=334024 CPUtime=222.26 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 81570 0 0 0 22099 127 0 0 20 0 1 0 289748363 342040576 81043 33554432000 134512640 137138936 4288495616 4288494732 136570369 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 83506 81043 192 642 0 82862 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 334024

[startup+282.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 4670
/proc/meminfo: memFree=30452280/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=372484 CPUtime=282.25 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 91187 0 0 0 28068 157 0 0 20 0 1 0 289748363 381423616 90660 33554432000 134512640 137138936 4288495616 4288494732 136570369 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 93121 90660 192 642 0 92477 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 372484

[startup+342.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4670
/proc/meminfo: memFree=30365516/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=409068 CPUtime=342.24 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 100320 0 0 0 34043 181 0 0 20 0 1 0 289748363 418885632 99793 33554432000 134512640 137138936 4288495616 4288494544 134542325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 102267 99793 192 642 0 101623 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 409068

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4670
/proc/meminfo: memFree=30273324/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=461256 CPUtime=402.22 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 113386 0 0 0 40023 199 0 0 20 0 1 0 289748363 472326144 112842 33554432000 134512640 137138936 4288495616 4288494544 134542835 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 115314 112842 192 642 0 114670 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 461256

[startup+462.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 4670
/proc/meminfo: memFree=30187816/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=508872 CPUtime=462.19 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 125332 0 0 0 46002 217 0 0 20 0 1 0 289748363 521084928 124745 33554432000 134512640 137138936 4288495616 4288494544 134542199 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 127218 124745 192 642 0 126574 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 508872

[startup+522.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 4670
/proc/meminfo: memFree=30087032/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=561124 CPUtime=522.15 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 138442 0 0 0 51985 230 0 0 20 0 1 0 289748363 574590976 137812 33554432000 134512640 137138936 4288495616 4288494544 134542199 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 140281 137812 192 642 0 139637 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 561124

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4671
/proc/meminfo: memFree=29994820/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=598608 CPUtime=582.12 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 147846 0 0 0 57965 247 0 0 20 0 1 0 289748363 612974592 147179 33554432000 134512640 137138936 4288495616 4288494544 134542770 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 149652 147179 192 642 0 149008 0
Current children cumulated CPU time (s) 582.12
Current children cumulated vsize (KiB) 598608

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=29373904/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=956460 CPUtime=1121.91 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 237511 0 0 0 111823 368 0 0 20 0 1 0 289748363 979415040 236654 33554432000 134512640 137138936 4288495616 4288494544 134542333 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 239115 236654 192 642 0 238471 0
Current children cumulated CPU time (s) 1121.91
Current children cumulated vsize (KiB) 956460

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4677
/proc/meminfo: memFree=29314012/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1017312 CPUtime=1181.9 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 252727 0 0 0 117817 373 0 0 20 0 1 0 289748363 1041727488 251870 33554432000 134512640 137138936 4288495616 4288494112 134618214 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 254328 251870 192 642 0 253684 0
Current children cumulated CPU time (s) 1181.9
Current children cumulated vsize (KiB) 1017312

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4677
/proc/meminfo: memFree=29270172/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1058188 CPUtime=1241.89 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 123814 375 0 0 20 0 1 0 289748363 1083584512 262106 33554432000 134512640 137138936 4288495616 4288494152 136504096 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264547 262106 192 642 0 263903 0
Current children cumulated CPU time (s) 1241.89
Current children cumulated vsize (KiB) 1058188

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4677
/proc/meminfo: memFree=29270576/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1058188 CPUtime=1301.88 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 129812 376 0 0 20 0 1 0 289748363 1083584512 262106 33554432000 134512640 137138936 4288495616 4288494224 134552483 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264547 262106 192 642 0 263903 0
Current children cumulated CPU time (s) 1301.88
Current children cumulated vsize (KiB) 1058188

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4677
/proc/meminfo: memFree=29270356/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1058188 CPUtime=1361.88 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 135800 388 0 0 20 0 1 0 289748363 1083584512 262106 33554432000 134512640 137138936 4288495616 4288494544 134542770 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264547 262106 192 642 0 263903 0
Current children cumulated CPU time (s) 1361.88
Current children cumulated vsize (KiB) 1058188

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 4680
/proc/meminfo: memFree=29270696/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1058188 CPUtime=1421.87 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 141767 420 0 0 20 0 1 0 289748363 1083584512 262106 33554432000 134512640 137138936 4288495616 4288494544 134542325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264547 262106 192 642 0 263903 0
Current children cumulated CPU time (s) 1421.87
Current children cumulated vsize (KiB) 1058188

[startup+1482.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 4681
/proc/meminfo: memFree=29271104/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1057692 CPUtime=1481.85 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 147744 441 0 0 20 0 1 0 289748363 1083076608 261985 33554432000 134512640 137138936 4288495616 4288494492 136511072 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264423 261985 192 642 0 263779 0
Current children cumulated CPU time (s) 1481.85
Current children cumulated vsize (KiB) 1057692

[startup+1542.31 s]
/proc/loadavg: 2.09 2.03 2.00 3/177 4681
/proc/meminfo: memFree=29271724/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1057692 CPUtime=1541.85 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 153708 477 0 0 20 0 1 0 289748363 1083076608 261985 33554432000 134512640 137138936 4288495616 4288494512 134542480 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264423 261985 192 642 0 263779 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 1057692

[startup+1602.3 s]
/proc/loadavg: 2.10 2.04 2.00 3/177 4681
/proc/meminfo: memFree=29272716/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1601.84 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 159662 522 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494544 134542516 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1601.84
Current children cumulated vsize (KiB) 1056616

[startup+1662.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/177 4719
/proc/meminfo: memFree=30230304/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1661.83 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 165638 545 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494040 134606663 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1661.83
Current children cumulated vsize (KiB) 1056616

[startup+1722.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 4719
/proc/meminfo: memFree=30155656/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1721.82 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 171625 557 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494112 134618214 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1721.82
Current children cumulated vsize (KiB) 1056616

[startup+1782.3 s]
/proc/loadavg: 2.10 2.04 2.01 3/177 4720
/proc/meminfo: memFree=30083744/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1781.81 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 177617 564 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494040 134606670 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1781.81
Current children cumulated vsize (KiB) 1056616

Solver just ended. Dumping a history of the last processes samples

[startup+1792.01 s]
/proc/loadavg: 2.08 2.04 2.01 3/177 4720
/proc/meminfo: memFree=30076048/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1791.52 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 178587 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494544 134542316 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1791.52
Current children cumulated vsize (KiB) 1056616

[startup+1795.2 s]
/proc/loadavg: 2.08 2.04 2.01 3/177 4720
/proc/meminfo: memFree=30072452/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1794.72 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 178907 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494160 134618927 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1794.72
Current children cumulated vsize (KiB) 1056616

[startup+1796.8 s]
/proc/loadavg: 2.07 2.04 2.00 3/177 4720
/proc/meminfo: memFree=30072080/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1796.31 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 179066 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494544 134542503 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1796.31
Current children cumulated vsize (KiB) 1056616

[startup+1797.6 s]
/proc/loadavg: 2.07 2.04 2.00 3/177 4720
/proc/meminfo: memFree=30071336/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1797.11 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 179146 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494040 134607134 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1797.11
Current children cumulated vsize (KiB) 1056616

[startup+1798 s]
/proc/loadavg: 2.07 2.04 2.00 3/177 4720
/proc/meminfo: memFree=30071336/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1797.51 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 179186 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494544 134542624 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1797.51
Current children cumulated vsize (KiB) 1056616

[startup+1798.4 s]
/proc/loadavg: 2.07 2.04 2.00 3/177 4720
/proc/meminfo: memFree=30071336/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=1056616 CPUtime=1797.91 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202496 264258 0 0 0 179226 565 0 0 20 0 1 0 289748363 1081974784 261716 33554432000 134512640 137138936 4288495616 4288494040 134606670 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 264154 261716 192 642 0 263510 0
Current children cumulated CPU time (s) 1797.91
Current children cumulated vsize (KiB) 1056616

[startup+1798.5 s]
/proc/loadavg: 2.07 2.04 2.00 3/177 4720
/proc/meminfo: memFree=30508368/32873648 swapFree=7116/7116
[pid=4665] ppid=4663 vsize=0 CPUtime=1798.02 cores=0,2,4,6
/proc/4665/stat : 4665 (bsolo) R 4663 4665 4099 0 -1 4202500 264258 0 0 0 179236 566 0 0 20 0 1 0 289748363 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4665/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1798.02
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1798.52
CPU time (s): 1798.04
CPU user time (s): 1792.36
CPU system time (s): 5.67514
CPU usage (%): 99.9731
Max. virtual memory (cumulated for all children) (KiB): 1058860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.36
system time used= 5.67514
maximum resident set size= 1049096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264258
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 333
involuntary context switches= 1957

runsolver used 4.81527 second user time and 8.61469 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 22:17:09
IDJOB=3707670
IDBENCH=90193
IDSOLVER=2286
FILE ID=node123/3707670-1338236229
RUNJOBID= node123-1338227645-4115
PBS_JOBID= 14624628
Free space on /tmp= 71676 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K152.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707670-1338236229/watcher-3707670-1338236229 -o /tmp/evaluation-result-3707670-1338236229/solver-3707670-1338236229 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707670-1338236229.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6abb89533e60aa1ed19663db7c40a868
RANDOM SEED=642946877

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31126228 kB
Buffers:          368916 kB
Cached:           298672 kB
SwapCached:          972 kB
Active:           583344 kB
Inactive:         324656 kB
Active(anon):     232168 kB
Inactive(anon):     8356 kB
Active(file):     351176 kB
Inactive(file):   316300 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102960 kB
Dirty:              5064 kB
Writeback:             0 kB
AnonPages:        275252 kB
Mapped:            11024 kB
Shmem:                 0 kB
Slab:             702788 kB
SReclaimable:     146940 kB
SUnreclaim:       555848 kB
KernelStack:        1472 kB
PageTables:         4152 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     362620 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     32768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node123 at 2012-05-28 22:47:08