Trace number 3707604

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.01 1798.67

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j1206_6-sat.opb
MD5SUM138289002292e7c474e0d36dbcddf060
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables37752
Total number of constraints120373
Number of constraints which are clauses119753
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints620
Minimum length of a constraint1
Maximum length of a constraint63
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 17
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 342
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707604-1338190980.opb
0.00/0.00	c File size is 3703078 bytes.
0.19/0.27	c Highest Coefficient sum: 342
0.19/0.27	c Parsing was ok!!
0.19/0.27	c Total parsing time: 0.277 s
0.29/0.30	c Var: 37752 Constr: 120373 119753/0/620 Lit: 294324 Watch. Lit: 273045
0.29/0.30	c Obj. Vars: 0 (0 % of total variables)
21.88/21.92	c Pre-processing Time: 21.917 s
21.88/21.93	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
21.88/21.93	c        0  22543    65220   164971    2   151705   71166      0      0 21.92
21.88/21.93	c Switching off lower bounding mode.
1797.94/1798.66	c      100  22543    65340   180724    2   153239   78283    120      4 22.13
1797.94/1798.66	c      250  22543    65520   187579    2   154273   86112    300     11 22.26
1797.94/1798.66	c      476  22543    65791   203806    3   154876   94724    571     21 22.49
1797.94/1798.66	c      814  22543    66192   214896    3   155621  104197    972     35 22.78
1797.94/1798.66	c     1322  22543    66812   233936    3   156905  114617   1592     57 23.09
1797.94/1798.66	c     2085  22543    67739   277684    4   158676  126079   2519     87 23.77
1797.94/1798.66	c     3231  22543    69087   363229    5   161477  138687   3867    131 24.60
1797.94/1798.66	c     4953  22543    71134   496315    6   165520  152556   5914    189 26.20
1797.94/1798.66	c     7539  22543    74411   694011    9   172108  167812   9191    260 28.92
1797.94/1798.66	c    11421  22543    79455  1095855   13   182273  184594  14235    345 33.06
1797.94/1798.66	c    17247  22543    87391  1749231   20   198106  203054  22171    426 40.47
1797.94/1798.66	c    25985  22543    98554  3306312   33   220502  223360  33334    478 54.27
1797.94/1798.66	c    39095  22543   114596  5886450   51   253004  245697  49376    461 84.78
1797.94/1798.66	c    58765  22543   139406  9514897   68   302843  270267  74186    458 128.28
1797.94/1798.66	c    88275  22543   176592 14432895   81   377775  297294 111372    433 203.43
1797.94/1798.66	c   132546  22543   233046 26624331  114   491669  327024 167826    379 348.99
1797.94/1798.66	c   198956  22543   322698 45409348  140   673164  359727 257478    307 647.96
1797.94/1798.66	c Reducing formula size due to memory constraints
1797.94/1798.66	c Memory Limit: 1000.00 MB  Used: 1006.39 MB
1797.94/1798.66	c   298576  22543   150208 59646292  397   330784  108704  84988    206 1448.86
1797.94/1798.66	c Resources Exceeded
1797.94/1798.66	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1797.94/1798.66	c   18   382918 124370   700425   143303 15940636  78083    212 1798.01
1797.94/1798.66	s UNKNOWN
1797.94/1798.66	c Total time: 1798.01 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707604-1338190980/watcher-3707604-1338190980 -o /tmp/evaluation-result-3707604-1338190980/solver-3707604-1338190980 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707604-1338190980.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32543
/proc/meminfo: memFree=27866132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=14696 CPUtime=0 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 375 0 0 0 0 0 0 0 20 0 1 0 285223498 15048704 329 33554432000 134512640 137138936 4290253040 4290251448 136506715 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 3674 329 183 642 0 2125 0

[startup+0.0828291 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32543
/proc/meminfo: memFree=27866132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=19996 CPUtime=0.07 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 1949 0 0 0 7 0 0 0 20 0 1 0 285223498 20475904 1903 33554432000 134512640 137138936 4290253040 4290251304 136506715 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 4999 1904 456 642 0 3450 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 19996

[startup+0.100258 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32543
/proc/meminfo: memFree=27866132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=20960 CPUtime=0.09 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 2272 0 0 0 9 0 0 0 20 0 1 0 285223498 21463040 2226 33554432000 134512640 137138936 4290253040 4290251448 136506715 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 5240 2226 523 642 0 3691 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20960

[startup+0.30023 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32543
/proc/meminfo: memFree=27866132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=33324 CPUtime=0.29 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 6797 0 0 0 28 1 0 0 20 0 1 0 285223498 34123776 5806 33554432000 134512640 137138936 4290253040 4290251720 136506715 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 8331 5809 182 642 0 7687 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 33324

[startup+0.700236 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32543
/proc/meminfo: memFree=27866132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=36276 CPUtime=0.69 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 7639 0 0 0 68 1 0 0 20 0 1 0 285223498 37146624 6483 33554432000 134512640 137138936 4290253040 4289798752 134567484 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9069 6483 184 642 0 8425 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 36276

[startup+1.50022 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32544
/proc/meminfo: memFree=27841556/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=36408 CPUtime=1.49 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 7682 0 0 0 148 1 0 0 20 0 1 0 285223498 37281792 6526 33554432000 134512640 137138936 4290253040 4289798432 136297742 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9102 6526 184 642 0 8458 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 36408

[startup+3.10017 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32544
/proc/meminfo: memFree=27839756/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=36408 CPUtime=3.09 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 7685 0 0 0 308 1 0 0 20 0 1 0 285223498 37281792 6529 33554432000 134512640 137138936 4290253040 4289798716 136570369 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9102 6529 184 642 0 8458 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 36408

[startup+6.30022 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 32544
/proc/meminfo: memFree=27840012/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=36408 CPUtime=6.29 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 7687 0 0 0 627 2 0 0 20 0 1 0 285223498 37281792 6531 33554432000 134512640 137138936 4290253040 4289798528 134543006 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9102 6531 184 642 0 8458 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 36408

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32545
/proc/meminfo: memFree=27838880/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=36672 CPUtime=12.68 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 7777 0 0 0 1266 2 0 0 20 0 1 0 285223498 37552128 6615 33554432000 134512640 137138936 4290253040 4289798528 134542128 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9168 6615 184 642 0 8524 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 36672

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32545
/proc/meminfo: memFree=27840168/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=37056 CPUtime=25.48 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 8385 0 0 0 2540 8 0 0 20 0 1 0 285223498 37945344 6701 33554432000 134512640 137138936 4290253040 4290251332 136511195 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 9264 6701 192 642 0 8620 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 37056

[startup+51.1002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32545
/proc/meminfo: memFree=27811028/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=66808 CPUtime=51.08 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 15824 0 0 0 5096 12 0 0 20 0 1 0 285223498 68411392 14140 33554432000 134512640 137138936 4290253040 4290251464 134606663 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 16702 14140 192 642 0 16058 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 66808

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32583
/proc/meminfo: memFree=27791396/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=126008 CPUtime=102.26 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 30744 0 0 0 10208 18 0 0 20 0 1 0 285223498 129032192 28942 33554432000 134512640 137138936 4290253040 4290251536 134618214 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 31502 28942 192 642 0 30858 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 126008

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32583
/proc/meminfo: memFree=27680260/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=184844 CPUtime=162.21 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 45500 0 0 0 16197 24 0 0 20 0 1 0 285223498 189280256 43651 33554432000 134512640 137138936 4290253040 4290251464 134606680 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 46211 43651 192 642 0 45567 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 184844

[startup+222.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32583
/proc/meminfo: memFree=27584144/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=241400 CPUtime=222.16 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 59678 0 0 0 22187 29 0 0 20 0 1 0 285223498 247193600 57790 33554432000 134512640 137138936 4290253040 4290251792 134575200 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 60350 57790 192 642 0 59706 0
Current children cumulated CPU time (s) 222.16
Current children cumulated vsize (KiB) 241400

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32583
/proc/meminfo: memFree=27466068/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=325192 CPUtime=282.15 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 80626 0 0 0 28178 37 0 0 20 0 1 0 285223498 332996608 78738 33554432000 134512640 137138936 4290253040 4290251968 134542490 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 81298 78738 192 642 0 80654 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 325192

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32584
/proc/meminfo: memFree=27405300/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=379304 CPUtime=342.14 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 94164 0 0 0 34172 42 0 0 20 0 1 0 285223498 388407296 92276 33554432000 134512640 137138936 4290253040 4290251464 134606592 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 94826 92276 192 642 0 94182 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 379304

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32584
/proc/meminfo: memFree=27321536/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=422816 CPUtime=402.12 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 105033 0 0 0 40165 47 0 0 20 0 1 0 285223498 432963584 103144 33554432000 134512640 137138936 4290253040 4290251968 134542761 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/32543/statm: 105704 103144 192 642 0 105060 0
Current children cumulated CPU time (s) 402.12
Current children cumulated vsize (KiB) 422816

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32587
/proc/meminfo: memFree=27227228/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=461196 CPUtime=462.12 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 114628 0 0 0 46160 52 0 0 20 0 1 0 285223498 472264704 112739 33554432000 134512640 137138936 4290253040 4290251968 134542187 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 115299 112739 192 642 0 114655 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 461196

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32587
/proc/meminfo: memFree=27116168/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=515112 CPUtime=522.09 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 128145 0 0 0 52152 57 0 0 20 0 1 0 285223498 527474688 126218 33554432000 134512640 137138936 4290253040 4290251968 134542187 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 128778 126218 192 642 0 128134 0
Current children cumulated CPU time (s) 522.09
Current children cumulated vsize (KiB) 515112

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32587
/proc/meminfo: memFree=27062132/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=567940 CPUtime=582.04 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 141400 0 0 0 58142 62 0 0 20 0 1 0 285223498 581570560 139425 33554432000 134512640 137138936 4290253040 4290251968 134542233 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 141985 139425 192 642 0 141341 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 567940

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=26582276/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1061.76 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 106074 102 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251892 136511114 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1061.76
Current children cumulated vsize (KiB) 1046600

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32615
/proc/meminfo: memFree=26582440/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1121.76 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 112072 104 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251968 134542333 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1121.76
Current children cumulated vsize (KiB) 1046600

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32615
/proc/meminfo: memFree=26582076/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1181.75 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 118069 106 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251968 134542301 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1181.75
Current children cumulated vsize (KiB) 1046600

[startup+1242.3 s]
/proc/loadavg: 2.08 2.03 2.01 3/177 32616
/proc/meminfo: memFree=26581580/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1241.74 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 124066 108 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251520 136500388 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1241.74
Current children cumulated vsize (KiB) 1046600

[startup+1302.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 32616
/proc/meminfo: memFree=26581580/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1301.73 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 130064 109 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251968 134542372 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1301.73
Current children cumulated vsize (KiB) 1046600

[startup+1362.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 32616
/proc/meminfo: memFree=26558888/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1361.72 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261618 0 0 0 136061 111 0 0 20 0 1 0 285223498 1071718400 259277 33554432000 134512640 137138936 4290253040 4290251968 134542764 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259277 192 642 0 261006 0
Current children cumulated CPU time (s) 1361.72
Current children cumulated vsize (KiB) 1046600

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 32616
/proc/meminfo: memFree=26537436/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1421.72 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261619 0 0 0 142060 112 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542233 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1421.72
Current children cumulated vsize (KiB) 1046600

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32616
/proc/meminfo: memFree=26537436/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1481.71 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261619 0 0 0 148056 115 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542199 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1481.71
Current children cumulated vsize (KiB) 1046600

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32617
/proc/meminfo: memFree=26537812/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1541.7 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261619 0 0 0 154052 118 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542233 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1541.7
Current children cumulated vsize (KiB) 1046600

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32617
/proc/meminfo: memFree=26537688/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1601.69 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261619 0 0 0 160048 121 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251532 136297616 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1601.69
Current children cumulated vsize (KiB) 1046600

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 32620
/proc/meminfo: memFree=26536876/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1661.67 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261645 0 0 0 166043 124 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251464 134606839 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1661.67
Current children cumulated vsize (KiB) 1046600

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 32620
/proc/meminfo: memFree=26537796/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1721.64 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 172037 127 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542295 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1721.64
Current children cumulated vsize (KiB) 1046600

[startup+1782.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26537452/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1781.64 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 178033 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251752 136506283 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1781.64
Current children cumulated vsize (KiB) 1046600

Solver just ended. Dumping a history of the last processes samples

[startup+1792.01 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26537948/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1791.34 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179003 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542187 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1791.34
Current children cumulated vsize (KiB) 1046600

[startup+1795.2 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26538072/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1794.54 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179323 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542187 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1794.54
Current children cumulated vsize (KiB) 1046600

[startup+1796.8 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26538072/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1796.13 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179482 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542199 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1796.13
Current children cumulated vsize (KiB) 1046600

[startup+1797.6 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26538072/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1796.93 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179562 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251900 136520975 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1796.93
Current children cumulated vsize (KiB) 1046600

[startup+1798.4 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26538072/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1797.73 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179642 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542295 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1797.73
Current children cumulated vsize (KiB) 1046600

[startup+1798.61 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 32620
/proc/meminfo: memFree=26538072/32873648 swapFree=7104/7104
[pid=32543] ppid=32541 vsize=1046600 CPUtime=1797.94 cores=1,3,5,7
/proc/32543/stat : 32543 (bsolo) R 32541 32543 29254 0 -1 4202496 261679 0 0 0 179663 131 0 0 20 0 1 0 285223498 1071718400 259278 33554432000 134512640 137138936 4290253040 4290251968 134542187 0 0 4096 16384 0 0 0 17 3 0 0 0 0 0
/proc/32543/statm: 261650 259278 192 642 0 261006 0
Current children cumulated CPU time (s) 1797.94
Current children cumulated vsize (KiB) 1046600

Child status: 0
Real time (s): 1798.67
CPU time (s): 1798.01
CPU user time (s): 1796.69
CPU system time (s): 1.3208
CPU usage (%): 99.9633
Max. virtual memory (cumulated for all children) (KiB): 1047888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1796.69
system time used= 1.3208
maximum resident set size= 1038392
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 261679
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 482
involuntary context switches= 5294

runsolver used 3.46447 second user time and 9.74152 second system time

The end

Launcher Data 

Begin job on node127 at 2012-05-28 09:43:00
IDJOB=3707604
IDBENCH=73805
IDSOLVER=2286
FILE ID=node127/3707604-1338190980
RUNJOBID= node127-1338157754-29271
PBS_JOBID= 14624533
Free space on /tmp= 71164 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j1206_6-sat.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707604-1338190980/watcher-3707604-1338190980 -o /tmp/evaluation-result-3707604-1338190980/solver-3707604-1338190980 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707604-1338190980.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 138289002292e7c474e0d36dbcddf060
RANDOM SEED=1907138904

node127.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.348
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27867256 kB
Buffers:          482796 kB
Cached:          3546528 kB
SwapCached:            0 kB
Active:          1319012 kB
Inactive:        2803696 kB
Active(anon):      95456 kB
Inactive(anon):        0 kB
Active(file):    1223556 kB
Inactive(file):  2803696 kB
Unevictable:        7104 kB
Mlocked:            7104 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              7464 kB
Writeback:             0 kB
AnonPages:        100016 kB
Mapped:            15520 kB
Shmem:               200 kB
Slab:             744824 kB
SReclaimable:     188696 kB
SUnreclaim:       556128 kB
KernelStack:        1472 kB
PageTables:         3912 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     215280 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     75776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71156 MiB
End job on node127 at 2012-05-28 10:12:59