Trace number 3739610

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.1 1800.71

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12038_3-sat.opb
MD5SUM56cc40b9ea431027514a5b56e02d7edb
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables37752
Total number of constraints125892
Number of constraints which are clauses125272
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints620
Minimum length of a constraint1
Maximum length of a constraint120
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 34
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 740
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3739610-1338748763.opb
0.00/0.00	c File size is 4220396 bytes.
0.38/0.40	c Highest Coefficient sum: 740
0.38/0.40	c Parsing was ok!!
0.38/0.40	c Total parsing time: 0.404 s
0.38/0.44	c Var: 37752 Constr: 125892 125272/0/620 Lit: 342326 Watch. Lit: 313924
0.38/0.44	c Obj. Vars: 0 (0 % of total variables)
8.48/8.53	c Pre-processing Time: 8.53 s
8.48/8.53	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
8.48/8.53	c        0  15292    43901   128359    2   114394   83144      0      0 8.53
8.48/8.53	c Switching off LPR mode.
1800.09/1800.70	c      101  15292    44002   147626    3   117365   91459    101     11 8.65
1800.09/1800.70	c      251  15292    44152   161996    3   119302  100605    251     28 8.74
1800.09/1800.70	c      476  15292    44377   178873    4   119777  110666    476     53 8.86
1800.09/1800.70	c      814  15292    44715   197329    4   120419  121733    814     90 8.99
1800.09/1800.70	c     1322  15292    45223   235608    5   121575  133907   1322    143 9.24
1800.09/1800.70	c     2086  15292    45987   282483    6   123025  147298   2086    217 9.57
1800.09/1800.70	c     3232  15292    47133   375267    7   125387  162028   3232    313 10.30
1800.09/1800.70	c     4954  15292    48855   507971   10   128764  178231   4954    442 11.19
1800.09/1800.70	c     7538  15292    51439   731047   14   134020  196055   7538    605 12.44
1800.09/1800.70	c    11418  15292    55319  1060728   19   141673  215661  11418    799 14.28
1800.09/1800.70	c    17241  15292    61142  1594221   26   153493  237228  17241    989 17.42
1800.09/1800.70	c    25978  15292    69879  2531131   36   170910  260951  25978   1123 23.12
1800.09/1800.70	c    39088  15292    82989  3521674   42   197189  287047  39088   1280 30.51
1800.09/1800.70	c    58759  15292   102660  5864761   57   236459  315752  58759   1199 48.98
1800.09/1800.70	c    88269  15292   132170  9803010   74   295576  347328  88269   1071 82.40
1800.09/1800.70	c   132539  15292   176440 15646588   88   384007  382061 132539    841 157.50
1800.09/1800.70	c   198949  15292   242850 23362869   96   516873  420268 198949    693 286.84
1800.09/1800.70	c   298569  15292   342470 43168624  126   715995  462295 298569    511 583.81
1800.09/1800.70	c   448004  15292   491905 68011310  138  1015020  508525 448004    346 1293.19
1800.09/1800.70	c Caught signal: 15
1800.09/1800.70	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.09/1800.70	c   19   554596 112255   760456    81728  5776945  37827    308 1800.10
1800.09/1800.70	s UNKNOWN
1800.09/1800.70	c Total time: 1800.1 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3739610-1338748763/watcher-3739610-1338748763 -o /tmp/evaluation-result-3739610-1338748763/solver-3739610-1338748763 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3739610-1338748763.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.93 1.40 1.74 3/176 5992
/proc/meminfo: memFree=28559908/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=8812 CPUtime=0 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 476 0 0 0 0 0 0 0 20 0 1 0 341002012 9023488 412 33554432000 134512640 135840783 4286619408 4286618240 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5992/statm: 2203 412 329 325 0 108 0

[startup+0.0944309 s]
/proc/loadavg: 0.93 1.40 1.74 3/176 5992
/proc/meminfo: memFree=28559908/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=13840 CPUtime=0.08 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 1997 0 0 0 8 0 0 0 20 0 1 0 341002012 14172160 1933 33554432000 134512640 135840783 4286619408 4286618368 134586460 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5992/statm: 3460 1935 585 325 0 1365 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 13840

[startup+0.100238 s]
/proc/loadavg: 0.93 1.40 1.74 3/176 5992
/proc/meminfo: memFree=28559908/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=14116 CPUtime=0.09 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 2076 0 0 0 9 0 0 0 20 0 1 0 341002012 14454784 2012 33554432000 134512640 135840783 4286619408 4286618400 134525286 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5992/statm: 3529 2012 601 325 0 1434 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14116

[startup+0.300204 s]
/proc/loadavg: 0.93 1.40 1.74 3/176 5992
/proc/meminfo: memFree=28559908/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=23568 CPUtime=0.28 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 5040 0 0 0 28 0 0 0 20 0 1 0 341002012 24133632 4936 33554432000 134512640 135840783 4286619408 4286618348 2320763 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5992/statm: 5892 4936 1170 325 0 3797 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 23568

[startup+0.700259 s]
/proc/loadavg: 0.93 1.40 1.74 3/176 5992
/proc/meminfo: memFree=28559908/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=31896 CPUtime=0.69 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 8245 0 0 0 68 1 0 0 20 0 1 0 341002012 32661504 7110 33554432000 134512640 135840783 4286619408 4286165360 134551741 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 7974 7110 344 325 0 6910 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 31896

[startup+1.50025 s]
/proc/loadavg: 0.93 1.40 1.74 3/177 5993
/proc/meminfo: memFree=28513600/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=31896 CPUtime=1.48 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 8247 0 0 0 147 1 0 0 20 0 1 0 341002012 32661504 7112 33554432000 134512640 135840783 4286619408 4286165500 9606192 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 7974 7112 344 325 0 6910 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 31896

[startup+3.10022 s]
/proc/loadavg: 1.02 1.41 1.75 3/177 5993
/proc/meminfo: memFree=28511988/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=31896 CPUtime=3.08 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 8248 0 0 0 307 1 0 0 20 0 1 0 341002012 32661504 7113 33554432000 134512640 135840783 4286619408 4286165500 9606192 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 7974 7113 344 325 0 6910 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 31896

[startup+6.30023 s]
/proc/loadavg: 1.02 1.41 1.75 3/177 5993
/proc/meminfo: memFree=28511848/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=32028 CPUtime=6.28 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 8285 0 0 0 626 2 0 0 20 0 1 0 341002012 32796672 7150 33554432000 134512640 135840783 4286619408 4286165500 9606192 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 8007 7150 344 325 0 6943 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 32028

[startup+12.7002 s]
/proc/loadavg: 1.17 1.43 1.75 3/177 5993
/proc/meminfo: memFree=28500064/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=32068 CPUtime=12.69 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 8834 0 0 0 1265 4 0 0 20 0 1 0 341002012 32837632 7181 33554432000 134512640 135840783 4286619408 4286617424 1580352 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 8017 7181 349 325 0 6953 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 32068

[startup+25.5063 s]
/proc/loadavg: 1.29 1.45 1.75 3/177 5993
/proc/meminfo: memFree=28454788/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=56224 CPUtime=25.49 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 14880 0 0 0 2544 5 0 0 20 0 1 0 341002012 57573376 13226 33554432000 134512640 135840783 4286619408 4286617872 1582375 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 14056 13226 349 325 0 12992 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 56224

[startup+51.1002 s]
/proc/loadavg: 1.53 1.49 1.75 3/178 5996
/proc/meminfo: memFree=28372776/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=101500 CPUtime=51.06 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 26214 0 0 0 5097 9 0 0 20 0 1 0 341002012 103936000 24544 33554432000 134512640 135840783 4286619408 4286618688 1584826 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 25375 24544 349 325 0 24311 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 101500

[startup+102.3 s]
/proc/loadavg: 1.88 1.58 1.77 3/177 5996
/proc/meminfo: memFree=28250076/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=177800 CPUtime=102.21 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 45315 0 0 0 10206 15 0 0 20 0 1 0 341002012 182067200 43606 33554432000 134512640 135840783 4286619408 4286618768 134551039 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 44450 43606 349 325 0 43386 0
Current children cumulated CPU time (s) 102.21
Current children cumulated vsize (KiB) 177800

[startup+162.3 s]
/proc/loadavg: 1.96 1.66 1.78 3/177 5996
/proc/meminfo: memFree=28148920/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=236140 CPUtime=162.16 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 59949 0 0 0 16194 22 0 0 20 0 1 0 341002012 241807360 58193 33554432000 134512640 135840783 4286619408 4286618688 1584738 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 59035 58193 349 325 0 57971 0
Current children cumulated CPU time (s) 162.16
Current children cumulated vsize (KiB) 236140

[startup+222.3 s]
/proc/loadavg: 1.98 1.72 1.79 3/177 5996
/proc/meminfo: memFree=28056268/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=288688 CPUtime=222.15 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 73107 0 0 0 22189 26 0 0 20 0 1 0 341002012 295616512 71345 33554432000 134512640 135840783 4286619408 4286618720 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 72172 71345 349 325 0 71108 0
Current children cumulated CPU time (s) 222.15
Current children cumulated vsize (KiB) 288688

[startup+282.3 s]
/proc/loadavg: 1.99 1.77 1.80 3/177 5996
/proc/meminfo: memFree=27987476/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=334068 CPUtime=282.14 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 84431 0 0 0 28183 31 0 0 20 0 1 0 341002012 342085632 82669 33554432000 134512640 135840783 4286619408 4286618544 1579690 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 83517 82669 349 325 0 82453 0
Current children cumulated CPU time (s) 282.14
Current children cumulated vsize (KiB) 334068

[startup+342.306 s]
/proc/loadavg: 1.99 1.81 1.82 3/177 5997
/proc/meminfo: memFree=27920856/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=400100 CPUtime=342.14 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 100934 0 0 0 34176 38 0 0 20 0 1 0 341002012 409702400 99172 33554432000 134512640 135840783 4286619408 4286618768 134551084 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 100025 99172 349 325 0 98961 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 400100

[startup+402.3 s]
/proc/loadavg: 1.99 1.84 1.82 3/177 5997
/proc/meminfo: memFree=27870016/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=451552 CPUtime=402.12 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 113800 0 0 0 40169 43 0 0 20 0 1 0 341002012 462389248 112038 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 112888 112038 349 325 0 111824 0
Current children cumulated CPU time (s) 402.12
Current children cumulated vsize (KiB) 451552

[startup+462.3 s]
/proc/loadavg: 1.99 1.87 1.83 3/177 5997
/proc/meminfo: memFree=27789540/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=506120 CPUtime=462.11 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 127469 0 0 0 46164 47 0 0 20 0 1 0 341002012 518266880 125707 33554432000 134512640 135840783 4286619408 4286618768 134551186 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 126530 125707 349 325 0 125466 0
Current children cumulated CPU time (s) 462.11
Current children cumulated vsize (KiB) 506120

[startup+522.3 s]
/proc/loadavg: 1.99 1.89 1.83 3/177 5997
/proc/meminfo: memFree=27708144/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=557240 CPUtime=522.09 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 140242 0 0 0 52157 52 0 0 20 0 1 0 341002012 570613760 138464 33554432000 134512640 135840783 4286619408 4286618768 134550893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 139310 138464 349 325 0 138246 0
Current children cumulated CPU time (s) 522.09
Current children cumulated vsize (KiB) 557240

[startup+582.3 s]
/proc/loadavg: 2.07 1.92 1.85 3/177 5997
/proc/meminfo: memFree=27634888/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=597960 CPUtime=582.05 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 150461 0 0 0 58149 56 0 0 20 0 1 0 341002012 612311040 148639 33554432000 134512640 135840783 4286619408 4286618768 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 149490 148639 349 325 0 148426 0
Current children cumulated CPU time (s) 582.05
Current children cumulated vsize (KiB) 597960

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.01 1.97 1.88 3/177 6001
/proc/meminfo: memFree=27380112/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=783136 CPUtime=881.92 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 196898 0 0 0 88115 77 0 0 20 0 1 0 341002012 801931264 194943 33554432000 134512640 135840783 4286619408 4286617028 1569028 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 195784 194943 349 325 0 194720 0
Current children cumulated CPU time (s) 881.92
Current children cumulated vsize (KiB) 783136

[startup+942.3 s]
/proc/loadavg: 2.00 1.97 1.89 3/177 6002
/proc/meminfo: memFree=27353576/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=810248 CPUtime=941.9 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 203674 0 0 0 94110 80 0 0 20 0 1 0 341002012 829693952 201719 33554432000 134512640 135840783 4286619408 4286618768 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 202562 201719 349 325 0 201498 0
Current children cumulated CPU time (s) 941.9
Current children cumulated vsize (KiB) 810248

[startup+1002.31 s]
/proc/loadavg: 2.00 1.97 1.89 3/177 6002
/proc/meminfo: memFree=27325980/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=837752 CPUtime=1001.9 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 210545 0 0 0 100106 84 0 0 20 0 1 0 341002012 857858048 208590 33554432000 134512640 135840783 4286619408 4286618768 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 209438 208590 349 325 0 208374 0
Current children cumulated CPU time (s) 1001.9
Current children cumulated vsize (KiB) 837752

[startup+1062.3 s]
/proc/loadavg: 2.00 1.97 1.90 3/177 6002
/proc/meminfo: memFree=27299728/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=857864 CPUtime=1061.88 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 215573 0 0 0 106102 86 0 0 20 0 1 0 341002012 878452736 213618 33554432000 134512640 135840783 4286619408 4286618768 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 214466 213618 349 325 0 213402 0
Current children cumulated CPU time (s) 1061.88
Current children cumulated vsize (KiB) 857864

[startup+1122.3 s]
/proc/loadavg: 2.00 1.97 1.90 3/177 6002
/proc/meminfo: memFree=27243060/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=880876 CPUtime=1121.87 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 221326 0 0 0 112098 89 0 0 20 0 1 0 341002012 902017024 219371 33554432000 134512640 135840783 4286619408 4286618768 134551093 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 220219 219371 349 325 0 219155 0
Current children cumulated CPU time (s) 1121.87
Current children cumulated vsize (KiB) 880876

[startup+1182.3 s]
/proc/loadavg: 2.00 1.97 1.91 3/177 6002
/proc/meminfo: memFree=27187012/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=899260 CPUtime=1181.87 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 225924 0 0 0 118095 92 0 0 20 0 1 0 341002012 920842240 223969 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 224815 223969 349 325 0 223751 0
Current children cumulated CPU time (s) 1181.87
Current children cumulated vsize (KiB) 899260

[startup+1242.3 s]
/proc/loadavg: 2.00 1.97 1.91 3/178 6006
/proc/meminfo: memFree=27168900/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=916976 CPUtime=1241.86 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 230372 0 0 0 124092 94 0 0 20 0 1 0 341002012 938983424 228417 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 229244 228417 349 325 0 228180 0
Current children cumulated CPU time (s) 1241.86
Current children cumulated vsize (KiB) 916976

[startup+1302.3 s]
/proc/loadavg: 2.03 1.99 1.91 3/178 6028
/proc/meminfo: memFree=27148888/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=937080 CPUtime=1301.85 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 235386 0 0 0 130088 97 0 0 20 0 1 0 341002012 959569920 233431 33554432000 134512640 135840783 4286619408 4286618760 6432968 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 234270 233431 349 325 0 233206 0
Current children cumulated CPU time (s) 1301.85
Current children cumulated vsize (KiB) 937080

[startup+1362.3 s]
/proc/loadavg: 2.01 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27113976/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=971996 CPUtime=1361.84 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 244104 0 0 0 136083 101 0 0 20 0 1 0 341002012 995323904 242149 33554432000 134512640 135840783 4286619408 4286618768 134551312 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 242999 242149 349 325 0 241935 0
Current children cumulated CPU time (s) 1361.84
Current children cumulated vsize (KiB) 971996

[startup+1422.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27076156/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1010068 CPUtime=1421.83 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 253643 0 0 0 142078 105 0 0 20 0 1 0 341002012 1034309632 251688 33554432000 134512640 135840783 4286619408 4286618768 134551324 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 252517 251688 349 325 0 251453 0
Current children cumulated CPU time (s) 1421.83
Current children cumulated vsize (KiB) 1010068

[startup+1482.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6028
/proc/meminfo: memFree=27044164/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1041668 CPUtime=1481.82 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 261528 0 0 0 148073 109 0 0 20 0 1 0 341002012 1066668032 259573 33554432000 134512640 135840783 4286619408 4286618768 134551071 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 260417 259573 349 325 0 259353 0
Current children cumulated CPU time (s) 1481.82
Current children cumulated vsize (KiB) 1041668

[startup+1542.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6029
/proc/meminfo: memFree=27019240/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1066000 CPUtime=1541.81 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 267634 0 0 0 154069 112 0 0 20 0 1 0 341002012 1091584000 265670 33554432000 134512640 135840783 4286619408 4286618544 1579781 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 266500 265670 349 325 0 265436 0
Current children cumulated CPU time (s) 1541.81
Current children cumulated vsize (KiB) 1066000

[startup+1602.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/177 6029
/proc/meminfo: memFree=26995956/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1089676 CPUtime=1601.79 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 273551 0 0 0 160063 116 0 0 20 0 1 0 341002012 1115828224 271568 33554432000 134512640 135840783 4286619408 4286618768 134550924 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 272419 271568 349 325 0 271355 0
Current children cumulated CPU time (s) 1601.79
Current children cumulated vsize (KiB) 1089676

[startup+1662.31 s]
/proc/loadavg: 2.03 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26957792/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1112820 CPUtime=1661.76 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 279372 0 0 0 166058 118 0 0 20 0 1 0 341002012 1139527680 277360 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 278205 277360 349 325 0 277141 0
Current children cumulated CPU time (s) 1661.76
Current children cumulated vsize (KiB) 1112820

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26906608/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1134108 CPUtime=1721.71 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 284736 0 0 0 172051 120 0 0 20 0 1 0 341002012 1161326592 282676 33554432000 134512640 135840783 4286619408 4286618768 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 283527 282676 349 325 0 282463 0
Current children cumulated CPU time (s) 1721.71
Current children cumulated vsize (KiB) 1134108

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/177 6029
/proc/meminfo: memFree=26881128/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1149840 CPUtime=1781.68 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 289231 0 0 0 178045 123 0 0 20 0 1 0 341002012 1177436160 286616 33554432000 134512640 135840783 4286619408 4286618768 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 287460 286616 349 325 0 286396 0
Current children cumulated CPU time (s) 1781.68
Current children cumulated vsize (KiB) 1149840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.7 s]
/proc/loadavg: 2.00 2.00 1.92 2/175 6030
/proc/meminfo: memFree=27411996/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1149840 CPUtime=1800.09 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 289231 0 0 0 179886 123 0 0 20 0 1 0 341002012 1177436160 286616 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 287460 286616 349 325 0 286396 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 1149840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.7 s]
/proc/loadavg: 2.00 2.00 1.92 2/175 6030
/proc/meminfo: memFree=27411996/32873844 swapFree=7112/7112
[pid=5992] ppid=5990 vsize=1149840 CPUtime=1800.09 cores=0,2,4,6
/proc/5992/stat : 5992 (bsolo3.0.17) R 5990 5992 5948 0 -1 4202496 289231 0 0 0 179886 123 0 0 20 0 1 0 341002012 1177436160 286616 33554432000 134512640 135840783 4286619408 4286618768 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5992/statm: 287460 286616 349 325 0 286396 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 1149840

Child status: 15
Real time (s): 1800.71
CPU time (s): 1800.1
CPU user time (s): 1798.86
CPU system time (s): 1.24181
CPU usage (%): 99.9663
Max. virtual memory (cumulated for all children) (KiB): 1151944

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.86
system time used= 1.24181
maximum resident set size= 1148568
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 289234
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 461
involuntary context switches= 2024

runsolver used 3.66044 second user time and 8.5347 second system time

The end

Launcher Data 

Begin job on node119 at 2012-06-03 20:39:23
IDJOB=3739610
IDBENCH=73867
IDSOLVER=2318
FILE ID=node119/3739610-1338748763
RUNJOBID= node119-1338748763-5964
PBS_JOBID= 14636790
Free space on /tmp= 70888 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12038_3-sat.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3739610-1338748763/watcher-3739610-1338748763 -o /tmp/evaluation-result-3739610-1338748763/solver-3739610-1338748763 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3739610-1338748763.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 56cc40b9ea431027514a5b56e02d7edb
RANDOM SEED=1111250848

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28561404 kB
Buffers:          410508 kB
Cached:          3065048 kB
SwapCached:         1936 kB
Active:          1503048 kB
Inactive:        1979732 kB
Active(anon):       3284 kB
Inactive(anon):     6624 kB
Active(file):    1499764 kB
Inactive(file):  1973108 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100224 kB
Dirty:             19828 kB
Writeback:             0 kB
AnonPages:         13084 kB
Mapped:            12528 kB
Shmem:                 0 kB
Slab:             690592 kB
SReclaimable:     132584 kB
SUnreclaim:       558008 kB
KernelStack:        1384 kB
PageTables:         4352 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     126756 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70880 MiB
End job on node119 at 2012-06-03 21:09:26