Trace number 3485230

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
SCIP spx 2 2011-06-10 (fixed)? (TO) 1800.07 1800.04

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_1000_60_1.opb
MD5SUM6856221d5d444d2079d321f11fb11f0b
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-68
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -74
Optimality of the best value was proved NO
Number of variables2000
Total number of constraints3001
Number of constraints which are clauses1000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2001
Minimum length of a constraint2
Maximum length of a constraint2000
Number of terms in the objective function 1000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1000
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 2000
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)151172
Sum of products size (including duplicates)302344
Number of different products75586
Sum of products size151172

Solver Data 

0.00/0.00	c SCIP version 2.0.1.4 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3485230-1307788013.opb>
0.09/0.15	c original problem has 2000 variables (2000 bin, 0 int, 0 impl, 0 cont) and 3001 constraints
0.09/0.15	c problem read
0.09/0.15	c presolving settings loaded
0.49/0.59	o 0
0.49/0.59	c feasible solution found by trivial heuristic, objective value  0.000000e+00
0.49/0.59	c presolving:
2.20/2.29	c (round 1) 0 del vars, 0 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 3000 upgd conss, 600464 impls, 2000 clqs
4.69/4.71	c    (4.7s) probing: 101/77586 (0.1%) - 0 fixings, 0 aggregations, 0 implications, 0 bound changes
4.69/4.71	c    (4.7s) probing aborted: 100/100 successive totally useless probings
4.69/4.72	c presolving (2 rounds):
4.69/4.72	c  0 deleted vars, 0 deleted constraints, 0 added constraints, 0 tightened bounds, 0 added holes, 0 changed sides, 0 changed coefficients
4.69/4.72	c  600464 implications, 2000 cliques
4.69/4.72	c presolved problem has 77586 variables (77586 bin, 0 int, 0 impl, 0 cont) and 78587 constraints
4.69/4.72	c    3000 constraints of type <setppc>
4.69/4.72	c   75586 constraints of type <and>
4.69/4.72	c       1 constraints of type <linear>
4.69/4.72	c transformed objective value is always integral (scale: 1)
4.69/4.72	c Presolving Time: 4.54
4.69/4.72	c - non default parameters ----------------------------------------------------------------------
4.69/4.72	c # SCIP version 2.0.1.4
4.69/4.72	c 
4.69/4.72	c # frequency for displaying node information lines
4.69/4.72	c # [type: int, range: [-1,2147483647], default: 100]
4.69/4.72	c display/freq = 10000
4.69/4.72	c 
4.69/4.72	c # maximal time in seconds to run
4.69/4.72	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
4.69/4.72	c limits/time = 1797
4.69/4.72	c 
4.69/4.72	c # maximal memory usage in MB; reported memory usage is lower than real memory usage!
4.69/4.72	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
4.69/4.72	c limits/memory = 13950
4.69/4.72	c 
4.69/4.72	c # default clock type (1: CPU user seconds, 2: wall clock time)
4.69/4.72	c # [type: int, range: [1,2], default: 1]
4.69/4.72	c timing/clocktype = 2
4.69/4.72	c 
4.69/4.72	c # belongs reading time to solving time?
4.69/4.72	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
4.69/4.72	c timing/reading = TRUE
4.69/4.72	c 
4.69/4.72	c # should presolving try to simplify inequalities
4.69/4.72	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
4.69/4.72	c constraints/linear/simplifyinequalities = TRUE
4.69/4.72	c 
4.69/4.72	c # add initial coupling inequalities as linear constraints, if 'addCoupling' is true
4.69/4.72	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
4.69/4.72	c constraints/indicator/addCouplingCons = TRUE
4.69/4.72	c 
4.69/4.72	c # should presolving try to simplify knapsacks
4.69/4.72	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
4.69/4.72	c constraints/knapsack/simplifyinequalities = TRUE
4.69/4.72	c 
4.69/4.72	c # frequency for calling separator <rapidlearning> (-1: never, 0: only in root node)
4.69/4.72	c # [type: int, range: [-1,2147483647], default: -1]
4.69/4.72	c separating/rapidlearning/freq = 0
4.69/4.72	c 
4.69/4.72	c -----------------------------------------------------------------------------------------------
4.69/4.72	c start solving
4.69/4.74	c

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3485230-1307788013/watcher-3485230-1307788013 -o /tmp/evaluation-result-3485230-1307788013/solver-3485230-1307788013 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3485230-1307788013.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.95 2/177 13475
/proc/meminfo: memFree=31410684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=10708 CPUtime=0 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 1673 0 0 0 0 0 0 0 25 0 1 0 969031950 10964992 1628 33554432000 4194304 8979876 140736731031952 18446744073709551615 7893696 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/13475/statm: 2774 1633 361 1169 0 1601 0

[startup+0.0245809 s]
/proc/loadavg: 2.00 2.00 1.95 2/177 13475
/proc/meminfo: memFree=31410684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=13340 CPUtime=0.02 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 2329 0 0 0 2 0 0 0 25 0 1 0 969031950 13660160 2284 33554432000 4194304 8979876 140736731031952 18446744073709551615 7836073 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/13475/statm: 3335 2284 367 1169 0 2162 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13340

[startup+0.10058 s]
/proc/loadavg: 2.00 2.00 1.95 2/177 13475
/proc/meminfo: memFree=31410684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=19252 CPUtime=0.09 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 3817 0 0 0 9 0 0 0 25 0 1 0 969031950 19714048 3772 33554432000 4194304 8979876 140736731031952 18446744073709551615 7807876 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/13475/statm: 4813 3772 367 1169 0 3640 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 19252

[startup+0.300538 s]
/proc/loadavg: 2.00 2.00 1.95 2/177 13475
/proc/meminfo: memFree=31410684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=84868 CPUtime=0.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 19901 0 0 0 27 2 0 0 25 0 1 0 969031950 86904832 19856 33554432000 4194304 8979876 140736731031952 18446744073709551615 6426237 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 21217 19856 456 1169 0 20044 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 84868

[startup+0.700461 s]
/proc/loadavg: 2.00 2.00 1.95 2/177 13475
/proc/meminfo: memFree=31410684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=157696 CPUtime=0.69 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 39155 0 0 0 65 4 0 0 25 0 1 0 969031950 161480704 38070 33554432000 4194304 8979876 140736731031952 18446744073709551615 4920676 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 39424 38070 480 1169 0 38251 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 157696

[startup+1.50032 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13476
/proc/meminfo: memFree=31256196/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=172728 CPUtime=1.49 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 42904 0 0 0 145 4 0 0 25 0 1 0 969031950 176873472 41819 33554432000 4194304 8979876 140736731031952 18446744073709551615 5040391 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 43182 41819 480 1169 0 42009 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 172728

[startup+3.10101 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13476
/proc/meminfo: memFree=31227180/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=205588 CPUtime=3.09 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 52978 0 0 0 304 5 0 0 25 0 1 0 969031950 210522112 50060 33554432000 4194304 8979876 140736731031952 18446744073709551615 7836073 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 51397 50060 507 1169 0 50224 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 205588

[startup+6.30044 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13476
/proc/meminfo: memFree=30894128/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=555488 CPUtime=6.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 139994 0 0 0 614 15 0 0 20 0 1 0 969031950 568819712 131986 33554432000 4194304 8979876 140736731031952 18446744073709551615 6937217 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 138872 131986 625 1169 0 137699 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 555488

[startup+12.7012 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13476
/proc/meminfo: memFree=30829940/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=621292 CPUtime=12.7 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 155873 0 0 0 1252 18 0 0 25 0 1 0 969031950 636203008 145490 33554432000 4194304 8979876 140736731031952 18446744073709551615 6942281 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 155323 145490 659 1169 0 154150 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 621292

[startup+25.5009 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13476
/proc/meminfo: memFree=30785492/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=644804 CPUtime=25.49 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 165413 0 0 0 2529 20 0 0 25 0 1 0 969031950 660279296 154690 33554432000 4194304 8979876 140736731031952 18446744073709551615 7146342 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 161201 154690 681 1169 0 160028 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 644804

[startup+51.1011 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13477
/proc/meminfo: memFree=30778004/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=646860 CPUtime=51.09 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 166089 0 0 0 5087 22 0 0 25 0 1 0 969031950 662384640 155288 33554432000 4194304 8979876 140736731031952 18446744073709551615 7146511 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 161715 155288 688 1169 0 160542 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 646860

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 1.95 3/178 13478
/proc/meminfo: memFree=30688296/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=646860 CPUtime=102.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 166094 0 0 0 10206 23 0 0 25 0 1 0 969031950 662384640 155293 33554432000 4194304 8979876 140736731031952 18446744073709551615 7890762 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 161715 155293 688 1169 0 160542 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 646860

[startup+162.301 s]
/proc/loadavg: 2.07 2.02 1.95 3/178 13480
/proc/meminfo: memFree=30687996/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=646860 CPUtime=162.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 166097 0 0 0 16204 25 0 0 25 0 1 0 969031950 662384640 155296 33554432000 4194304 8979876 140736731031952 18446744073709551615 7146987 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 161715 155296 688 1169 0 160542 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 646860

[startup+222.3 s]
/proc/loadavg: 2.06 2.03 1.96 3/178 13482
/proc/meminfo: memFree=30673452/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=662200 CPUtime=222.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 169736 0 0 0 22202 27 0 0 25 0 1 0 969031950 678092800 158876 33554432000 4194304 8979876 140736731031952 18446744073709551615 7890762 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 165550 158876 629 1169 0 164377 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 662200

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 1.96 3/178 13483
/proc/meminfo: memFree=30673664/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=662200 CPUtime=282.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 169740 0 0 0 28201 28 0 0 25 0 1 0 969031950 678092800 158880 33554432000 4194304 8979876 140736731031952 18446744073709551615 7147088 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 165550 158880 629 1169 0 164377 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 662200

[startup+342.301 s]
/proc/loadavg: 2.01 2.01 1.96 3/178 13485
/proc/meminfo: memFree=30652784/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682172 CPUtime=342.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 174905 0 0 0 34199 30 0 0 25 0 1 0 969031950 698544128 164045 33554432000 4194304 8979876 140736731031952 18446744073709551615 7146536 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170543 164045 629 1169 0 169370 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 682172

[startup+402.301 s]
/proc/loadavg: 2.00 2.01 1.96 3/178 13486
/proc/meminfo: memFree=30652868/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682172 CPUtime=402.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 174908 0 0 0 40197 32 0 0 25 0 1 0 969031950 698544128 164048 33554432000 4194304 8979876 140736731031952 18446744073709551615 7145555 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170543 164048 629 1169 0 169370 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 682172

[startup+462.301 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13488
/proc/meminfo: memFree=30652832/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682172 CPUtime=462.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 174911 0 0 0 46196 34 0 0 25 0 1 0 969031950 698544128 164051 33554432000 4194304 8979876 140736731031952 18446744073709551615 7146622 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170543 164051 629 1169 0 169370 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 682172

[startup+522.301 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13490
/proc/meminfo: memFree=30652556/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682928 CPUtime=522.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 175035 0 0 0 52194 36 0 0 25 0 1 0 969031950 699318272 164175 33554432000 4194304 8979876 140736731031952 18446744073709551615 6942131 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170732 164175 629 1169 0 169559 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 682928

[startup+582.301 s]
/proc/loadavg: 2.07 2.02 1.96 3/178 13491
/proc/meminfo: memFree=30652528/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682928 CPUtime=582.29 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 175038 0 0 0 58192 37 0 0 25 0 1 0 969031950 699318272 164178 33554432000 4194304 8979876 140736731031952 18446744073709551615 7145571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170732 164178 629 1169 0 169559 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 682928

[startup+642.301 s]

################
# More data... #
################

[startup+822.301 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13501
/proc/meminfo: memFree=30651688/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682928 CPUtime=822.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 175049 0 0 0 82187 43 0 0 25 0 1 0 969031950 699318272 164189 33554432000 4194304 8979876 140736731031952 18446744073709551615 7186186 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170732 164189 629 1169 0 169559 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 682928

[startup+882.301 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13502
/proc/meminfo: memFree=30651660/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682928 CPUtime=882.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 175052 0 0 0 88186 44 0 0 25 0 1 0 969031950 699318272 164192 33554432000 4194304 8979876 140736731031952 18446744073709551615 7122693 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170732 164192 629 1169 0 169559 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 682928

[startup+942.301 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13504
/proc/meminfo: memFree=30651632/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=682928 CPUtime=942.31 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 175054 0 0 0 94185 46 0 0 25 0 1 0 969031950 699318272 164194 33554432000 4194304 8979876 140736731031952 18446744073709551615 7157242 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 170732 164194 629 1169 0 169559 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 682928

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13505
/proc/meminfo: memFree=30633744/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1002.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179569 0 0 0 100182 48 0 0 25 0 1 0 969031950 721141760 168709 33554432000 4194304 8979876 140736731031952 18446744073709551615 7154820 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168709 629 1169 0 174887 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 704240

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13507
/proc/meminfo: memFree=30633692/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1062.3 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179571 0 0 0 106181 49 0 0 25 0 1 0 969031950 721141760 168711 33554432000 4194304 8979876 140736731031952 18446744073709551615 7145543 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168711 629 1169 0 174887 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 704240

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13509
/proc/meminfo: memFree=30633648/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1122.31 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179573 0 0 0 112180 51 0 0 25 0 1 0 969031950 721141760 168713 33554432000 4194304 8979876 140736731031952 18446744073709551615 7184821 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168713 629 1169 0 174887 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 704240

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.96 3/178 13510
/proc/meminfo: memFree=30633616/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1182.31 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179575 0 0 0 118179 52 0 0 25 0 1 0 969031950 721141760 168715 33554432000 4194304 8979876 140736731031952 18446744073709551615 7185294 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168715 629 1169 0 174887 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 704240

[startup+1242.3 s]
/proc/loadavg: 2.13 2.03 1.97 3/178 13512
/proc/meminfo: memFree=30633576/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1242.31 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179577 0 0 0 124177 54 0 0 25 0 1 0 969031950 721141760 168717 33554432000 4194304 8979876 140736731031952 18446744073709551615 7184776 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168717 629 1169 0 174887 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 704240

[startup+1302.3 s]
/proc/loadavg: 2.05 2.02 1.97 3/178 13513
/proc/meminfo: memFree=30633656/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1302.31 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179579 0 0 0 130176 55 0 0 25 0 1 0 969031950 721141760 168719 33554432000 4194304 8979876 140736731031952 18446744073709551615 7184608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168719 629 1169 0 174887 0
Current children cumulated CPU time (s) 1302.31
Current children cumulated vsize (KiB) 704240

[startup+1362.3 s]
/proc/loadavg: 2.02 2.02 1.97 3/178 13515
/proc/meminfo: memFree=30633624/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1362.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179581 0 0 0 136175 57 0 0 25 0 1 0 969031950 721141760 168721 33554432000 4194304 8979876 140736731031952 18446744073709551615 7186186 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168721 629 1169 0 174887 0
Current children cumulated CPU time (s) 1362.32
Current children cumulated vsize (KiB) 704240

[startup+1422.31 s]
/proc/loadavg: 2.00 2.01 1.97 3/178 13517
/proc/meminfo: memFree=30633708/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1422.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179582 0 0 0 142174 58 0 0 25 0 1 0 969031950 721141760 168722 33554432000 4194304 8979876 140736731031952 18446744073709551615 7185120 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168722 629 1169 0 174887 0
Current children cumulated CPU time (s) 1422.32
Current children cumulated vsize (KiB) 704240

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/178 13518
/proc/meminfo: memFree=30633684/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1482.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 179584 0 0 0 148173 59 0 0 25 0 1 0 969031950 721141760 168724 33554432000 4194304 8979876 140736731031952 18446744073709551615 7145571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 168724 629 1169 0 174887 0
Current children cumulated CPU time (s) 1482.32
Current children cumulated vsize (KiB) 704240

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 13520
/proc/meminfo: memFree=30630680/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1542.33 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180331 0 0 0 154172 61 0 0 25 0 1 0 969031950 721141760 169471 33554432000 4194304 8979876 140736731031952 18446744073709551615 7145571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169471 629 1169 0 174887 0
Current children cumulated CPU time (s) 1542.33
Current children cumulated vsize (KiB) 704240

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 13521
/proc/meminfo: memFree=30630764/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1602.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180340 0 0 0 160170 62 0 0 25 0 1 0 969031950 721141760 169480 33554432000 4194304 8979876 140736731031952 18446744073709551615 6883896 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169480 629 1169 0 174887 0
Current children cumulated CPU time (s) 1602.32
Current children cumulated vsize (KiB) 704240

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 13523
/proc/meminfo: memFree=30630732/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1662.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180349 0 0 0 166168 64 0 0 25 0 1 0 969031950 721141760 169489 33554432000 4194304 8979876 140736731031952 18446744073709551615 7185294 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169489 629 1169 0 174887 0
Current children cumulated CPU time (s) 1662.32
Current children cumulated vsize (KiB) 704240

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 13525
/proc/meminfo: memFree=30630588/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1722.32 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180402 0 0 0 172167 65 0 0 25 0 1 0 969031950 721141760 169542 33554432000 4194304 8979876 140736731031952 18446744073709551615 7118958 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169542 629 1169 0 174887 0
Current children cumulated CPU time (s) 1722.32
Current children cumulated vsize (KiB) 704240

[startup+1782.3 s]
/proc/loadavg: 2.07 2.02 1.98 3/178 13526
/proc/meminfo: memFree=30630424/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1782.33 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180411 0 0 0 178166 67 0 0 25 0 1 0 969031950 721141760 169551 33554432000 4194304 8979876 140736731031952 18446744073709551615 6829040 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169551 629 1169 0 174887 0
Current children cumulated CPU time (s) 1782.33
Current children cumulated vsize (KiB) 704240



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800 s]
/proc/loadavg: 2.05 2.01 1.98 3/178 13566
/proc/meminfo: memFree=30598636/32950928 swapFree=67051096/67111528
[pid=13475] ppid=13473 vsize=704240 CPUtime=1800.03 cores=0,2,4,6
/proc/13475/stat : 13475 (scip-2.0.1.4_2.) R 13473 13475 13131 0 -1 4202496 180414 0 0 0 179936 67 0 0 25 0 1 0 969031950 721141760 169554 33554432000 4194304 8979876 140736731031952 18446744073709551615 7890762 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13475/statm: 176060 169554 629 1169 0 174887 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 704240

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.04
CPU time (s): 1800.07
CPU user time (s): 1799.37
CPU system time (s): 0.705892
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 704240

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.37
system time used= 0.705892
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 180414
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 22506

runsolver used 3.22051 second user time and 6.03208 second system time

The end

Launcher Data 

Begin job on node113 at 2011-06-11 12:26:53
IDJOB=3485230
IDBENCH=48276
IDSOLVER=1977
FILE ID=node113/3485230-1307788013
RUNJOBID= node113-1307784414-13149
PBS_JOBID= 13550901
Free space on /tmp= 74092 MiB

SOLVER NAME= SCIP spx 2 2011-06-10 (fixed)
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_1000_60_1.opb
COMMAND LINE= HOME/scip-2.0.1.4_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3485230-1307788013/watcher-3485230-1307788013 -o /tmp/evaluation-result-3485230-1307788013/solver-3485230-1307788013 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3485230-1307788013.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6856221d5d444d2079d321f11fb11f0b
RANDOM SEED=1420132466

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31410996 kB
Buffers:        263544 kB
Cached:         913488 kB
SwapCached:      14384 kB
Active:         661372 kB
Inactive:       675448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31410996 kB
SwapTotal:    67111528 kB
SwapFree:     67051096 kB
Dirty:           35896 kB
Writeback:           0 kB
AnonPages:      157096 kB
Mapped:          11908 kB
Slab:           139628 kB
PageTables:       4856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   359284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74072 MiB
End job on node113 at 2011-06-11 12:56:55