Trace number 3743273

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB11: SCIP spx E_2 2011-06-10 (fixed)? (TO) 1802.19 1802.48

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX300_K192_cod2.opb
MD5SUMcd577d7fe2c7600d8302daa2328d0cdf
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-15627
Best CPU time to get the best result obtained on this benchmark1800.32
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1605
Biggest coefficient in the objective function 1024
Number of bits for the biggest coefficient in the objective function 11
Sum of the numbers in the objective function 188353
Number of bits of the sum of numbers in the objective function 18
Biggest number in a constraint 1024
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 188353
Number of bits of the biggest sum of numbers18
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 2.0.1.5 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743273-1338796976.opb>
3.44/3.45	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
3.44/3.45	c problem read
3.44/3.45	c presolving settings loaded
5.19/5.25	c presolving:
7.89/7.91	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
8.59/8.67	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs
80.68/80.76	c (round 3) 679 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12261460 impls, 1977 clqs
80.87/80.96	c (round 4) 679 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12265462 impls, 1977 clqs
82.07/82.15	c (round 5) 2683 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300072 impls, 1977 clqs
82.27/82.34	c (round 6) 2683 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300084 impls, 1977 clqs
266.26/266.38	c (round 7) 3353 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086958 impls, 1977 clqs
266.45/266.57	c (round 8) 3353 del vars, 5324 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086966 impls, 1977 clqs

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743273-1338796976/watcher-3743273-1338796976 -o /tmp/evaluation-result-3743273-1338796976/solver-3743273-1338796976 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743273-1338796976.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1191
/proc/meminfo: memFree=23090180/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=9324 CPUtime=0 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1471 0 0 0 0 0 0 0 20 0 1 0 345823386 9547776 1425 33554432000 4194304 9016284 140737273869808 140736290962360 7824814 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 2331 1425 311 1178 0 1149 0

[startup+0.0206889 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1191
/proc/meminfo: memFree=23090180/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=18436 CPUtime=0.01 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 3613 0 0 0 1 0 0 0 20 0 1 0 345823386 18878464 3567 33554432000 4194304 9016284 140737273869808 140737273801560 4530476 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 4609 3567 360 1178 0 3427 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18436

[startup+0.100253 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1191
/proc/meminfo: memFree=23090180/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=36068 CPUtime=0.09 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 7973 0 0 0 9 0 0 0 20 0 1 0 345823386 36933632 7928 33554432000 4194304 9016284 140737273869808 140737273801560 6813403 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 9273 7953 360 1178 0 8091 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 36068

[startup+0.300245 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1191
/proc/meminfo: memFree=23090180/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=63932 CPUtime=0.28 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 14968 0 0 0 27 1 0 0 20 0 1 0 345823386 65466368 14922 33554432000 4194304 9016284 140737273869808 140737273801560 7842257 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 15983 14922 360 1178 0 14801 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 63932

[startup+0.700243 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 1191
/proc/meminfo: memFree=23090180/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=120540 CPUtime=0.68 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 29104 0 0 0 65 3 0 0 20 0 1 0 345823386 123432960 29058 33554432000 4194304 9016284 140737273869808 140737273801560 7870493 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 30135 29058 360 1178 0 28953 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 120540

[startup+1.50025 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=22928328/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=243840 CPUtime=1.49 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 59867 0 0 0 142 7 0 0 20 0 1 0 345823386 249692160 59821 33554432000 4194304 9016284 140737273869808 140737273733704 6151852 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 60960 59821 360 1178 0 59778 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 243840

[startup+3.10018 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=22761284/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=454532 CPUtime=3.09 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 112595 0 0 0 295 14 0 0 20 0 1 0 345823386 465440768 112549 33554432000 4194304 9016284 140737273869808 140737273733704 4992855 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 113633 112549 360 1178 0 112451 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 454532

[startup+6.30025 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=21922352/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=1255012 CPUtime=6.29 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 309590 0 0 0 588 41 0 0 20 0 1 0 345823386 1285132288 311290 33554432000 4194304 9016284 140737273869808 140737273865896 4318833 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 313753 311290 487 1178 0 312571 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1255012

[startup+12.7001 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=21592936/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=1509592 CPUtime=12.69 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 406087 0 0 0 1212 57 0 0 20 0 1 0 345823386 1545822208 373180 33554432000 4194304 9016284 140737273869808 140737273864872 6480407 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 377398 373180 529 1178 0 376216 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1509592

[startup+25.5068 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=21486288/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=1613128 CPUtime=25.49 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 431571 0 0 0 2489 60 0 0 20 0 1 0 345823386 1651843072 398664 33554432000 4194304 9016284 140737273869808 140737273865400 6480372 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 403282 398664 529 1178 0 402100 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1613128

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=21282028/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=1809772 CPUtime=51.08 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 480681 0 0 0 5042 66 0 0 20 0 1 0 345823386 1853206528 447774 33554432000 4194304 9016284 140737273869808 140737273865192 4222983 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 452443 447774 529 1178 0 451261 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1809772

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=20811352/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2047556 CPUtime=102.27 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 540291 0 0 0 10153 74 0 0 20 0 1 0 345823386 2096697344 505337 33554432000 4194304 9016284 140737273869808 140737273865400 4222983 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 511889 505337 529 1178 0 510707 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 2047556

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=20524840/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2311608 CPUtime=162.26 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 586301 0 0 0 16145 81 0 0 20 0 1 0 345823386 2367086592 570254 33554432000 4194304 9016284 140737273869808 140737273865400 6480403 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 577902 570254 529 1178 0 576720 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 2311608

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1192
/proc/meminfo: memFree=20488972/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2323848 CPUtime=222.26 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 588787 0 0 0 22145 81 0 0 20 0 1 0 345823386 2379620352 573251 33554432000 4194304 9016284 140737273869808 140737273865400 6480379 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 580962 573251 529 1178 0 579780 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 2323848

[startup+282.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 1193
/proc/meminfo: memFree=20297356/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2508344 CPUtime=282.25 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 632316 0 0 0 28137 88 0 0 20 0 1 0 345823386 2568544256 616900 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 627086 616900 529 1178 0 625904 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 2508344

[startup+342.307 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 1193
/proc/meminfo: memFree=20017520/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2778156 CPUtime=342.24 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 699444 0 0 0 34122 102 0 0 20 0 1 0 345823386 2844831744 684028 33554432000 4194304 9016284 140737273869808 140737273865192 6480376 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 694539 684028 529 1178 0 693357 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 2778156

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1193
/proc/meminfo: memFree=19816296/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=2977200 CPUtime=402.23 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 747914 0 0 0 40111 112 0 0 20 0 1 0 345823386 3048652800 732498 33554432000 4194304 9016284 140737273869808 140737273865192 6480403 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 744300 732498 529 1178 0 743118 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 2977200

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 1196
/proc/meminfo: memFree=19546064/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=3249732 CPUtime=462.21 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 812364 0 0 0 46097 124 0 0 20 0 1 0 345823386 3327725568 796948 33554432000 4194304 9016284 140737273869808 140737273865192 6480372 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 812433 796948 529 1178 0 811251 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 3249732

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1196
/proc/meminfo: memFree=19500592/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=3265088 CPUtime=522.21 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 818887 0 0 0 52092 129 0 0 20 0 1 0 345823386 3343450112 803471 33554432000 4194304 9016284 140737273869808 140737273865192 6480376 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 816272 803471 529 1178 0 815090 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 3265088

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 1197
/proc/meminfo: memFree=19051244/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=3439312 CPUtime=582.2 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 860046 0 0 0 58084 136 0 0 20 0 1 0 345823386 3521855488 844630 33554432000 4194304 9016284 140737273869808 140737273865192 6480398 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 859828 844630 529 1178 0 858646 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3439312

[startup+642.3 s]

################
# More data... #
################

/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 985460 0 0 0 100047 166 0 0 20 0 1 0 345823386 4032307200 971183 33554432000 4194304 9016284 140737273869808 140737273865192 6480372 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 984450 971183 529 1178 0 983268 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 3937800

[startup+1062.3 s]
/proc/loadavg: 2.09 2.07 2.02 3/178 1240
/proc/meminfo: memFree=20707992/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=3950084 CPUtime=1062.12 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 990833 0 0 0 106043 169 0 0 20 0 1 0 345823386 4044886016 977249 33554432000 4194304 9016284 140737273869808 140737273865192 6480403 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 987521 977249 529 1178 0 986339 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 3950084

[startup+1122.3 s]
/proc/loadavg: 2.03 2.06 2.01 3/177 1240
/proc/meminfo: memFree=20098944/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4224680 CPUtime=1122.11 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1050926 0 0 0 112033 178 0 0 20 0 1 0 345823386 4326072320 1037748 33554432000 4194304 9016284 140737273869808 140737273865192 6480360 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1056170 1037748 529 1178 0 1054988 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 4224680

[startup+1182.3 s]
/proc/loadavg: 2.04 2.06 2.01 3/177 1240
/proc/meminfo: memFree=19886824/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4236968 CPUtime=1182.11 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1056342 0 0 0 118029 182 0 0 20 0 1 0 345823386 4338655232 1043712 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1059242 1043712 529 1178 0 1058060 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 4236968

[startup+1242.3 s]
/proc/loadavg: 2.08 2.07 2.01 3/177 1241
/proc/meminfo: memFree=19701828/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4249252 CPUtime=1242.09 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1061479 0 0 0 124025 184 0 0 20 0 1 0 345823386 4351234048 1049180 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1062313 1049180 529 1178 0 1061131 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 4249252

[startup+1302.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/177 1241
/proc/meminfo: memFree=19550532/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4258468 CPUtime=1302.08 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1065430 0 0 0 130022 186 0 0 20 0 1 0 345823386 4360671232 1054247 33554432000 4194304 9016284 140737273869808 140737273865192 6480403 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1064617 1054247 529 1178 0 1063435 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 4258468

[startup+1362.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/177 1241
/proc/meminfo: memFree=19378184/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4261540 CPUtime=1362.08 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1066895 0 0 0 136021 187 0 0 20 0 1 0 345823386 4363816960 1056789 33554432000 4194304 9016284 140737273869808 140737273865192 6480407 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1065385 1056789 529 1178 0 1064203 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 4261540

[startup+1422.3 s]
/proc/loadavg: 2.05 2.07 2.01 3/178 1242
/proc/meminfo: memFree=19324280/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4266660 CPUtime=1422.07 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1068906 0 0 0 142019 188 0 0 20 0 1 0 345823386 4369059840 1059304 33554432000 4194304 9016284 140737273869808 140737273865192 6480372 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1066665 1059304 529 1178 0 1065483 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 4266660

[startup+1482.3 s]
/proc/loadavg: 2.02 2.05 2.01 3/177 1242
/proc/meminfo: memFree=19123188/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4274736 CPUtime=1482.06 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1072098 0 0 0 148017 189 0 0 20 0 1 0 345823386 4377329664 1062887 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1068684 1062887 529 1178 0 1067502 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 4274736

[startup+1542.3 s]
/proc/loadavg: 2.04 2.06 2.01 3/177 1243
/proc/meminfo: memFree=18813204/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4597600 CPUtime=1542.04 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1141030 0 0 0 154005 199 0 0 20 0 1 0 345823386 4707942400 1132267 33554432000 4194304 9016284 140737273869808 140737273865192 6480360 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1149400 1132267 529 1178 0 1148218 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 4597600

[startup+1602.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/177 1243
/proc/meminfo: memFree=18786464/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4606812 CPUtime=1602.04 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1144808 0 0 0 160002 202 0 0 20 0 1 0 345823386 4717375488 1136434 33554432000 4194304 9016284 140737273869808 140737273865192 6480412 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1151703 1136434 529 1178 0 1150521 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 4606812

[startup+1662.31 s]
/proc/loadavg: 2.02 2.04 2.00 3/178 1246
/proc/meminfo: memFree=18570336/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4616028 CPUtime=1662.03 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1148825 0 0 0 165999 204 0 0 20 0 1 0 345823386 4726812672 1140703 33554432000 4194304 9016284 140737273869808 140737273865192 6480421 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1154007 1140703 529 1178 0 1152825 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 4616028

[startup+1722.3 s]
/proc/loadavg: 2.07 2.06 2.01 3/177 1246
/proc/meminfo: memFree=18543356/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4625240 CPUtime=1722.01 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1152856 0 0 0 171996 205 0 0 20 0 1 0 345823386 4736245760 1144734 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1156310 1144734 529 1178 0 1155128 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 4625240

[startup+1782.3 s]
/proc/loadavg: 2.11 2.08 2.01 3/177 1246
/proc/meminfo: memFree=18502092/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4634456 CPUtime=1782 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1156827 0 0 0 177993 207 0 0 20 0 1 0 345823386 4745682944 1148879 33554432000 4194304 9016284 140737273869808 140737273865192 6480372 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1158614 1148879 529 1178 0 1157432 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 4634456



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.14 2.09 2.01 3/176 1246
/proc/meminfo: memFree=18489792/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4637528 CPUtime=1800.01 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1158085 0 0 0 179793 208 0 0 20 0 1 0 345823386 4748828672 1150137 33554432000 4194304 9016284 140737273869808 140737273865192 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1159382 1150137 529 1178 0 1158200 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 4637528

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -1191

Solver just ended. Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.14 2.09 2.01 3/177 1247
/proc/meminfo: memFree=18489792/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4637528 CPUtime=1801.31 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1158121 0 0 0 179923 208 0 0 20 0 1 0 345823386 4748828672 1150173 33554432000 4194304 9016284 140737273869808 140737273864640 6480389 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1159382 1150173 529 1178 0 1158200 0
Current children cumulated CPU time (s) 1801.31
Current children cumulated vsize (KiB) 4637528

[startup+1802.01 s]
/proc/loadavg: 2.14 2.09 2.01 3/178 1248
/proc/meminfo: memFree=18489156/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=4637528 CPUtime=1801.71 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4202496 1158127 0 0 0 179963 208 0 0 20 0 1 0 345823386 4748828672 1150179 33554432000 4194304 9016284 140737273869808 140737273864640 6480360 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 1159382 1150179 529 1178 0 1158200 0
Current children cumulated CPU time (s) 1801.71
Current children cumulated vsize (KiB) 4637528

[startup+1802.4 s]
/proc/loadavg: 2.14 2.09 2.01 3/178 1248
/proc/meminfo: memFree=18489156/32873660 swapFree=7120/7120
[pid=1191] ppid=1189 vsize=0 CPUtime=1802.1 cores=1,3,5,7
/proc/1191/stat : 1191 (scip-2.0.1.4b_2) R 1189 1191 31309 0 -1 4203524 1158131 0 0 0 179993 217 0 0 20 0 1 0 345823386 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1191/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.48
CPU time (s): 1802.19
CPU user time (s): 1799.94
CPU system time (s): 2.25066
CPU usage (%): 99.984
Max. virtual memory (cumulated for all children) (KiB): 4637528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.94
system time used= 2.25066
maximum resident set size= 4600732
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1158131
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 35
involuntary context switches= 1866

runsolver used 3.18052 second user time and 8.24075 second system time

The end

Launcher Data 

Begin job on node117 at 2012-06-04 10:02:56
IDJOB=3743273
IDBENCH=90939
IDSOLVER=2329
FILE ID=node117/3743273-1338796976
RUNJOBID= node117-1338764718-31326
PBS_JOBID= 14636813
Free space on /tmp= 69052 MiB

SOLVER NAME= PB11: SCIP spx E_2 2011-06-10 (fixed)
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX300_K192_cod2.opb
COMMAND LINE= HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743273-1338796976/watcher-3743273-1338796976 -o /tmp/evaluation-result-3743273-1338796976/solver-3743273-1338796976 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743273-1338796976.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cd577d7fe2c7600d8302daa2328d0cdf
RANDOM SEED=892542631

node117.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.148
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873660 kB
MemFree:        23090180 kB
Buffers:          639464 kB
Cached:          4320600 kB
SwapCached:          776 kB
Active:          6375012 kB
Inactive:        2484896 kB
Active(anon):    3885744 kB
Inactive(anon):     9972 kB
Active(file):    2489268 kB
Inactive(file):  2474924 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108856 kB
SwapFree:       67107012 kB
Dirty:             44320 kB
Writeback:             0 kB
AnonPages:       3901684 kB
Mapped:            14380 kB
Shmem:                80 kB
Slab:             780788 kB
SReclaimable:     224804 kB
SUnreclaim:       555984 kB
KernelStack:        1448 kB
PageTables:        12004 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545684 kB
Committed_AS:    4060656 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     98304 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69036 MiB
End job on node117 at 2012-06-04 10:32:59