Trace number 3743759

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver? (TO) 1802.1 1802.44

General information on the benchmark

Name/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX300_K192_cod1.opb
MD5SUMd5a8bb9ed5309f201221b880b841b89a
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-13312
Best CPU time to get the best result obtained on this benchmark1800.34
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables399113
Total number of constraints400980
Number of constraints which are clauses399002
Number of constraints which are cardinality constraints (but not clauses)1977
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint397089
Number of terms in the objective function 170372
Biggest coefficient in the objective function 1024
Number of bits for the biggest coefficient in the objective function 11
Sum of the numbers in the objective function 174265535
Number of bits of the sum of numbers in the objective function 28
Biggest number in a constraint 1024
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 174265535
Number of bits of the biggest sum of numbers28
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 1.2.1.3 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.4.2]
0.00/0.00	c Copyright (c) 2002-2010 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743759-1338793133.opb>
5.09/5.14	c original problem has 399113 variables (399113 bin, 0 int, 0 impl, 0 cont) and 400980 constraints
5.09/5.14	c problem read
5.09/5.14	c presolving settings loaded
7.09/7.13	c presolving:
8.98/9.03	c (round 1) 170181 del vars, 171072 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 50616 impls, 1086 clqs
10.79/10.80	c (round 2) 170181 del vars, 171266 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229520 upgd conss, 50616 impls, 1086 clqs
11.29/11.35	c (round 3) 170181 del vars, 171266 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 50616 impls, 1086 clqs
223.54/223.66	c (round 4) 170529 del vars, 171266 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 3949508 impls, 1086 clqs
223.94/224.01	c (round 5) 170529 del vars, 171614 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 3952226 impls, 1086 clqs
245.73/245.89	c (round 6) 171551 del vars, 171614 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 3968744 impls, 1086 clqs
246.13/246.22	c (round 7) 171551 del vars, 172636 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 3968752 impls, 1086 clqs
630.17/630.32	c (round 8) 171893 del vars, 172636 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 11802660 impls, 1086 clqs
630.46/630.65	c (round 9) 171893 del vars, 172975 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 229714 upgd conss, 11802668 impls, 1086 clqs
1800.06/1800.40	c pressed CTRL-C 1 times (5 times for forcing termination)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743759-1338793133/watcher-3743759-1338793133 -o /tmp/evaluation-result-3743759-1338793133/solver-3743759-1338793133 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743759-1338793133.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 2857
/proc/meminfo: memFree=25637592/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=7916 CPUtime=0 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 1243 0 0 0 0 0 0 0 20 0 1 0 345441975 8105984 1189 33554432000 4194304 8395647 140736188191888 140733459324344 7385025 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 1979 1189 370 1026 0 949 0

[startup+0.0232999 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 2857
/proc/meminfo: memFree=25637592/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=15144 CPUtime=0.01 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 3040 0 0 0 1 0 0 0 20 0 1 0 345441975 15507456 2985 33554432000 4194304 8395647 140736188191888 140733459324344 4424487 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 3786 2985 387 1026 0 2756 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15144

[startup+0.100295 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 2857
/proc/meminfo: memFree=25637592/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=46312 CPUtime=0.08 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 10762 0 0 0 8 0 0 0 20 0 1 0 345441975 47423488 10702 33554432000 4194304 8395647 140736188191888 140733459324344 7301320 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 11578 10702 387 1026 0 10548 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 46312

[startup+0.300286 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 2857
/proc/meminfo: memFree=25637592/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=124052 CPUtime=0.29 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 29556 0 0 0 26 3 0 0 20 0 1 0 345441975 127029248 29497 33554432000 4194304 8395647 140736188191888 140733459324344 6347101 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 31013 29534 387 1026 0 29983 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 124052

[startup+0.700273 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 2857
/proc/meminfo: memFree=25637592/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=177056 CPUtime=0.69 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 42956 0 0 0 64 5 0 0 20 0 1 0 345441975 181305344 42896 33554432000 4194304 8395647 140736188191888 140736188057096 7382061 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 44264 42896 394 1026 0 43234 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 177056

[startup+1.50023 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 2858
/proc/meminfo: memFree=25447344/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=303348 CPUtime=1.49 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 74520 0 0 0 139 10 0 0 20 0 1 0 345441975 310628352 74460 33554432000 4194304 8395647 140736188191888 140736188057096 4685157 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 75837 74460 394 1026 0 74807 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 303348

[startup+3.10028 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 2858
/proc/meminfo: memFree=25300520/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=383228 CPUtime=3.09 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 94441 0 0 0 296 13 0 0 20 0 1 0 345441975 392425472 94381 33554432000 4194304 8395647 140736188191888 140736188056760 7370532 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 95807 94381 394 1026 0 94777 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 383228

[startup+6.30029 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 2858
/proc/meminfo: memFree=24960136/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1077200 CPUtime=6.29 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 266205 0 0 0 595 34 0 0 20 0 1 0 345441975 1103052800 267835 33554432000 4194304 8395647 140736188191888 140736188188168 4449009 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/2857/statm: 269300 267835 421 1026 0 268270 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1077200

[startup+12.7003 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 2858
/proc/meminfo: memFree=24244680/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1397740 CPUtime=12.69 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 338819 0 0 0 1225 44 0 0 20 0 1 0 345441975 1431285760 347565 33554432000 4194304 8395647 140736188191888 140736188187688 5604430 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 349435 347565 502 1026 0 348405 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1397740

[startup+25.5004 s]
/proc/loadavg: 2.17 2.04 2.01 3/177 2897
/proc/meminfo: memFree=26092956/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1397740 CPUtime=25.48 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 338827 0 0 0 2504 44 0 0 20 0 1 0 345441975 1431285760 347572 33554432000 4194304 8395647 140736188191888 140736188187688 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 349435 347572 502 1026 0 348405 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1397740

[startup+51.1003 s]
/proc/loadavg: 2.11 2.04 2.01 3/177 2897
/proc/meminfo: memFree=25527480/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1397740 CPUtime=51.08 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 338834 0 0 0 5064 44 0 0 20 0 1 0 345441975 1431285760 347648 33554432000 4194304 8395647 140736188191888 140736188187688 4911320 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 349435 347648 502 1026 0 348405 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1397740

[startup+102.307 s]
/proc/loadavg: 2.04 2.03 2.00 3/178 2901
/proc/meminfo: memFree=25526632/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1398224 CPUtime=102.27 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 338854 0 0 0 10183 44 0 0 20 0 1 0 345441975 1431781376 347654 33554432000 4194304 8395647 140736188191888 140736188187688 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 349556 347654 502 1026 0 348526 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 1398224

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/178 2924
/proc/meminfo: memFree=25488220/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1438220 CPUtime=162.24 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 348597 0 0 0 16179 45 0 0 20 0 1 0 345441975 1472737280 357390 33554432000 4194304 8395647 140736188191888 140736188187960 6080692 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 359555 357390 502 1026 0 358525 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 1438220

[startup+222.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 2924
/proc/meminfo: memFree=25412864/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1480908 CPUtime=222.24 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 359414 0 0 0 22177 47 0 0 20 0 1 0 345441975 1516449792 368207 33554432000 4194304 8395647 140736188191888 140736188187960 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 370227 368207 502 1026 0 369197 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 1480908

[startup+282.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 2924
/proc/meminfo: memFree=25350000/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1511712 CPUtime=282.23 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 361174 0 0 0 28176 47 0 0 20 0 1 0 345441975 1547993088 376097 33554432000 4194304 8395647 140736188191888 140736188187688 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 377928 376097 502 1026 0 376898 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 1511712

[startup+342.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 2924
/proc/meminfo: memFree=25295468/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1542460 CPUtime=342.22 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 368308 0 0 0 34174 48 0 0 20 0 1 0 345441975 1579479040 383231 33554432000 4194304 8395647 140736188191888 140736188187960 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 385615 383231 502 1026 0 384585 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 1542460

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/176 2924
/proc/meminfo: memFree=25236604/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1577212 CPUtime=402.21 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 377041 0 0 0 40171 50 0 0 20 0 1 0 345441975 1615065088 392309 33554432000 4194304 8395647 140736188191888 140736188187960 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 394303 392309 502 1026 0 393273 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 1577212

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 2925
/proc/meminfo: memFree=25170532/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1623392 CPUtime=462.2 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 388333 0 0 0 46168 52 0 0 20 0 1 0 345441975 1662353408 403646 33554432000 4194304 8395647 140736188191888 140736188187960 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 405848 403646 502 1026 0 404818 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 1623392

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 4/177 2925
/proc/meminfo: memFree=25097096/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1674908 CPUtime=522.18 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 401127 0 0 0 52164 54 0 0 20 0 1 0 345441975 1715105792 416446 33554432000 4194304 8395647 140736188191888 140736188187960 6068889 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 418727 416446 502 1026 0 417697 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 1674908

[startup+582.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 2925
/proc/meminfo: memFree=25029936/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=1725528 CPUtime=582.16 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 413583 0 0 0 58161 55 0 0 20 0 1 0 345441975 1766940672 429044 33554432000 4194304 8395647 140736188191888 140736188187960 4911325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 431382 429044 502 1026 0 430352 0
Current children cumulated CPU time (s) 582.16
Current children cumulated vsize (KiB) 1725528

[startup+642.3 s]

################
# More data... #
################

/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 612365 0 0 0 100116 93 0 0 20 0 1 0 345441975 2661130240 647053 33554432000 4194304 8395647 140736188191888 140736188187752 6080679 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 649690 647053 502 1026 0 648660 0
Current children cumulated CPU time (s) 1002.09
Current children cumulated vsize (KiB) 2598760

[startup+1062.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 2930
/proc/meminfo: memFree=23381980/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2734384 CPUtime=1062.08 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 642512 0 0 0 106110 98 0 0 20 0 1 0 345441975 2800009216 677550 33554432000 4194304 8395647 140736188191888 140736188187752 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 683596 677550 502 1026 0 682566 0
Current children cumulated CPU time (s) 1062.08
Current children cumulated vsize (KiB) 2734384

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 2.00 4/177 2930
/proc/meminfo: memFree=23276912/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2745648 CPUtime=1122.07 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 647175 0 0 0 112106 101 0 0 20 0 1 0 345441975 2811543552 682435 33554432000 4194304 8395647 140736188191888 140736188187752 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 686412 682435 502 1026 0 685382 0
Current children cumulated CPU time (s) 1122.07
Current children cumulated vsize (KiB) 2745648

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2930
/proc/meminfo: memFree=23171856/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2752816 CPUtime=1182.06 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 650295 0 0 0 118103 103 0 0 20 0 1 0 345441975 2818883584 685945 33554432000 4194304 8395647 140736188191888 140736188187752 6080675 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 688204 685945 502 1026 0 687174 0
Current children cumulated CPU time (s) 1182.06
Current children cumulated vsize (KiB) 2752816

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2930
/proc/meminfo: memFree=23017256/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2910656 CPUtime=1242.05 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 684506 0 0 0 124097 108 0 0 20 0 1 0 345441975 2980511744 720407 33554432000 4194304 8395647 140736188191888 140736188187752 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 727664 720407 502 1026 0 726634 0
Current children cumulated CPU time (s) 1242.05
Current children cumulated vsize (KiB) 2910656

[startup+1302.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 2933
/proc/meminfo: memFree=22990600/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2918848 CPUtime=1302.04 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 687823 0 0 0 130095 109 0 0 20 0 1 0 345441975 2988900352 723897 33554432000 4194304 8395647 140736188191888 140736188187752 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 729712 723897 502 1026 0 728682 0
Current children cumulated CPU time (s) 1302.04
Current children cumulated vsize (KiB) 2918848

[startup+1362.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 2935
/proc/meminfo: memFree=22877804/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2926012 CPUtime=1362.03 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 690789 0 0 0 136092 111 0 0 20 0 1 0 345441975 2996236288 726863 33554432000 4194304 8395647 140736188191888 140736188187752 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 731503 726863 502 1026 0 730473 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 2926012

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2935
/proc/meminfo: memFree=22847716/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2932156 CPUtime=1422.03 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 693433 0 0 0 142091 112 0 0 20 0 1 0 345441975 3002527744 730263 33554432000 4194304 8395647 140736188191888 140736188187752 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 733039 730263 502 1026 0 732009 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 2932156

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2935
/proc/meminfo: memFree=22715948/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=2938300 CPUtime=1482 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 695436 0 0 0 148088 112 0 0 20 0 1 0 345441975 3008819200 732904 33554432000 4194304 8395647 140736188191888 140736188187752 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 734575 732904 502 1026 0 733545 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 2938300

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2935
/proc/meminfo: memFree=22538984/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3129044 CPUtime=1541.99 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 736162 0 0 0 154080 119 0 0 20 0 1 0 345441975 3204141056 773962 33554432000 4194304 8395647 140736188191888 140736188187752 6080675 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 782261 773962 502 1026 0 781231 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 3129044

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2935
/proc/meminfo: memFree=22511236/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3139284 CPUtime=1601.98 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 740407 0 0 0 160077 121 0 0 20 0 1 0 345441975 3214626816 778209 33554432000 4194304 8395647 140736188191888 140736188187752 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 784821 778209 502 1026 0 783791 0
Current children cumulated CPU time (s) 1601.98
Current children cumulated vsize (KiB) 3139284

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2936
/proc/meminfo: memFree=22490432/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3143380 CPUtime=1661.97 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 742318 0 0 0 166075 122 0 0 20 0 1 0 345441975 3218821120 780120 33554432000 4194304 8395647 140736188191888 140736188187752 6080675 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 785845 780120 502 1026 0 784815 0
Current children cumulated CPU time (s) 1661.97
Current children cumulated vsize (KiB) 3143380

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2936
/proc/meminfo: memFree=22470372/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3148496 CPUtime=1721.96 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 744486 0 0 0 172073 123 0 0 20 0 1 0 345441975 3224059904 782526 33554432000 4194304 8395647 140736188191888 140736188187752 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 787124 782526 502 1026 0 786094 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 3148496

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2936
/proc/meminfo: memFree=22324100/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3152592 CPUtime=1781.95 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 746338 0 0 0 178071 124 0 0 20 0 1 0 345441975 3228254208 784378 33554432000 4194304 8395647 140736188191888 140736188187752 6080705 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 788148 784378 502 1026 0 787118 0
Current children cumulated CPU time (s) 1781.95
Current children cumulated vsize (KiB) 3152592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 2936
/proc/meminfo: memFree=22316132/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3154640 CPUtime=1800.06 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 747127 0 0 0 179881 125 0 0 20 0 1 0 345441975 3230351360 785167 33554432000 4194304 8395647 140736188191888 140736188187752 6080675 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 788660 785167 502 1026 0 787630 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 3154640

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -2857

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 2937
/proc/meminfo: memFree=22316132/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3154640 CPUtime=1801.05 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 747146 0 0 0 179980 125 0 0 20 0 1 0 345441975 3230351360 785186 33554432000 4194304 8395647 140736188191888 140736188187200 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 788660 785186 502 1026 0 787630 0
Current children cumulated CPU time (s) 1801.05
Current children cumulated vsize (KiB) 3154640

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 2937
/proc/meminfo: memFree=22315876/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3154640 CPUtime=1801.85 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 747158 0 0 0 180060 125 0 0 20 0 1 0 345441975 3230351360 785198 33554432000 4194304 8395647 140736188191888 140736188187200 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 788660 785198 502 1026 0 787630 0
Current children cumulated CPU time (s) 1801.85
Current children cumulated vsize (KiB) 3154640

[startup+1802.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 2937
/proc/meminfo: memFree=22315876/32873844 swapFree=7372/7372
[pid=2857] ppid=2855 vsize=3154640 CPUtime=1802.05 cores=0,2,4,6
/proc/2857/stat : 2857 (pbscip.linux.x8) R 2855 2857 2230 0 -1 4202496 747160 0 0 0 180080 125 0 0 20 0 1 0 345441975 3230351360 785200 33554432000 4194304 8395647 140736188191888 140736188187200 6080665 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/2857/statm: 788660 785200 502 1026 0 787630 0
Current children cumulated CPU time (s) 1802.05
Current children cumulated vsize (KiB) 3154640

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.44
CPU time (s): 1802.1
CPU user time (s): 1800.81
CPU system time (s): 1.2868
CPU usage (%): 99.9809
Max. virtual memory (cumulated for all children) (KiB): 3154640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.81
system time used= 1.2868
maximum resident set size= 3140800
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 747160
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 114
involuntary context switches= 1965

runsolver used 4.66429 second user time and 11.7362 second system time

The end

Launcher Data 

Begin job on node109 at 2012-06-04 08:58:54
IDJOB=3743759
IDBENCH=92353
IDSOLVER=2326
FILE ID=node109/3743759-1338793133
RUNJOBID= node109-1338782366-2246
PBS_JOBID= 14636835
Free space on /tmp= 70648 MiB

SOLVER NAME= PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/sroussel/NG/normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX300_K192_cod1.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743759-1338793133/watcher-3743759-1338793133 -o /tmp/evaluation-result-3743759-1338793133/solver-3743759-1338793133 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743759-1338793133.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d5a8bb9ed5309f201221b880b841b89a
RANDOM SEED=1794734903

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        25637856 kB
Buffers:         1873268 kB
Cached:          1785492 kB
SwapCached:          988 kB
Active:          5191504 kB
Inactive:        1154224 kB
Active(anon):    2673780 kB
Inactive(anon):    11964 kB
Active(file):    2517724 kB
Inactive(file):  1142260 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67105540 kB
Dirty:             40340 kB
Writeback:             0 kB
AnonPages:       2693916 kB
Mapped:            12452 kB
Shmem:                 4 kB
Slab:             741656 kB
SReclaimable:     183456 kB
SUnreclaim:       558200 kB
KernelStack:        1440 kB
PageTables:         9444 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    2958968 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    258048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70636 MiB
End job on node109 at 2012-06-04 09:28:57