Trace number 3743262

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB11: SCIP spx E_2 2011-06-10 (fixed)? (TO) 1802.17 1802.47

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null20mast_rapportOE1.0_TMAX15_K192_cod2.opb
MD5SUMda53a74913ae0ed6caffae915d70714d
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-11389
Best CPU time to get the best result obtained on this benchmark619.196
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 892
Biggest coefficient in the objective function 1000
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 623794
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 1000
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 623794
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 2.0.1.5 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743262-1338796902.opb>
3.38/3.45	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
3.38/3.45	c problem read
3.38/3.45	c presolving settings loaded
5.18/5.24	c presolving:
7.79/7.90	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
8.59/8.66	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs
112.18/112.27	c (round 3) 679 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17190162 impls, 1977 clqs
112.37/112.46	c (round 4) 679 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17195504 impls, 1977 clqs
113.77/113.81	c (round 5) 2685 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17228896 impls, 1977 clqs
113.97/114.01	c (round 6) 2685 del vars, 4659 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17228904 impls, 1977 clqs
237.24/237.38	c (round 7) 3355 del vars, 4659 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19823854 impls, 1977 clqs
237.45/237.57	c (round 8) 3355 del vars, 5326 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19823862 impls, 1977 clqs

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743262-1338796902/watcher-3743262-1338796902 -o /tmp/evaluation-result-3743262-1338796902/solver-3743262-1338796902 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743262-1338796902.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 5/177 12479
/proc/meminfo: memFree=23902360/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=9456 CPUtime=0 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1493 0 0 0 0 0 0 0 20 0 1 0 345816262 9682944 1448 33554432000 4194304 9016284 140737215179024 140734471820808 7875499 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 2364 1449 311 1178 0 1182 0

[startup+0.0398871 s]
/proc/loadavg: 2.00 2.01 2.00 5/177 12479
/proc/meminfo: memFree=23902360/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=22804 CPUtime=0.03 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 4689 0 0 0 3 0 0 0 20 0 1 0 345816262 23351296 4644 33554432000 4194304 9016284 140737215179024 140734471820808 7928096 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 5701 4644 360 1178 0 4519 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 22804

[startup+0.100352 s]
/proc/loadavg: 2.00 2.01 2.00 5/177 12479
/proc/meminfo: memFree=23902360/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=35900 CPUtime=0.08 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 7938 0 0 0 8 0 0 0 20 0 1 0 345816262 36761600 7893 33554432000 4194304 9016284 140737215179024 140737215042712 6151448 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 8975 7893 360 1178 0 7793 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 35900

[startup+0.300235 s]
/proc/loadavg: 2.00 2.01 2.00 5/177 12479
/proc/meminfo: memFree=23902360/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=63952 CPUtime=0.28 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 14968 0 0 0 27 1 0 0 20 0 1 0 345816262 65486848 14923 33554432000 4194304 9016284 140737215179024 140737215042712 7989800 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 15988 14923 360 1178 0 14806 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 63952

[startup+0.700235 s]
/proc/loadavg: 2.00 2.01 2.00 5/177 12479
/proc/meminfo: memFree=23902360/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=118520 CPUtime=0.69 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 28595 0 0 0 66 3 0 0 20 0 1 0 345816262 121364480 28550 33554432000 4194304 9016284 140737215179024 140737215042712 7713472 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 29630 28550 360 1178 0 28448 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 118520

[startup+1.50023 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 12480
/proc/meminfo: memFree=23742376/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=243868 CPUtime=1.49 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 59870 0 0 0 142 7 0 0 20 0 1 0 345816262 249720832 59825 33554432000 4194304 9016284 140737215179024 140737215042920 7870468 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 60967 59826 360 1178 0 59785 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 243868

[startup+3.10024 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 12480
/proc/meminfo: memFree=23573612/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=454560 CPUtime=3.09 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 112597 0 0 0 295 14 0 0 20 0 1 0 345816262 465469440 112552 33554432000 4194304 9016284 140737215179024 140737215042920 6816922 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 113640 112552 360 1178 0 112458 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 454560

[startup+6.30023 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12480
/proc/meminfo: memFree=22736972/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=1257444 CPUtime=6.29 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 310198 0 0 0 588 41 0 0 20 0 1 0 345816262 1287622656 311752 33554432000 4194304 9016284 140737215179024 140737215175640 4318833 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 314361 311752 487 1178 0 313179 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1257444

[startup+12.7001 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12480
/proc/meminfo: memFree=22408880/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=1509688 CPUtime=12.69 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 406777 0 0 0 1211 58 0 0 20 0 1 0 345816262 1545920512 373213 33554432000 4194304 9016284 140737215179024 140737215174616 6480433 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 377422 373213 529 1178 0 376240 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1509688

[startup+25.5002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12480
/proc/meminfo: memFree=22306632/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=1612328 CPUtime=25.49 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 431936 0 0 0 2487 62 0 0 20 0 1 0 345816262 1651023872 398372 33554432000 4194304 9016284 140737215179024 140737215174776 6476072 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 403082 398372 529 1178 0 401900 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1612328

[startup+51.1002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=22100992/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=1808768 CPUtime=51.08 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 480979 0 0 0 5040 68 0 0 20 0 1 0 345816262 1852178432 447415 33554432000 4194304 9016284 140737215179024 140737215174616 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 452192 447415 529 1178 0 451010 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1808768

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=21766484/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=2131264 CPUtime=102.28 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 559163 0 0 0 10149 79 0 0 20 0 1 0 345816262 2182414336 525599 33554432000 4194304 9016284 140737215179024 140737215174616 6480407 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 532816 525599 529 1178 0 531634 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2131264

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=21519120/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=2366636 CPUtime=162.26 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 600116 0 0 0 16140 86 0 0 20 0 1 0 345816262 2423435264 583412 33554432000 4194304 9016284 140737215179024 140737215174616 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 591659 583412 529 1178 0 590477 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 2366636

[startup+222.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 12481
/proc/meminfo: memFree=21502160/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=2376596 CPUtime=222.25 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 602548 0 0 0 22139 86 0 0 20 0 1 0 345816262 2433634304 585844 33554432000 4194304 9016284 140737215179024 140737215174616 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 594149 585844 529 1178 0 592967 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 2376596

[startup+282.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12481
/proc/meminfo: memFree=21190516/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=2691688 CPUtime=282.25 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 678652 0 0 0 28127 98 0 0 20 0 1 0 345816262 2756288512 661557 33554432000 4194304 9016284 140737215179024 140737215174408 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 672922 661557 529 1178 0 671740 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 2691688

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=20941396/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=2928444 CPUtime=342.23 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 737647 0 0 0 34116 107 0 0 20 0 1 0 345816262 2998726656 720552 33554432000 4194304 9016284 140737215179024 140737215174408 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 732111 720552 529 1178 0 730929 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 2928444

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12482
/proc/meminfo: memFree=20447780/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=3153072 CPUtime=402.22 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 790777 0 0 0 40106 116 0 0 20 0 1 0 345816262 3228745728 773682 33554432000 4194304 9016284 140737215179024 140737215174408 6480376 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 788268 773682 529 1178 0 787086 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 3153072

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12482
/proc/meminfo: memFree=20273464/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=3312244 CPUtime=462.22 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 830867 0 0 0 46098 124 0 0 20 0 1 0 345816262 3391737856 813772 33554432000 4194304 9016284 140737215179024 140737215174408 6480393 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 828061 813772 529 1178 0 826879 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 3312244

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12485
/proc/meminfo: memFree=20083272/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=3486464 CPUtime=522.21 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 872160 0 0 0 52090 131 0 0 20 0 1 0 345816262 3570139136 855065 33554432000 4194304 9016284 140737215179024 140737215174408 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 871616 855065 529 1178 0 870434 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 3486464

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12485
/proc/meminfo: memFree=20042264/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=3499096 CPUtime=582.2 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 877334 0 0 0 58087 133 0 0 20 0 1 0 345816262 3583074304 860239 33554432000 4194304 9016284 140737215179024 140737215174408 6480379 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 874774 860239 529 1178 0 873592 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3499096

[startup+642.3 s]

################
# More data... #
################

/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 998995 0 0 0 100055 158 0 0 20 0 1 0 345816262 4084088832 984659 33554432000 4194304 9016284 140737215179024 140737215174408 6480384 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 997092 984659 529 1178 0 995910 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 3988368

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12526
/proc/meminfo: memFree=21045752/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=3998608 CPUtime=1062.11 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1003563 0 0 0 106052 159 0 0 20 0 1 0 345816262 4094574592 989997 33554432000 4194304 9016284 140737215179024 140737215174408 6480425 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 999652 989997 529 1178 0 998470 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 3998608

[startup+1122.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 12529
/proc/meminfo: memFree=20661620/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4273204 CPUtime=1122.1 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1063519 0 0 0 112041 169 0 0 20 0 1 0 345816262 4375760896 1050425 33554432000 4194304 9016284 140737215179024 140737215174408 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1068301 1050425 529 1178 0 1067119 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 4273204

[startup+1182.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 12529
/proc/meminfo: memFree=20601888/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4284352 CPUtime=1182.09 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1068037 0 0 0 118039 170 0 0 20 0 1 0 345816262 4387176448 1056121 33554432000 4194304 9016284 140737215179024 140737215174408 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1071088 1056121 529 1178 0 1069906 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 4284352

[startup+1242.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 12529
/proc/meminfo: memFree=20413316/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4293568 CPUtime=1242.09 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1072114 0 0 0 124037 172 0 0 20 0 1 0 345816262 4396613632 1061447 33554432000 4194304 9016284 140737215179024 140737215174408 6480425 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1073392 1061447 529 1178 0 1072210 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 4293568

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 12530
/proc/meminfo: memFree=20203536/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4305856 CPUtime=1302.08 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1076987 0 0 0 130035 173 0 0 20 0 1 0 345816262 4409196544 1066662 33554432000 4194304 9016284 140737215179024 140737215174408 6480364 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1076464 1066662 529 1178 0 1075282 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 4305856

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 12530
/proc/meminfo: memFree=20157808/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4313020 CPUtime=1362.07 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1080104 0 0 0 136033 174 0 0 20 0 1 0 345816262 4416532480 1070271 33554432000 4194304 9016284 140737215179024 140737215174408 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1078255 1070271 529 1178 0 1077073 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 4313020

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12530
/proc/meminfo: memFree=20129936/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4320188 CPUtime=1422.06 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1083276 0 0 0 142031 175 0 0 20 0 1 0 345816262 4423872512 1073666 33554432000 4194304 9016284 140737215179024 140737215174408 6480376 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1080047 1073666 529 1178 0 1078865 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 4320188

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12530
/proc/meminfo: memFree=19917800/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4329404 CPUtime=1482.04 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1087105 0 0 0 148028 176 0 0 20 0 1 0 345816262 4433309696 1077884 33554432000 4194304 9016284 140737215179024 140737215174408 6480376 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1082351 1077884 529 1178 0 1081169 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 4329404

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12531
/proc/meminfo: memFree=19624932/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4653288 CPUtime=1542.04 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1156216 0 0 0 154018 186 0 0 20 0 1 0 345816262 4764966912 1147246 33554432000 4194304 9016284 140737215179024 140737215174408 6480433 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1163322 1147246 529 1178 0 1162140 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 4653288

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12532
/proc/meminfo: memFree=19591240/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4661480 CPUtime=1602.03 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1159594 0 0 0 160016 187 0 0 20 0 1 0 345816262 4773355520 1150624 33554432000 4194304 9016284 140737215179024 140737215174408 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1165370 1150624 529 1178 0 1164188 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 4661480

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 12532
/proc/meminfo: memFree=19552088/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4668648 CPUtime=1662.01 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1162958 0 0 0 166013 188 0 0 20 0 1 0 345816262 4780695552 1154162 33554432000 4194304 9016284 140737215179024 140737215174408 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1167162 1154162 529 1178 0 1165980 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 4668648

[startup+1722.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 12535
/proc/meminfo: memFree=19499044/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4686052 CPUtime=1722.01 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1170046 0 0 0 172011 190 0 0 20 0 1 0 345816262 4798517248 1161511 33554432000 4194304 9016284 140737215179024 140737215174408 6480376 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1171513 1161511 529 1178 0 1170331 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 4686052

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12535
/proc/meminfo: memFree=19245624/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4694244 CPUtime=1781.99 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1173298 0 0 0 178009 190 0 0 20 0 1 0 345816262 4806905856 1164763 33554432000 4194304 9016284 140737215179024 140737215174408 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1173561 1164763 529 1178 0 1172379 0
Current children cumulated CPU time (s) 1781.99
Current children cumulated vsize (KiB) 4694244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12535
/proc/meminfo: memFree=19239780/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4694244 CPUtime=1800 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1173498 0 0 0 179809 191 0 0 20 0 1 0 345816262 4806905856 1164963 33554432000 4194304 9016284 140737215179024 140737215174408 6480412 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1173561 1164963 529 1178 0 1172379 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 4694244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -12479

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12536
/proc/meminfo: memFree=19239392/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4694244 CPUtime=1801.1 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1173507 0 0 0 179919 191 0 0 20 0 1 0 345816262 4806905856 1164972 33554432000 4194304 9016284 140737215179024 140737215173888 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1173561 1164972 529 1178 0 1172379 0
Current children cumulated CPU time (s) 1801.1
Current children cumulated vsize (KiB) 4694244

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12536
/proc/meminfo: memFree=19238268/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=4695268 CPUtime=1801.9 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4202496 1173772 0 0 0 179999 191 0 0 20 0 1 0 345816262 4807954432 1165237 33554432000 4194304 9016284 140737215179024 140737215174408 6480393 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 1173817 1165237 529 1178 0 1172635 0
Current children cumulated CPU time (s) 1801.9
Current children cumulated vsize (KiB) 4695268

[startup+1802.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12536
/proc/meminfo: memFree=19238268/32873648 swapFree=6864/6864
[pid=12479] ppid=12477 vsize=0 CPUtime=1802.09 cores=0,2,4,6
/proc/12479/stat : 12479 (scip-2.0.1.4b_2) R 12477 12479 9205 0 -1 4203524 1173772 0 0 0 180009 200 0 0 20 0 1 0 345816262 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/12479/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.09
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.47
CPU time (s): 1802.17
CPU user time (s): 1800.1
CPU system time (s): 2.07368
CPU usage (%): 99.9835
Max. virtual memory (cumulated for all children) (KiB): 4695268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.1
system time used= 2.07368
maximum resident set size= 4660948
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1173772
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30
involuntary context switches= 1989

runsolver used 2.72358 second user time and 7.36988 second system time

The end

Launcher Data 

Begin job on node120 at 2012-06-04 10:01:43
IDJOB=3743262
IDBENCH=90937
IDSOLVER=2329
FILE ID=node120/3743262-1338796902
RUNJOBID= node120-1338771707-9221
PBS_JOBID= 14636816
Free space on /tmp= 70708 MiB

SOLVER NAME= PB11: SCIP spx E_2 2011-06-10 (fixed)
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_unif_50null20mast_rapportOE1.0_TMAX15_K192_cod2.opb
COMMAND LINE= HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743262-1338796902/watcher-3743262-1338796902 -o /tmp/evaluation-result-3743262-1338796902/solver-3743262-1338796902 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743262-1338796902.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= da53a74913ae0ed6caffae915d70714d
RANDOM SEED=1969067031

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        23902896 kB
Buffers:          586860 kB
Cached:          3271424 kB
SwapCached:         1580 kB
Active:          6013256 kB
Inactive:        2010948 kB
Active(anon):    4158016 kB
Inactive(anon):     9224 kB
Active(file):    1855240 kB
Inactive(file):  2001724 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67103516 kB
Dirty:             44292 kB
Writeback:             0 kB
AnonPages:       4170092 kB
Mapped:            12860 kB
Shmem:                32 kB
Slab:             796904 kB
SReclaimable:     241064 kB
SUnreclaim:       555840 kB
KernelStack:        1464 kB
PageTables:        12572 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    4354032 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    104448 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70688 MiB
End job on node120 at 2012-06-04 10:31:45