Trace number 3743394

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB11: SCIP spx E_2 2011-06-10 (fixed)? (TO) 1802.18 1802.47

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb
MD5SUM765f9ba042cd825181247f9fbcec5226
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-35819
Best CPU time to get the best result obtained on this benchmark746.384
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 892
Biggest coefficient in the objective function 1000
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 891819
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 1000
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 891819
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 2.0.1.5 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743394-1338798705.opb>
3.39/3.45	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
3.39/3.45	c problem read
3.39/3.46	c presolving settings loaded
5.18/5.24	c presolving:
7.89/7.91	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
8.58/8.68	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs
112.27/112.38	c (round 3) 679 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17190162 impls, 1977 clqs
112.47/112.57	c (round 4) 679 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17195504 impls, 1977 clqs
113.87/113.93	c (round 5) 2685 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17228896 impls, 1977 clqs
114.07/114.12	c (round 6) 2685 del vars, 4659 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 17228904 impls, 1977 clqs
236.75/236.88	c (round 7) 3355 del vars, 4659 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19823854 impls, 1977 clqs
236.95/237.07	c (round 8) 3355 del vars, 5326 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19823862 impls, 1977 clqs

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743394-1338798705/watcher-3743394-1338798705 -o /tmp/evaluation-result-3743394-1338798705/solver-3743394-1338798705 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743394-1338798705.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12573
/proc/meminfo: memFree=23900656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=9924 CPUtime=0 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1569 0 0 0 0 0 0 0 20 0 1 0 345996605 10162176 1525 33554432000 4194304 9016284 140734559505056 140736108749304 7928096 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 2481 1536 335 1178 0 1299 0

[startup+0.070717 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12573
/proc/meminfo: memFree=23900656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=30268 CPUtime=0.05 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 6568 0 0 0 5 0 0 0 20 0 1 0 345996605 30994432 6523 33554432000 4194304 9016284 140734559505056 140736108749304 6813403 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 7567 6523 360 1178 0 6385 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 30268

[startup+0.100345 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12573
/proc/meminfo: memFree=23900656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=35900 CPUtime=0.09 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 7939 0 0 0 8 1 0 0 20 0 1 0 345996605 36761600 7894 33554432000 4194304 9016284 140734559505056 140736108749304 6418669 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 8975 7894 360 1178 0 7793 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 35900

[startup+0.300232 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12573
/proc/meminfo: memFree=23900656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=63952 CPUtime=0.29 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 14969 0 0 0 28 1 0 0 20 0 1 0 345996605 65486848 14924 33554432000 4194304 9016284 140734559505056 140736108749304 4447104 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 15988 14924 360 1178 0 14806 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63952

[startup+0.700235 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12573
/proc/meminfo: memFree=23900656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=118520 CPUtime=0.69 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 28595 0 0 0 66 3 0 0 20 0 1 0 345996605 121364480 28550 33554432000 4194304 9016284 140734559505056 140734559368952 6151926 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 29630 28550 360 1178 0 28448 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 118520

[startup+1.50024 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=23738200/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=242844 CPUtime=1.49 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 59613 0 0 0 142 7 0 0 20 0 1 0 345996605 248672256 59568 33554432000 4194304 9016284 140734559505056 140734559368952 6179847 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 60711 59568 360 1178 0 59529 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 242844

[startup+3.10024 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=23568188/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=454560 CPUtime=3.09 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 112597 0 0 0 294 15 0 0 20 0 1 0 345996605 465469440 112552 33554432000 4194304 9016284 140734559505056 140734559368952 7928096 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 113640 112552 360 1178 0 112458 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 454560

[startup+6.30024 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=22733476/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=1252008 CPUtime=6.29 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 310939 0 0 0 587 42 0 0 20 0 1 0 345996605 1282056192 310449 33554432000 4194304 9016284 140734559505056 140734559500696 7260789 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 313002 310455 487 1178 0 311820 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1252008

[startup+12.7001 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=22403952/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=1508124 CPUtime=12.69 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 409954 0 0 0 1210 59 0 0 20 0 1 0 345996605 1544318976 373324 33554432000 4194304 9016284 140734559505056 140734559500648 6480364 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 377031 373324 529 1178 0 375849 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1508124

[startup+25.5002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=22301256/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=1612328 CPUtime=25.48 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 435219 0 0 0 2487 61 0 0 20 0 1 0 345996605 1651023872 398589 33554432000 4194304 9016284 140734559505056 140734559500728 5511150 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 403082 398589 529 1178 0 401900 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1612328

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12574
/proc/meminfo: memFree=22097476/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=1808768 CPUtime=51.08 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 484262 0 0 0 5040 68 0 0 20 0 1 0 345996605 1852178432 447632 33554432000 4194304 9016284 140734559505056 140734559500648 4222974 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 452192 447632 529 1178 0 451010 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1808768

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12575
/proc/meminfo: memFree=21762968/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=2130240 CPUtime=102.28 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 562190 0 0 0 10148 80 0 0 20 0 1 0 345996605 2181365760 525560 33554432000 4194304 9016284 140734559505056 140734559500648 4982756 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 532560 525560 529 1178 0 531378 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2130240

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12575
/proc/meminfo: memFree=21516844/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=2366636 CPUtime=162.27 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 603209 0 0 0 16138 89 0 0 20 0 1 0 345996605 2423435264 583950 33554432000 4194304 9016284 140734559505056 140734559500648 6480389 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 591659 583950 529 1178 0 590477 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 2366636

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12575
/proc/meminfo: memFree=21499884/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=2376596 CPUtime=222.25 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 605643 0 0 0 22136 89 0 0 20 0 1 0 345996605 2433634304 586384 33554432000 4194304 9016284 140734559505056 140734559500648 6480393 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 594149 586384 529 1178 0 592967 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 2376596

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12575
/proc/meminfo: memFree=21184088/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=2692712 CPUtime=282.25 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 682036 0 0 0 28122 103 0 0 20 0 1 0 345996605 2757337088 662386 33554432000 4194304 9016284 140734559505056 140734559500440 6480425 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 673178 662386 529 1178 0 671996 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 2692712

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12575
/proc/meminfo: memFree=20934380/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=2929468 CPUtime=342.24 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 741009 0 0 0 34112 112 0 0 20 0 1 0 345996605 2999775232 721359 33554432000 4194304 9016284 140734559505056 140734559500440 6480425 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 732367 721359 529 1178 0 731185 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 2929468

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12576
/proc/meminfo: memFree=20439772/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=3155116 CPUtime=402.23 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 794594 0 0 0 40103 120 0 0 20 0 1 0 345996605 3230838784 774944 33554432000 4194304 9016284 140734559505056 140734559500440 6480433 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 788779 774944 529 1178 0 787597 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 3155116

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12576
/proc/meminfo: memFree=20261736/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=3312244 CPUtime=462.21 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 834177 0 0 0 46094 127 0 0 20 0 1 0 345996605 3391737856 814527 33554432000 4194304 9016284 140734559505056 140734559500440 6480389 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 828061 814527 529 1178 0 826879 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 3312244

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12579
/proc/meminfo: memFree=20076816/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=3486464 CPUtime=522.21 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 875346 0 0 0 52087 134 0 0 20 0 1 0 345996605 3570139136 855696 33554432000 4194304 9016284 140734559505056 140734559500440 6480389 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 871616 855696 529 1178 0 870434 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 3486464

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12579
/proc/meminfo: memFree=20035436/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=3499096 CPUtime=582.2 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 880497 0 0 0 58084 136 0 0 20 0 1 0 345996605 3583074304 860847 33554432000 4194304 9016284 140734559505056 140734559500440 6480412 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 874774 860847 529 1178 0 873592 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3499096

[startup+642.3 s]

################
# More data... #
################

/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1002129 0 0 0 100054 159 0 0 20 0 1 0 345996605 4084088832 985240 33554432000 4194304 9016284 140734559505056 140734559500440 6480421 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 997092 985240 529 1178 0 995910 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 3988368

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12620
/proc/meminfo: memFree=21041068/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4000656 CPUtime=1062.12 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1007234 0 0 0 106051 161 0 0 20 0 1 0 345996605 4096671744 991117 33554432000 4194304 9016284 140734559505056 140734559500440 6480403 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1000164 991117 529 1178 0 998982 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 4000656

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12623
/proc/meminfo: memFree=20653356/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4274228 CPUtime=1122.11 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1066938 0 0 0 112041 170 0 0 20 0 1 0 345996605 4376809472 1051292 33554432000 4194304 9016284 140734559505056 140734559500440 6480372 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1068557 1051292 529 1178 0 1067375 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 4274228

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12623
/proc/meminfo: memFree=20594864/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4286400 CPUtime=1182.1 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1071708 0 0 0 118038 172 0 0 20 0 1 0 345996605 4389273600 1057238 33554432000 4194304 9016284 140734559505056 140734559500440 6480393 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1071600 1057238 529 1178 0 1070418 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 4286400

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12623
/proc/meminfo: memFree=20405052/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4295616 CPUtime=1242.09 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1075806 0 0 0 124036 173 0 0 20 0 1 0 345996605 4398710784 1062585 33554432000 4194304 9016284 140734559505056 140734559500440 6480407 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1073904 1062585 529 1178 0 1072722 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 4295616

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12624
/proc/meminfo: memFree=20197628/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4305856 CPUtime=1302.09 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1080164 0 0 0 130034 175 0 0 20 0 1 0 345996605 4409196544 1067285 33554432000 4194304 9016284 140734559505056 140734559500440 6480403 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1076464 1067285 529 1178 0 1075282 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 4305856

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12624
/proc/meminfo: memFree=20152148/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4313020 CPUtime=1362.08 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1083233 0 0 0 136032 176 0 0 20 0 1 0 345996605 4416532480 1070846 33554432000 4194304 9016284 140734559505056 140734559500440 6480403 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1078255 1070846 529 1178 0 1077073 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 4313020

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12624
/proc/meminfo: memFree=20122912/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4320188 CPUtime=1422.07 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1086454 0 0 0 142030 177 0 0 20 0 1 0 345996605 4423872512 1074290 33554432000 4194304 9016284 140734559505056 140734559500440 6480421 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1080047 1074290 529 1178 0 1078865 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 4320188

[startup+1482.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 12624
/proc/meminfo: memFree=19911148/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4330428 CPUtime=1482.05 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1090575 0 0 0 148026 179 0 0 20 0 1 0 345996605 4434358272 1078800 33554432000 4194304 9016284 140734559505056 140734559500440 6480425 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1082607 1078800 529 1178 0 1081425 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 4330428

[startup+1542.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 12624
/proc/meminfo: memFree=19617668/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4653288 CPUtime=1542.04 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1159378 0 0 0 154016 188 0 0 20 0 1 0 345996605 4764966912 1147854 33554432000 4194304 9016284 140734559505056 140734559500440 6480360 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1163322 1147854 529 1178 0 1162140 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 4653288

[startup+1602.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 12625
/proc/meminfo: memFree=19584216/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4661480 CPUtime=1602.03 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1162756 0 0 0 160013 190 0 0 20 0 1 0 345996605 4773355520 1151232 33554432000 4194304 9016284 140734559505056 140734559500440 6480407 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1165370 1151232 529 1178 0 1164188 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 4661480

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12625
/proc/meminfo: memFree=19542088/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4670692 CPUtime=1662.02 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1166656 0 0 0 166011 191 0 0 20 0 1 0 345996605 4782788608 1155306 33554432000 4194304 9016284 140734559505056 140734559500440 6480376 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1167673 1155306 529 1178 0 1166491 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 4670692

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12628
/proc/meminfo: memFree=19270556/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4687076 CPUtime=1722.02 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1173437 0 0 0 172008 194 0 0 20 0 1 0 345996605 4799565824 1162348 33554432000 4194304 9016284 140734559505056 140734559500440 6480360 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1171769 1162348 529 1178 0 1170587 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 4687076

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12651
/proc/meminfo: memFree=19238848/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4694244 CPUtime=1782 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1176420 0 0 0 178005 195 0 0 20 0 1 0 345996605 4806905856 1165331 33554432000 4194304 9016284 140734559505056 140734559500440 6480389 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1173561 1165331 529 1178 0 1172379 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 4694244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12651
/proc/meminfo: memFree=19230764/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4696292 CPUtime=1800 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1177169 0 0 0 179805 195 0 0 20 0 1 0 345996605 4809003008 1166080 33554432000 4194304 9016284 140734559505056 140734559500440 6480360 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1174073 1166080 529 1178 0 1172891 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 4696292

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -12573

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 12652
/proc/meminfo: memFree=19229648/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4696292 CPUtime=1801.1 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1177247 0 0 0 179914 196 0 0 20 0 1 0 345996605 4809003008 1166158 33554432000 4194304 9016284 140734559505056 140734559499904 6480407 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1174073 1166158 529 1178 0 1172891 0
Current children cumulated CPU time (s) 1801.1
Current children cumulated vsize (KiB) 4696292

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 12652
/proc/meminfo: memFree=19227656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=4696292 CPUtime=1801.9 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4202496 1177286 0 0 0 179994 196 0 0 20 0 1 0 345996605 4809003008 1166197 33554432000 4194304 9016284 140734559505056 140734559499904 6480403 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 1174073 1166197 529 1178 0 1172891 0
Current children cumulated CPU time (s) 1801.9
Current children cumulated vsize (KiB) 4696292

[startup+1802.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 12652
/proc/meminfo: memFree=19227656/32873648 swapFree=6864/6864
[pid=12573] ppid=12571 vsize=0 CPUtime=1802.1 cores=0,2,4,6
/proc/12573/stat : 12573 (scip-2.0.1.4b_2) R 12571 12573 9205 0 -1 4203524 1177289 0 0 0 180005 205 0 0 20 0 1 0 345996605 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/12573/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.47
CPU time (s): 1802.18
CPU user time (s): 1800.06
CPU system time (s): 2.12368
CPU usage (%): 99.9839
Max. virtual memory (cumulated for all children) (KiB): 4696292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.06
system time used= 2.12368
maximum resident set size= 4664800
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1177289
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 32
involuntary context switches= 1862

runsolver used 2.74358 second user time and 7.36588 second system time

The end

Launcher Data 

Begin job on node120 at 2012-06-04 10:31:46
IDJOB=3743394
IDBENCH=91064
IDSOLVER=2329
FILE ID=node120/3743394-1338798705
RUNJOBID= node120-1338771707-9221
PBS_JOBID= 14636816
Free space on /tmp= 70708 MiB

SOLVER NAME= PB11: SCIP spx E_2 2011-06-10 (fixed)
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb
COMMAND LINE= HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743394-1338798705/watcher-3743394-1338798705 -o /tmp/evaluation-result-3743394-1338798705/solver-3743394-1338798705 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743394-1338798705.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 765f9ba042cd825181247f9fbcec5226
RANDOM SEED=1736444193

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        23900548 kB
Buffers:          587144 kB
Cached:          3276676 kB
SwapCached:         1580 kB
Active:          6012792 kB
Inactive:        2015592 kB
Active(anon):    4156928 kB
Inactive(anon):     9224 kB
Active(file):    1855864 kB
Inactive(file):  2006368 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67103516 kB
Dirty:             44012 kB
Writeback:             0 kB
AnonPages:       4171408 kB
Mapped:            12784 kB
Shmem:                32 kB
Slab:             796912 kB
SReclaimable:     240880 kB
SUnreclaim:       556032 kB
KernelStack:        1456 kB
PageTables:        12464 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    4352776 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     96256 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70688 MiB
End job on node120 at 2012-06-04 11:01:49