Trace number 3743753

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver? (TO) 1802.24 1802.64

General information on the benchmark

Name/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_10null0mast_rapportOE1.0_TMAX180_K192_cod1.opb
MD5SUMd2107be783663a4b74fe1129fd5afba5
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-115005
Best CPU time to get the best result obtained on this benchmark1804.76
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables399113
Total number of constraints400980
Number of constraints which are clauses399002
Number of constraints which are cardinality constraints (but not clauses)1977
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint397089
Number of terms in the objective function 306555
Biggest coefficient in the objective function 6765
Number of bits for the biggest coefficient in the objective function 13
Sum of the numbers in the objective function 279837538
Number of bits of the sum of numbers in the objective function 29
Biggest number in a constraint 6765
Number of bits of the biggest number in a constraint 13
Biggest sum of numbers in a constraint 279837538
Number of bits of the biggest sum of numbers29
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 1.2.1.3 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.4.2]
0.00/0.00	c Copyright (c) 2002-2010 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743753-1338792930.opb>
5.19/5.27	c original problem has 399113 variables (399113 bin, 0 int, 0 impl, 0 cont) and 400980 constraints
5.19/5.27	c problem read
5.19/5.27	c presolving settings loaded
7.19/7.27	c presolving:
8.39/8.46	c (round 1) 33998 del vars, 34176 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 61694 impls, 1799 clqs
10.48/10.54	c (round 2) 33998 del vars, 34370 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366416 upgd conss, 61694 impls, 1799 clqs
11.09/11.16	c (round 3) 33998 del vars, 34370 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 61694 impls, 1799 clqs
814.68/814.94	c (round 4) 34613 del vars, 34370 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 13026104 impls, 1799 clqs
815.08/815.32	c (round 5) 34613 del vars, 34985 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 13029740 impls, 1799 clqs
827.27/827.57	c (round 6) 36434 del vars, 34985 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 13065218 impls, 1799 clqs
827.87/828.13	c (round 7) 36434 del vars, 36806 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 13065230 impls, 1799 clqs
1125.13/1125.42	c (round 8) 37043 del vars, 36806 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 17707740 impls, 1799 clqs
1125.53/1125.84	c (round 9) 37043 del vars, 37412 del conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 366610 upgd conss, 17707748 impls, 1799 clqs
1800.09/1800.50	c pressed CTRL-C 1 times (5 times for forcing termination)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743753-1338792930/watcher-3743753-1338792930 -o /tmp/evaluation-result-3743753-1338792930/solver-3743753-1338792930 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743753-1338792930.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 5536
/proc/meminfo: memFree=31122112/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=7916 CPUtime=0 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 1247 0 0 0 0 0 0 0 20 0 1 0 345421671 8105984 1194 33554432000 4194304 8395647 140734301027808 140734674113512 7430272 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 1979 1194 370 1026 0 949 0

[startup+0.019024 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 5536
/proc/meminfo: memFree=31122112/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=14964 CPUtime=0.01 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 3030 0 0 0 1 0 0 0 20 0 1 0 345421671 15323136 2976 33554432000 4194304 8395647 140734301027808 140734674113512 4481595 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 3741 2976 387 1026 0 2711 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 14964

[startup+0.100233 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 5536
/proc/meminfo: memFree=31122112/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=48360 CPUtime=0.09 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 11288 0 0 0 8 1 0 0 20 0 1 0 345421671 49520640 11229 33554432000 4194304 8395647 140734301027808 140734674113512 4246004 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 12090 11229 387 1026 0 11060 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 48360

[startup+0.300223 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 5536
/proc/meminfo: memFree=31122112/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=129620 CPUtime=0.29 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 31062 0 0 0 25 4 0 0 20 0 1 0 345421671 132730880 31003 33554432000 4194304 8395647 140734301027808 140734674113512 6765685 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 32405 31003 387 1026 0 31375 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 129620

[startup+0.70022 s]
/proc/loadavg: 2.05 2.02 2.00 3/176 5536
/proc/meminfo: memFree=31122112/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=249728 CPUtime=0.69 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 60818 0 0 0 60 9 0 0 20 0 1 0 345421671 255721472 60759 33554432000 4194304 8395647 140734301027808 140734674113512 5755376 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 62432 60759 394 1026 0 61402 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 249728

[startup+1.50022 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 5537
/proc/meminfo: memFree=30799564/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=307984 CPUtime=1.49 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 75345 0 0 0 137 12 0 0 20 0 1 0 345421671 315375616 75286 33554432000 4194304 8395647 140734301027808 140734300890312 7324698 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 76996 75286 394 1026 0 75966 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 307984

[startup+3.10021 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 5537
/proc/meminfo: memFree=30704704/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=379200 CPUtime=3.09 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 93162 0 0 0 294 15 0 0 20 0 1 0 345421671 388300800 93103 33554432000 4194304 8395647 140734301027808 140734300893016 5754911 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 94800 93103 394 1026 0 93770 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 379200

[startup+6.30024 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 5537
/proc/meminfo: memFree=29710468/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1035584 CPUtime=6.28 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 256352 0 0 0 587 41 0 0 20 0 1 0 345421671 1060438016 257474 33554432000 4194304 8395647 140734301027808 140734301024040 6347101 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 258896 257478 421 1026 0 257866 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1035584

[startup+12.7003 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 5537
/proc/meminfo: memFree=28217704/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1601072 CPUtime=12.68 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 385072 0 0 0 1209 59 0 0 20 0 1 0 345421671 1639497728 398151 33554432000 4194304 8395647 140734301027808 140734301023608 4911287 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 400268 398151 502 1026 0 399238 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1601072

[startup+25.5003 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 5537
/proc/meminfo: memFree=28217812/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1601072 CPUtime=25.48 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 385086 0 0 0 2489 59 0 0 20 0 1 0 345421671 1639497728 398165 33554432000 4194304 8395647 140734301027808 140734301023608 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 400268 398165 502 1026 0 399238 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1601072

[startup+51.1003 s]
/proc/loadavg: 2.02 2.02 2.00 3/176 5537
/proc/meminfo: memFree=28218020/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1601072 CPUtime=51.07 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 385086 0 0 0 5048 59 0 0 20 0 1 0 345421671 1639497728 398165 33554432000 4194304 8395647 140734301027808 140734301023608 4706433 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 400268 398165 502 1026 0 399238 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1601072

[startup+102.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 5538
/proc/meminfo: memFree=28206028/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1613520 CPUtime=102.27 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 387891 0 0 0 10167 60 0 0 20 0 1 0 345421671 1652244480 400970 33554432000 4194304 8395647 140734301027808 140734301023672 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 403380 400970 502 1026 0 402350 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 1613520

[startup+162.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 5538
/proc/meminfo: memFree=28168236/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1653496 CPUtime=162.24 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 397343 0 0 0 16163 61 0 0 20 0 1 0 345421671 1693179904 410422 33554432000 4194304 8395647 140734301027808 140734301023880 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 413374 410422 502 1026 0 412344 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 1653496

[startup+222.307 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 5538
/proc/meminfo: memFree=28088408/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1699488 CPUtime=222.24 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 408417 0 0 0 22161 63 0 0 20 0 1 0 345421671 1740275712 421496 33554432000 4194304 8395647 140734301027808 140734301023880 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 424872 421496 502 1026 0 423842 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 1699488

[startup+282.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/178 5541
/proc/meminfo: memFree=28008688/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1745084 CPUtime=282.21 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 419892 0 0 0 28156 65 0 0 20 0 1 0 345421671 1786966016 432971 33554432000 4194304 8395647 140734301027808 140734301023672 4911307 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 436271 432971 502 1026 0 435241 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 1745084

[startup+342.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 5564
/proc/meminfo: memFree=27930844/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1786416 CPUtime=342.19 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 430208 0 0 0 34153 66 0 0 20 0 1 0 345421671 1829289984 443287 33554432000 4194304 8395647 140734301027808 140734301023880 4911233 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 446604 443287 502 1026 0 445574 0
Current children cumulated CPU time (s) 342.19
Current children cumulated vsize (KiB) 1786416

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/176 5565
/proc/meminfo: memFree=27863316/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1810092 CPUtime=402.18 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 435751 0 0 0 40151 67 0 0 20 0 1 0 345421671 1853534208 448830 33554432000 4194304 8395647 140734301027808 140734301023880 4911327 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 452523 448830 502 1026 0 451493 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 1810092

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 5566
/proc/meminfo: memFree=27788068/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1845272 CPUtime=462.16 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 444027 0 0 0 46149 67 0 0 20 0 1 0 345421671 1889558528 457106 33554432000 4194304 8395647 140734301027808 140734301023880 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 461318 457106 502 1026 0 460288 0
Current children cumulated CPU time (s) 462.16
Current children cumulated vsize (KiB) 1845272

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5566
/proc/meminfo: memFree=27731304/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1876840 CPUtime=522.15 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 451714 0 0 0 52146 69 0 0 20 0 1 0 345421671 1921884160 464793 33554432000 4194304 8395647 140734301027808 140734301023880 4911325 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 469210 464793 502 1026 0 468180 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 1876840

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5566
/proc/meminfo: memFree=27681608/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=1904168 CPUtime=582.13 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 458367 0 0 0 58143 70 0 0 20 0 1 0 345421671 1949868032 471446 33554432000 4194304 8395647 140734301027808 140734301023880 4911287 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/5536/statm: 476042 471446 502 1026 0 475012 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 1904168

[startup+642.3 s]

################
# More data... #
################

/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 523726 0 0 0 106123 80 0 0 20 0 1 0 345421671 2312769536 558267 33554432000 4194304 8395647 140734301027808 140734301023880 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 564641 558267 502 1026 0 563611 0
Current children cumulated CPU time (s) 1062.03
Current children cumulated vsize (KiB) 2258564

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 5571
/proc/meminfo: memFree=26514736/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=2272704 CPUtime=1122.02 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 526762 0 0 0 112122 80 0 0 20 0 1 0 345421671 2327248896 561814 33554432000 4194304 8395647 140734301027808 140734301023880 6080665 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 568176 561814 502 1026 0 567146 0
Current children cumulated CPU time (s) 1122.02
Current children cumulated vsize (KiB) 2272704

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5571
/proc/meminfo: memFree=26152492/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=2643464 CPUtime=1182.01 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 611717 0 0 0 118105 96 0 0 20 0 1 0 345421671 2706907136 652463 33554432000 4194304 8395647 140734301027808 140734301023672 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 660866 652463 502 1026 0 659836 0
Current children cumulated CPU time (s) 1182.01
Current children cumulated vsize (KiB) 2643464

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5571
/proc/meminfo: memFree=26003720/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=2801456 CPUtime=1242 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 648517 0 0 0 124098 102 0 0 20 0 1 0 345421671 2868690944 689260 33554432000 4194304 8395647 140734301027808 140734301023672 6080705 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 700364 689260 502 1026 0 699334 0
Current children cumulated CPU time (s) 1242
Current children cumulated vsize (KiB) 2801456

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5572
/proc/meminfo: memFree=25897232/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=2908976 CPUtime=1301.98 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 675008 0 0 0 130091 107 0 0 20 0 1 0 345421671 2978791424 715751 33554432000 4194304 8395647 140734301027808 140734301023672 6080665 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 727244 715751 502 1026 0 726214 0
Current children cumulated CPU time (s) 1301.98
Current children cumulated vsize (KiB) 2908976

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5572
/proc/meminfo: memFree=25871096/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=2926384 CPUtime=1361.96 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 681593 0 0 0 136087 109 0 0 20 0 1 0 345421671 2996617216 722332 33554432000 4194304 8395647 140734301027808 140734301023672 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 731596 722332 502 1026 0 730566 0
Current children cumulated CPU time (s) 1361.96
Current children cumulated vsize (KiB) 2926384

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5572
/proc/meminfo: memFree=25760268/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3045880 CPUtime=1421.96 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 709219 0 0 0 142081 115 0 0 20 0 1 0 345421671 3118981120 749955 33554432000 4194304 8395647 140734301027808 140734301023672 6080679 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 761470 749955 502 1026 0 760440 0
Current children cumulated CPU time (s) 1421.96
Current children cumulated vsize (KiB) 3045880

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 5575
/proc/meminfo: memFree=25738588/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3058168 CPUtime=1481.94 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 714594 0 0 0 148077 117 0 0 20 0 1 0 345421671 3131564032 755330 33554432000 4194304 8395647 140734301027808 140734301023672 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 764542 755330 502 1026 0 763512 0
Current children cumulated CPU time (s) 1481.94
Current children cumulated vsize (KiB) 3058168

[startup+1542.31 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 5575
/proc/meminfo: memFree=25606440/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3199932 CPUtime=1541.94 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 747376 0 0 0 154071 123 0 0 20 0 1 0 345421671 3276730368 788361 33554432000 4194304 8395647 140734301027808 140734301023672 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 799983 788361 502 1026 0 798953 0
Current children cumulated CPU time (s) 1541.94
Current children cumulated vsize (KiB) 3199932

[startup+1602.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 5576
/proc/meminfo: memFree=25590228/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3209148 CPUtime=1601.92 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 751347 0 0 0 160067 125 0 0 20 0 1 0 345421671 3286167552 792349 33554432000 4194304 8395647 140734301027808 140734301023672 6080665 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 802287 792349 502 1026 0 801257 0
Current children cumulated CPU time (s) 1601.92
Current children cumulated vsize (KiB) 3209148

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5576
/proc/meminfo: memFree=25576368/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3218364 CPUtime=1661.91 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 754913 0 0 0 166065 126 0 0 20 0 1 0 345421671 3295604736 795915 33554432000 4194304 8395647 140734301027808 140734301023672 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 804591 795915 502 1026 0 803561 0
Current children cumulated CPU time (s) 1661.91
Current children cumulated vsize (KiB) 3218364

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 5576
/proc/meminfo: memFree=25438648/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3375180 CPUtime=1721.9 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 789216 0 0 0 172058 132 0 0 20 0 1 0 345421671 3456184320 830218 33554432000 4194304 8395647 140734301027808 140734301023672 6080701 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 843795 830218 502 1026 0 842765 0
Current children cumulated CPU time (s) 1721.9
Current children cumulated vsize (KiB) 3375180

[startup+1782.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 5576
/proc/meminfo: memFree=25422296/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3384396 CPUtime=1781.89 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 793166 0 0 0 178055 134 0 0 20 0 1 0 345421671 3465621504 834263 33554432000 4194304 8395647 140734301027808 140734301023672 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 846099 834263 502 1026 0 845069 0
Current children cumulated CPU time (s) 1781.89
Current children cumulated vsize (KiB) 3384396



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.04 2.01 2.00 3/178 5577
/proc/meminfo: memFree=25418500/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3387468 CPUtime=1800.09 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 794495 0 0 0 179875 134 0 0 20 0 1 0 345421671 3468767232 835824 33554432000 4194304 8395647 140734301027808 140734301023672 6080692 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 846867 835824 502 1026 0 845837 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 3387468

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -5536

Solver just ended. Dumping a history of the last processes samples

[startup+1801.5 s]
/proc/loadavg: 2.04 2.01 2.00 3/179 5578
/proc/meminfo: memFree=25418500/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3387468 CPUtime=1801.08 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 794518 0 0 0 179974 134 0 0 20 0 1 0 345421671 3468767232 835847 33554432000 4194304 8395647 140734301027808 140734301023104 6080688 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 846867 835847 502 1026 0 845837 0
Current children cumulated CPU time (s) 1801.08
Current children cumulated vsize (KiB) 3387468

[startup+1802.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/175 5606
/proc/meminfo: memFree=28094716/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3387468 CPUtime=1801.88 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 794538 0 0 0 180054 134 0 0 20 0 1 0 345421671 3468767232 835867 33554432000 4194304 8395647 140734301027808 140734301023104 6080692 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 846867 835867 502 1026 0 845837 0
Current children cumulated CPU time (s) 1801.88
Current children cumulated vsize (KiB) 3387468

[startup+1802.5 s]
/proc/loadavg: 2.04 2.01 2.00 3/175 5606
/proc/meminfo: memFree=28094716/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=3387468 CPUtime=1802.08 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4202496 794545 0 0 0 180074 134 0 0 20 0 1 0 345421671 3468767232 835874 33554432000 4194304 8395647 140734301027808 140734301023104 6080661 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 846867 835874 502 1026 0 845837 0
Current children cumulated CPU time (s) 1802.08
Current children cumulated vsize (KiB) 3387468

[startup+1802.6 s]
/proc/loadavg: 2.04 2.01 2.00 3/175 5606
/proc/meminfo: memFree=28094716/32873844 swapFree=7116/7116
[pid=5536] ppid=5534 vsize=0 CPUtime=1802.19 cores=0,2,4,6
/proc/5536/stat : 5536 (pbscip.linux.x8) R 5534 5536 4984 0 -1 4203524 794545 0 0 0 180075 144 0 0 20 0 1 0 345421671 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/5536/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.19
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.64
CPU time (s): 1802.24
CPU user time (s): 1800.75
CPU system time (s): 1.48277
CPU usage (%): 99.9775
Max. virtual memory (cumulated for all children) (KiB): 3387468

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.75
system time used= 1.48277
maximum resident set size= 3343496
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 794545
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 45
involuntary context switches= 2098

runsolver used 3.11253 second user time and 8.33973 second system time

The end

Launcher Data 

Begin job on node103 at 2012-06-04 08:55:31
IDJOB=3743753
IDBENCH=92309
IDSOLVER=2326
FILE ID=node103/3743753-1338792930
RUNJOBID= node103-1338783950-5000
PBS_JOBID= 14636845
Free space on /tmp= 71056 MiB

SOLVER NAME= PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/sroussel/NG/normalized-NG.dot_fibo_10null0mast_rapportOE1.0_TMAX180_K192_cod1.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743753-1338792930/watcher-3743753-1338792930 -o /tmp/evaluation-result-3743753-1338792930/solver-3743753-1338792930 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743753-1338792930.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2107be783663a4b74fe1129fd5afba5
RANDOM SEED=1423414754

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5411.36
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31122500 kB
Buffers:          205784 kB
Cached:           472548 kB
SwapCached:         5648 kB
Active:           543320 kB
Inactive:         432348 kB
Active(anon):     295092 kB
Inactive(anon):     4740 kB
Active(file):     248228 kB
Inactive(file):   427608 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67096352 kB
Dirty:             82768 kB
Writeback:             0 kB
AnonPages:        300484 kB
Mapped:            10380 kB
Shmem:                 0 kB
Slab:             636428 kB
SReclaimable:      76452 kB
SUnreclaim:       559976 kB
KernelStack:        1440 kB
PageTables:         4664 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     418324 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71048 MiB
End job on node103 at 2012-06-04 09:25:34