Trace number 2696035

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.01 1491.63

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_8_70_1.opb
MD5SUM0263d0a7c5e3320bd7cce9534c14bf27
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark17
Best CPU time to get the best result obtained on this benchmark1792.56
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 32
Optimality of the best value was proved NO
Number of variables198
Total number of constraints16
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints16
Minimum length of a constraint85
Maximum length of a constraint86
Number of terms in the objective function 128
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 4080
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1884
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 6162
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696035-1278020869.opb.
0.00/0.00	c Instance file HOME/instance-2696035-1278020869.opb
0.00/0.00	c File size is 13239 bytes.
0.00/0.04	c Highest Coefficient sum: 6162
0.00/0.04	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.04	c ============================[ Problem Statistics ]=============================
0.00/0.04	c |                                                                             |
0.00/0.04	c |  Parsing time:          0.04         s                                      |
0.00/0.04	c |  Number Variables:      198                                                 |
0.00/0.04	c |  Number Constraints:    16                                                  |
0.00/0.04	c ===============================================================================
1800.01/1491.62	c Remaining time 1799.96 sec.
1800.01/1491.62	c 
1800.01/1491.62	c *** INTERRUPTED ***
1800.01/1491.62	s UNKNOWN
1800.01/1491.62	c Total CPU time              : 1704.8 s
1800.01/1491.62	c Memory used           : 136.68 MB
1800.01/1491.62	c CPU time              : 1704.8 s
1800.01/1491.62	c 
1800.01/1491.62	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696035-1278020869/watcher-2696035-1278020869 -o /tmp/evaluation-result-2696035-1278020869/solver-2696035-1278020869 -C 1800 -W 2000 -M 1800 run HOME/instance-2696035-1278020869.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 1.86 1.73 3/107 24694
/proc/meminfo: memFree=1326412/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0

[startup+0.102684 s]
/proc/loadavg: 2.01 1.86 1.73 3/107 24694
/proc/meminfo: memFree=1326412/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.204001 s]
/proc/loadavg: 2.01 1.86 1.73 3/107 24694
/proc/meminfo: memFree=1326412/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.304773 s]
/proc/loadavg: 2.01 1.86 1.73 3/107 24694
/proc/meminfo: memFree=1326412/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701762 s]
/proc/loadavg: 2.01 1.86 1.73 3/107 24694
/proc/meminfo: memFree=1326412/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50074 s]
/proc/loadavg: 1.93 1.85 1.72 2/110 24703
/proc/meminfo: memFree=1322172/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=29284 CPUtime=1.75
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 4807 0 0 0 160 15 0 0 16 0 2 0 175742676 29986816 1892 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 7321 1892 1077 2985 0 3863 0
[pid=24695/tid=24703] ppid=24694 vsize=29284 CPUtime=0.46
/proc/24695/task/24703/stat : 24703 (pb_cplex) S 24694 24694 24131 0 -1 4202560 545 0 0 0 44 2 0 0 16 0 2 0 175742744 29986816 1892 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.75
Current children cumulated vsize (KiB) 37984

[startup+3.10093 s]
/proc/loadavg: 1.93 1.85 1.72 2/110 24703
/proc/meminfo: memFree=1321552/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=29736 CPUtime=3.51
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 6723 0 0 0 328 23 0 0 16 0 2 0 175742676 30449664 2072 1992294400 134512640 146736320 4294883920 18446744073709551615 139039615 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 7434 2072 1077 2985 0 3976 0
[pid=24695/tid=24703] ppid=24694 vsize=29736 CPUtime=1.47
/proc/24695/task/24703/stat : 24703 (pb_cplex) S 24694 24694 24131 0 -1 4202560 1617 0 0 0 140 7 0 0 16 0 2 0 175742744 30449664 2072 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.51
Current children cumulated vsize (KiB) 38436

[startup+6.30122 s]
/proc/loadavg: 1.85 1.83 1.72 2/110 24703
/proc/meminfo: memFree=1320188/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=31104 CPUtime=7.47
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 10941 0 0 0 703 44 0 0 16 0 2 0 175742676 31850496 2470 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 7776 2470 1077 2985 0 4318 0
[pid=24695/tid=24703] ppid=24694 vsize=31104 CPUtime=3.47
/proc/24695/task/24703/stat : 24703 (pb_cplex) R 24694 24694 24131 0 -1 4202560 3716 0 0 0 330 17 0 0 15 0 2 0 175742744 31850496 2470 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.47
Current children cumulated vsize (KiB) 39804

[startup+12.7008 s]
/proc/loadavg: 1.87 1.84 1.72 3/110 24703
/proc/meminfo: memFree=1318576/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=33004 CPUtime=18.19
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 26366 0 0 0 1726 93 0 0 21 0 2 0 175742676 33796096 2781 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 8251 2781 1085 2985 0 4793 0
[pid=24695/tid=24703] ppid=24694 vsize=33004 CPUtime=8.95
/proc/24695/task/24703/stat : 24703 (pb_cplex) R 24694 24694 24131 0 -1 4202560 11855 0 0 0 851 44 0 0 18 0 2 0 175742744 33796096 2781 1992294400 134512640 146736320 4294883920 18446744073709551615 137083836 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.19
Current children cumulated vsize (KiB) 41704

[startup+25.5019 s]
/proc/loadavg: 1.75 1.81 1.72 2/110 24708
/proc/meminfo: memFree=1316964/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=34624 CPUtime=34.97
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 53559 0 0 0 3333 164 0 0 16 0 2 0 175742676 35454976 3180 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 8656 3180 1086 2985 0 5198 0
[pid=24695/tid=24708] ppid=24694 vsize=34624 CPUtime=5.99
/proc/24695/task/24708/stat : 24708 (pb_cplex) S 24694 24694 24131 0 -1 4202560 11083 0 0 0 572 27 0 0 16 0 2 0 175744244 35454976 3180 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 34.97
Current children cumulated vsize (KiB) 43324

[startup+51.1012 s]
/proc/loadavg: 1.49 1.74 1.70 2/110 24708
/proc/meminfo: memFree=1307912/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=43328 CPUtime=65.46
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 114810 0 0 0 6237 309 0 0 16 0 2 0 175742676 44367872 5420 1992294400 134512640 146736320 4294883920 18446744073709551615 135445584 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 10832 5420 1086 2985 0 7374 0
[pid=24695/tid=24708] ppid=24694 vsize=43328 CPUtime=21.24
/proc/24695/task/24708/stat : 24708 (pb_cplex) S 24694 24694 24131 0 -1 4202560 42581 0 0 0 2026 98 0 0 15 0 2 0 175744244 44367872 5420 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 65.46
Current children cumulated vsize (KiB) 52028

[startup+102.302 s]
/proc/loadavg: 1.30 1.66 1.67 3/110 24710
/proc/meminfo: memFree=1296132/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=55224 CPUtime=127.98
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 213391 0 0 0 12171 627 0 0 15 0 2 0 175742676 56549376 8232 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 13806 8232 1087 2985 0 10348 0
[pid=24695/tid=24708] ppid=24694 vsize=55224 CPUtime=53.37
/proc/24695/task/24708/stat : 24708 (pb_cplex) R 24694 24694 24131 0 -1 4202560 95030 0 0 0 5077 260 0 0 16 0 2 0 175744244 56549376 8235 1992294400 134512640 146736320 4294883920 18446744073709551615 137334198 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 127.98
Current children cumulated vsize (KiB) 63924

[startup+162.301 s]
/proc/loadavg: 1.22 1.57 1.63 2/110 24712
/proc/meminfo: memFree=1280632/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=70756 CPUtime=199.46
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 325831 0 0 0 18973 973 0 0 16 0 2 0 175742676 72454144 12104 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 17689 12104 1086 2985 0 14231 0
[pid=24695/tid=24708] ppid=24694 vsize=70756 CPUtime=88.06
/proc/24695/task/24708/stat : 24708 (pb_cplex) S 24694 24694 24131 0 -1 4202560 151542 0 0 0 8376 430 0 0 16 0 2 0 175744244 72454144 12104 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 199.46
Current children cumulated vsize (KiB) 79456

[startup+222.31 s]
/proc/loadavg: 1.44 1.57 1.63 2/110 24719
/proc/meminfo: memFree=1289188/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=61744 CPUtime=281.89
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 451282 0 0 0 26837 1352 0 0 16 0 2 0 175742676 63225856 9966 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 15436 9966 1086 2985 0 11978 0
[pid=24695/tid=24717] ppid=24694 vsize=61744 CPUtime=7.18
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 2637 0 0 0 684 34 0 0 15 0 2 0 175763724 63225856 9966 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 281.89
Current children cumulated vsize (KiB) 70444

[startup+282.302 s]
/proc/loadavg: 1.40 1.52 1.61 2/110 24719
/proc/meminfo: memFree=1286088/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=64816 CPUtime=353.58
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 474837 0 0 0 33636 1722 0 0 16 0 2 0 175742676 66371584 10718 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 16204 10718 1086 2985 0 12746 0
[pid=24695/tid=24717] ppid=24694 vsize=64816 CPUtime=42.92
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 14658 0 0 0 4071 221 0 0 16 0 2 0 175763724 66371584 10718 1992294400 134512640 146736320 4294883920 18446744073709551615 136474418 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 353.58
Current children cumulated vsize (KiB) 73516

[startup+342.301 s]
/proc/loadavg: 1.18 1.44 1.57 2/110 24721
/proc/meminfo: memFree=1283360/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0

################
# More data... #
################

[pid=24695] ppid=24694 vsize=114628 CPUtime=1217.68
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 895855 0 0 0 115361 6407 0 0 16 0 2 0 175742676 117379072 23011 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24695/statm: 28657 23011 1086 2985 0 25199 0
[pid=24695/tid=24717] ppid=24694 vsize=114628 CPUtime=470.18
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 230951 0 0 0 44494 2524 0 0 15 0 2 0 175763724 117379072 23011 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1217.68
Current children cumulated vsize (KiB) 123328

[startup+1062.3 s]
/proc/loadavg: 1.23 1.18 1.33 2/110 24750
/proc/meminfo: memFree=1234008/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=117616 CPUtime=1288.69
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 940838 0 0 0 122082 6787 0 0 15 0 2 0 175742676 120438784 23755 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 29404 23755 1086 2985 0 25946 0
[pid=24695/tid=24717] ppid=24694 vsize=117616 CPUtime=504.56
/proc/24695/task/24717/stat : 24717 (pb_cplex) S 24694 24694 24131 0 -1 4202560 254541 0 0 0 47749 2707 0 0 16 0 2 0 175763724 120438784 23755 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1288.69
Current children cumulated vsize (KiB) 126316

[startup+1122.3 s]
/proc/loadavg: 1.12 1.16 1.32 2/110 24752
/proc/meminfo: memFree=1230536/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=120628 CPUtime=1359.53
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 983747 0 0 0 128786 7167 0 0 15 0 2 0 175742676 123523072 24607 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 30157 24607 1086 2985 0 26699 0
[pid=24695/tid=24717] ppid=24694 vsize=120628 CPUtime=539.13
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 275460 0 0 0 51018 2895 0 0 16 0 2 0 175763724 123523072 24607 1992294400 134512640 146736320 4294883920 18446744073709551615 138665734 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1359.53
Current children cumulated vsize (KiB) 129328

[startup+1182.3 s]
/proc/loadavg: 1.28 1.19 1.31 2/110 24752
/proc/meminfo: memFree=1227684/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=123616 CPUtime=1431.48
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 1031228 0 0 0 135604 7544 0 0 16 0 2 0 175742676 126582784 25340 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 30904 25340 1086 2985 0 27446 0
[pid=24695/tid=24717] ppid=24694 vsize=123616 CPUtime=574.12
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 298154 0 0 0 54335 3077 0 0 16 0 2 0 175763724 126582784 25340 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1431.48
Current children cumulated vsize (KiB) 132316

[startup+1242.3 s]
/proc/loadavg: 1.28 1.21 1.31 2/110 24754
/proc/meminfo: memFree=1224584/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=126480 CPUtime=1502.99
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 1075497 0 0 0 142361 7938 0 0 15 0 2 0 175742676 129515520 25991 1992294400 134512640 146736320 4294883920 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 31620 25991 1086 2985 0 28162 0
[pid=24695/tid=24717] ppid=24694 vsize=126480 CPUtime=609.86
/proc/24695/task/24717/stat : 24717 (pb_cplex) S 24694 24694 24131 0 -1 4202560 322536 0 0 0 57713 3273 0 0 16 0 2 0 175763724 129515520 25991 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1502.99
Current children cumulated vsize (KiB) 135180

[startup+1302.3 s]
/proc/loadavg: 1.23 1.20 1.30 2/110 24756
/proc/meminfo: memFree=1221856/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=128468 CPUtime=1574.44
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 1121933 0 0 0 149136 8308 0 0 15 0 2 0 175742676 131551232 26603 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 32117 26603 1086 2985 0 28659 0
[pid=24695/tid=24717] ppid=24694 vsize=128468 CPUtime=646.16
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 347461 0 0 0 61163 3453 0 0 16 0 2 0 175763724 131551232 26603 1992294400 134512640 146736320 4294883920 18446744073709551615 135938225 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1574.44
Current children cumulated vsize (KiB) 137168

[startup+1362.3 s]
/proc/loadavg: 1.34 1.23 1.30 2/110 24758
/proc/meminfo: memFree=1219004/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=131432 CPUtime=1645.7
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 1169931 0 0 0 155878 8692 0 0 16 0 2 0 175742676 134586368 27308 1992294400 134512640 146736320 4294883920 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 32858 27308 1086 2985 0 29400 0
[pid=24695/tid=24717] ppid=24694 vsize=131432 CPUtime=681.02
/proc/24695/task/24717/stat : 24717 (pb_cplex) S 24694 24694 24131 0 -1 4202560 373642 0 0 0 64461 3641 0 0 16 0 2 0 175763724 134586368 27308 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1645.7
Current children cumulated vsize (KiB) 140132

[startup+1422.3 s]
/proc/loadavg: 1.45 1.28 1.31 3/110 24760
/proc/meminfo: memFree=1216028/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=134432 CPUtime=1716.85
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 1206497 0 0 0 162622 9063 0 0 15 0 2 0 175742676 137658368 28079 1992294400 134512640 146736320 4294883920 18446744073709551615 136674344 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 33608 28079 1086 2985 0 30150 0
[pid=24695/tid=24717] ppid=24694 vsize=134432 CPUtime=717.78
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 392925 0 0 0 67943 3835 0 0 16 0 2 0 175763724 137658368 28079 1992294400 134512640 146736320 4294883920 18446744073709551615 144580332 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1716.85
Current children cumulated vsize (KiB) 143132

[startup+1482.3 s]
/proc/loadavg: 1.39 1.28 1.30 2/110 24760
/proc/meminfo: memFree=1212432/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=138800 CPUtime=1788.87
/proc/24695/stat : 24695 (pb_cplex) S 24694 24694 24131 0 -1 4202496 1252017 0 0 0 169425 9462 0 0 16 0 2 0 175742676 142131200 29045 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 34700 29045 1086 2985 0 31242 0
[pid=24695/tid=24717] ppid=24694 vsize=138800 CPUtime=752.7
/proc/24695/task/24717/stat : 24717 (pb_cplex) R 24694 24694 24131 0 -1 4202560 414829 0 0 0 71239 4031 0 0 16 0 2 0 175763724 142131200 29045 1992294400 134512640 146736320 4294883920 18446744073709551615 136474365 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1788.87
Current children cumulated vsize (KiB) 147500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1491.6 s]
/proc/loadavg: 1.33 1.27 1.30 2/110 24762
/proc/meminfo: memFree=1211812/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=139960 CPUtime=1800.01
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 1258786 0 0 0 170479 9522 0 0 15 0 2 0 175742676 143319040 29238 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 34990 29238 1086 2985 0 31532 0
[pid=24695/tid=24717] ppid=24694 vsize=139960 CPUtime=758.35
/proc/24695/task/24717/stat : 24717 (pb_cplex) S 24694 24694 24131 0 -1 4202560 418761 0 0 0 71773 4062 0 0 16 0 2 0 175763724 143319040 29238 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 148660

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1491.6 s]
/proc/loadavg: 1.33 1.27 1.30 2/110 24762
/proc/meminfo: memFree=1211812/2059040 swapFree=4139232/4192956
[pid=24694] ppid=24692 vsize=8700 CPUtime=0
/proc/24694/stat : 24694 (run) S 24692 24694 24131 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 175742676 8908800 248 1992294400 4194304 4922060 140735839494752 18446744073709551615 259177159813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24694/statm: 2175 248 208 178 0 68 0
[pid=24695] ppid=24694 vsize=139960 CPUtime=1800.01
/proc/24695/stat : 24695 (pb_cplex) R 24694 24694 24131 0 -1 4202496 1258786 0 0 0 170479 9522 0 0 15 0 2 0 175742676 143319040 29238 1992294400 134512640 146736320 4294883920 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24695/statm: 34990 29238 1086 2985 0 31532 0
[pid=24695/tid=24717] ppid=24694 vsize=139960 CPUtime=758.35
/proc/24695/task/24717/stat : 24717 (pb_cplex) S 24694 24694 24131 0 -1 4202560 418761 0 0 0 71773 4062 0 0 16 0 2 0 175763724 143319040 29238 1992294400 134512640 146736320 4294883920 18446744073709551615 144580073 0 2 4096 16387 18446604437831755008 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 148660

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24694 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1800.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1491.63
CPU time (s): 1800.01
CPU user time (s): 1704.79
CPU system time (s): 95.22
CPU usage (%): 120.674
Max. virtual memory (cumulated for all children) (KiB): 149548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 363
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.55561 second user time and 7.03593 second system time

The end

Launcher Data 

Begin job on node025 at 2010-07-01 23:47:49
IDJOB=2696035
IDBENCH=2920
IDSOLVER=1209
FILE ID=node025/2696035-1278020869
PBS_JOBID= 11198736
Free space on /tmp= 62232 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_8_70_1.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696035-1278020869/watcher-2696035-1278020869 -o /tmp/evaluation-result-2696035-1278020869/solver-2696035-1278020869 -C 1800 -W 2000 -M 1800  run HOME/instance-2696035-1278020869.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 0263d0a7c5e3320bd7cce9534c14bf27
RANDOM SEED=246278269

node025.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.242
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.48
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.242
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.44
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1326692 kB
Buffers:        202364 kB
Cached:         412012 kB
SwapCached:       7972 kB
Active:         322060 kB
Inactive:       307384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1326692 kB
SwapTotal:     4192956 kB
SwapFree:      4139232 kB
Dirty:           16640 kB
Writeback:           0 kB
AnonPages:       12768 kB
Mapped:          11944 kB
Slab:            80752 kB
PageTables:       4244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   183888 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62216 MiB
End job on node025 at 2010-07-02 00:12:43