Trace number 2696047

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.09 1493.83

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_8_70_3.opb
MD5SUM0278ee4f163393ac33163ff791a7f96d
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark16
Best CPU time to get the best result obtained on this benchmark1791.86
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 24
Optimality of the best value was proved NO
Number of variables198
Total number of constraints16
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints16
Minimum length of a constraint82
Maximum length of a constraint86
Number of terms in the objective function 128
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 4080
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1782
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 5856
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696047-1278020794.opb.
0.00/0.00	c Instance file HOME/instance-2696047-1278020794.opb
0.00/0.00	c File size is 13159 bytes.
0.00/0.04	c Highest Coefficient sum: 5856
0.00/0.04	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.04	c ============================[ Problem Statistics ]=============================
0.00/0.04	c |                                                                             |
0.00/0.04	c |  Parsing time:          0.04         s                                      |
0.00/0.04	c |  Number Variables:      198                                                 |
0.00/0.04	c |  Number Constraints:    16                                                  |
0.00/0.04	c ===============================================================================
1800.09/1493.82	c Remaining time 1799.96 sec.
1800.09/1493.82	c 
1800.09/1493.82	c *** INTERRUPTED ***
1800.09/1493.82	s UNKNOWN
1800.09/1493.82	c Total CPU time              : 1703.21 s
1800.09/1493.82	c Memory used           : 123.35 MB
1800.09/1493.82	c CPU time              : 1703.21 s
1800.09/1493.82	c 
1800.09/1493.82	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696047-1278020794/watcher-2696047-1278020794 -o /tmp/evaluation-result-2696047-1278020794/solver-2696047-1278020794 -C 1800 -W 2000 -M 1800 run HOME/instance-2696047-1278020794.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 1.81 1.70 3/106 24541
/proc/meminfo: memFree=1336728/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0

[startup+0.104196 s]
/proc/loadavg: 1.93 1.81 1.70 3/106 24541
/proc/meminfo: memFree=1336728/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.202194 s]
/proc/loadavg: 1.93 1.81 1.70 3/106 24541
/proc/meminfo: memFree=1336728/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.36113 s]
/proc/loadavg: 1.93 1.81 1.70 3/106 24541
/proc/meminfo: memFree=1336728/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701188 s]
/proc/loadavg: 1.93 1.81 1.70 3/106 24541
/proc/meminfo: memFree=1336728/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50133 s]
/proc/loadavg: 1.93 1.81 1.70 2/109 24552
/proc/meminfo: memFree=1332860/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=29024 CPUtime=1.74
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 4730 0 0 0 158 16 0 0 16 0 2 0 177681013 29720576 1905 1992294400 134512640 146736320 4294588512 18446744073709551615 136389677 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24542/statm: 7256 1905 1074 2985 0 3798 0
[pid=24542/tid=24552] ppid=24541 vsize=29024 CPUtime=0.42
/proc/24542/task/24552/stat : 24552 (pb_cplex) S 24541 24541 23705 0 -1 4202560 524 0 0 0 39 3 0 0 16 0 2 0 177681100 29720576 1905 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 37724

[startup+3.10161 s]
/proc/loadavg: 1.93 1.81 1.70 2/109 24552
/proc/meminfo: memFree=1331992/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=29912 CPUtime=3.7
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 6733 0 0 0 342 28 0 0 16 0 2 0 177681013 30629888 2190 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 7478 2190 1074 2985 0 4020 0
[pid=24542/tid=24552] ppid=24541 vsize=29912 CPUtime=1.42
/proc/24542/task/24552/stat : 24552 (pb_cplex) S 24541 24541 23705 0 -1 4202560 1361 0 0 0 133 9 0 0 16 0 2 0 177681100 30629888 2190 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.7
Current children cumulated vsize (KiB) 38612

[startup+6.30119 s]
/proc/loadavg: 1.85 1.80 1.69 2/109 24552
/proc/meminfo: memFree=1330752/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=31728 CPUtime=7.48
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 11068 0 0 0 702 46 0 0 16 0 2 0 177681013 32489472 2480 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 7932 2480 1074 2985 0 4474 0
[pid=24542/tid=24552] ppid=24541 vsize=31728 CPUtime=3.1
/proc/24542/task/24552/stat : 24552 (pb_cplex) S 24541 24541 23705 0 -1 4202560 3233 0 0 0 294 16 0 0 16 0 2 0 177681100 32489472 2480 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7.48
Current children cumulated vsize (KiB) 40428

[startup+12.7013 s]
/proc/loadavg: 1.78 1.78 1.69 3/109 24552
/proc/meminfo: memFree=1329140/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=33008 CPUtime=17.93
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 22375 0 0 0 1701 92 0 0 18 0 2 0 177681013 33800192 2736 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 8252 2736 1084 2985 0 4794 0
[pid=24542/tid=24552] ppid=24541 vsize=33008 CPUtime=8.1
/proc/24542/task/24552/stat : 24552 (pb_cplex) R 24541 24541 23705 0 -1 4202560 9132 0 0 0 772 38 0 0 18 0 2 0 177681100 33800192 2736 1992294400 134512640 146736320 4294588512 18446744073709551615 137381134 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 17.93
Current children cumulated vsize (KiB) 41708

[startup+25.5016 s]
/proc/loadavg: 1.75 1.77 1.69 2/109 24557
/proc/meminfo: memFree=1327900/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=34624 CPUtime=35.42
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 41486 0 0 0 3380 162 0 0 16 0 2 0 177681013 35454976 3057 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 8656 3057 1087 2985 0 5198 0
[pid=24542/tid=24557] ppid=24541 vsize=34624 CPUtime=5.46
/proc/24542/task/24557/stat : 24557 (pb_cplex) R 24541 24541 23705 0 -1 4202560 6178 0 0 0 524 22 0 0 16 0 2 0 177682615 35454976 3057 1992294400 134512640 146736320 4294588512 18446744073709551615 135468697 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 35.42
Current children cumulated vsize (KiB) 43324

[startup+51.1022 s]
/proc/loadavg: 1.64 1.74 1.68 3/109 24559
/proc/meminfo: memFree=1318724/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=42720 CPUtime=66.89
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 94443 0 0 0 6370 319 0 0 16 0 2 0 177681013 43745280 5289 1992294400 134512640 146736320 4294588512 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 10680 5289 1087 2985 0 7222 0
[pid=24542/tid=24557] ppid=24541 vsize=42720 CPUtime=21.42
/proc/24542/task/24557/stat : 24557 (pb_cplex) S 24541 24541 23705 0 -1 4202560 34326 0 0 0 2041 101 0 0 16 0 2 0 177682615 43745280 5289 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 66.89
Current children cumulated vsize (KiB) 51420

[startup+102.302 s]
/proc/loadavg: 1.36 1.66 1.65 2/109 24559
/proc/meminfo: memFree=1306200/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=55580 CPUtime=127.48
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 193007 0 0 0 12143 605 0 0 16 0 2 0 177681013 56913920 8355 1992294400 134512640 146736320 4294588512 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 13895 8355 1086 2985 0 10437 0
[pid=24542/tid=24557] ppid=24541 vsize=55580 CPUtime=50.29
/proc/24542/task/24557/stat : 24557 (pb_cplex) S 24541 24541 23705 0 -1 4202560 82978 0 0 0 4790 239 0 0 16 0 2 0 177682615 56913920 8360 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 127.48
Current children cumulated vsize (KiB) 64280

[startup+162.302 s]
/proc/loadavg: 1.32 1.59 1.63 2/109 24561
/proc/meminfo: memFree=1300992/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=60924 CPUtime=204.01
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 278282 0 0 0 19380 1021 0 0 16 0 2 0 177681013 62386176 9692 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 15231 9692 1085 2985 0 11773 0
[pid=24542/tid=24557] ppid=24541 vsize=60924 CPUtime=87.26
/proc/24542/task/24557/stat : 24557 (pb_cplex) S 24541 24541 23705 0 -1 4202560 125767 0 0 0 8282 444 0 0 16 0 2 0 177682615 62386176 9692 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.01
Current children cumulated vsize (KiB) 69624

[startup+222.309 s]
/proc/loadavg: 1.31 1.55 1.61 2/109 24568
/proc/meminfo: memFree=1317236/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=43892 CPUtime=283.55
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 342612 0 0 0 26944 1411 0 0 16 0 2 0 177681013 44945408 5552 1992294400 134512640 146736320 4294588512 18446744073709551615 137334198 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24542/statm: 10973 5552 1086 2985 0 7515 0
[pid=24542/tid=24566] ppid=24541 vsize=43892 CPUtime=23.06
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 7302 0 0 0 2188 118 0 0 15 0 2 0 177699387 44945408 5552 1992294400 134512640 146736320 4294588512 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 283.55
Current children cumulated vsize (KiB) 52592

[startup+282.302 s]
/proc/loadavg: 1.29 1.50 1.59 2/109 24570
/proc/meminfo: memFree=1312896/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=47988 CPUtime=355.88
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 389653 0 0 0 33800 1788 0 0 15 0 2 0 177681013 49139712 6609 1992294400 134512640 146736320 4294588512 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 11997 6609 1086 2985 0 8539 0
[pid=24542/tid=24566] ppid=24541 vsize=47988 CPUtime=58.82
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 32467 0 0 0 5579 303 0 0 16 0 2 0 177699387 49139712 6609 1992294400 134512640 146736320 4294588512 18446744073709551615 137281042 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 355.88
Current children cumulated vsize (KiB) 56688

[startup+342.301 s]
/proc/loadavg: 1.24 1.45 1.56 2/109 24570
/proc/meminfo: memFree=1311036/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0

################
# More data... #
################

[pid=24542] ppid=24541 vsize=87944 CPUtime=1216.83
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1024689 0 0 0 115155 6528 0 0 16 0 2 0 177681013 90054656 16247 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 21986 16247 1086 2985 0 18528 0
[pid=24542/tid=24566] ppid=24541 vsize=87944 CPUtime=481.2
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 351913 0 0 0 45464 2656 0 0 16 0 2 0 177699387 90054656 16247 1992294400 134512640 146736320 4294588512 18446744073709551615 135982321 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1216.83
Current children cumulated vsize (KiB) 96644

[startup+1062.3 s]
/proc/loadavg: 1.08 1.19 1.34 2/109 24599
/proc/meminfo: memFree=1271480/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=90384 CPUtime=1288.03
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1084122 0 0 0 121871 6932 0 0 16 0 2 0 177681013 92553216 16934 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 22596 16934 1086 2985 0 19138 0
[pid=24542/tid=24566] ppid=24541 vsize=90384 CPUtime=515.34
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 380988 0 0 0 48681 2853 0 0 16 0 2 0 177699387 92553216 16934 1992294400 134512640 146736320 4294588512 18446744073709551615 136387684 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1288.03
Current children cumulated vsize (KiB) 99084

[startup+1122.3 s]
/proc/loadavg: 1.29 1.21 1.34 2/109 24601
/proc/meminfo: memFree=1263792/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=98896 CPUtime=1359.01
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 1147350 0 0 0 128584 7317 0 0 16 0 2 0 177681013 101269504 18892 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 24724 18892 1086 2985 0 21266 0
[pid=24542/tid=24566] ppid=24541 vsize=98896 CPUtime=550.78
/proc/24542/task/24566/stat : 24566 (pb_cplex) S 24541 24541 23705 0 -1 4202560 413248 0 0 0 52033 3045 0 0 16 0 2 0 177699387 101269504 18892 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1359.01
Current children cumulated vsize (KiB) 107596

[startup+1182.3 s]
/proc/loadavg: 1.38 1.24 1.34 3/109 24603
/proc/meminfo: memFree=1253500/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=109324 CPUtime=1431
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1210444 0 0 0 135387 7713 0 0 16 0 2 0 177681013 111947776 21428 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 27331 21428 1086 2985 0 23873 0
[pid=24542/tid=24566] ppid=24541 vsize=109324 CPUtime=587.64
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 446740 0 0 0 55513 3251 0 0 16 0 2 0 177699387 111947776 21428 1992294400 134512640 146736320 4294588512 18446744073709551615 144896091 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1431
Current children cumulated vsize (KiB) 118024

[startup+1242.3 s]
/proc/loadavg: 1.27 1.23 1.33 2/109 24603
/proc/meminfo: memFree=1250152/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=112376 CPUtime=1502.41
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1272919 0 0 0 142145 8096 0 0 16 0 2 0 177681013 115073024 22227 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 28094 22227 1089 2985 0 24636 0
[pid=24542/tid=24566] ppid=24541 vsize=112376 CPUtime=622.27
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 477446 0 0 0 58786 3441 0 0 16 0 2 0 177699387 115073024 22227 1992294400 134512640 146736320 4294588512 18446744073709551615 138430394 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1502.41
Current children cumulated vsize (KiB) 121076

[startup+1302.3 s]
/proc/loadavg: 1.25 1.23 1.32 2/109 24605
/proc/meminfo: memFree=1247300/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=113936 CPUtime=1573.4
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 1333101 0 0 0 148866 8474 0 0 16 0 2 0 177681013 116670464 22873 1992294400 134512640 146736320 4294588512 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 28484 22873 1086 2985 0 25026 0
[pid=24542/tid=24566] ppid=24541 vsize=113936 CPUtime=657.16
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 508128 0 0 0 62084 3632 0 0 16 0 2 0 177699387 116670464 22873 1992294400 134512640 146736320 4294588512 18446744073709551615 136385170 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1573.4
Current children cumulated vsize (KiB) 122636

[startup+1362.3 s]
/proc/loadavg: 1.15 1.20 1.30 2/109 24607
/proc/meminfo: memFree=1244076/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=117964 CPUtime=1644.35
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 1394818 0 0 0 155581 8854 0 0 15 0 2 0 177681013 120795136 23735 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 29491 23735 1086 2985 0 26033 0
[pid=24542/tid=24566] ppid=24541 vsize=117964 CPUtime=692.06
/proc/24542/task/24566/stat : 24566 (pb_cplex) S 24541 24541 23705 0 -1 4202560 538644 0 0 0 65383 3823 0 0 16 0 2 0 177699387 120795136 23735 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1644.35
Current children cumulated vsize (KiB) 126664

[startup+1422.3 s]
/proc/loadavg: 1.18 1.20 1.29 2/109 24609
/proc/meminfo: memFree=1240356/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=121444 CPUtime=1715.44
/proc/24542/stat : 24542 (pb_cplex) R 24541 24541 23705 0 -1 4202496 1456578 0 0 0 162311 9233 0 0 15 0 2 0 177681013 124358656 24671 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 30361 24671 1086 2985 0 26903 0
[pid=24542/tid=24566] ppid=24541 vsize=121444 CPUtime=727.99
/proc/24542/task/24566/stat : 24566 (pb_cplex) S 24541 24541 23705 0 -1 4202560 569871 0 0 0 68787 4012 0 0 16 0 2 0 177699387 124358656 24671 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 2 4096 16387 18446604437830910400 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1715.44
Current children cumulated vsize (KiB) 130144

[startup+1482.3 s]
/proc/loadavg: 1.17 1.19 1.28 2/109 24611
/proc/meminfo: memFree=1236884/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=125744 CPUtime=1785.91
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1518301 0 0 0 168981 9610 0 0 16 0 2 0 177681013 128761856 25574 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24542/statm: 31436 25574 1086 2985 0 27978 0
[pid=24542/tid=24566] ppid=24541 vsize=125744 CPUtime=762.19
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 600146 0 0 0 72020 4199 0 0 16 0 2 0 177699387 128761856 25574 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1785.91
Current children cumulated vsize (KiB) 134444



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1493.8 s]
/proc/loadavg: 1.21 1.19 1.28 2/109 24611
/proc/meminfo: memFree=1236140/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=126308 CPUtime=1800.09
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1530181 0 0 0 170320 9689 0 0 15 0 2 0 177681013 129339392 25725 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 31577 25725 1086 2985 0 28119 0
[pid=24542/tid=24566] ppid=24541 vsize=126308 CPUtime=769.69
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 606402 0 0 0 72729 4240 0 0 16 0 2 0 177699387 129339392 25725 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 135008

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1493.8 s]
/proc/loadavg: 1.21 1.19 1.28 2/109 24611
/proc/meminfo: memFree=1236140/2059040 swapFree=4135876/4192956
[pid=24541] ppid=24539 vsize=8700 CPUtime=0
/proc/24541/stat : 24541 (run) S 24539 24541 23705 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 177681013 8908800 248 1992294400 4194304 4922060 140735382748800 18446744073709551615 257316985989 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24541/statm: 2175 248 208 178 0 68 0
[pid=24542] ppid=24541 vsize=126308 CPUtime=1800.09
/proc/24542/stat : 24542 (pb_cplex) S 24541 24541 23705 0 -1 4202496 1530181 0 0 0 170320 9689 0 0 15 0 2 0 177681013 129339392 25725 1992294400 134512640 146736320 4294588512 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24542/statm: 31577 25725 1086 2985 0 28119 0
[pid=24542/tid=24566] ppid=24541 vsize=126308 CPUtime=769.69
/proc/24542/task/24566/stat : 24566 (pb_cplex) R 24541 24541 23705 0 -1 4202560 606402 0 0 0 72729 4240 0 0 16 0 2 0 177699387 129339392 25725 1992294400 134512640 146736320 4294588512 18446744073709551615 144785853 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 135008

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24541 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.001998
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1493.83
CPU time (s): 1800.09
CPU user time (s): 1703.2
CPU system time (s): 96.89
CPU usage (%): 120.502
Max. virtual memory (cumulated for all children) (KiB): 135544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 364
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.82657 second user time and 7.65484 second system time

The end

Launcher Data 

Begin job on node012 at 2010-07-01 23:46:34
IDJOB=2696047
IDBENCH=2912
IDSOLVER=1209
FILE ID=node012/2696047-1278020794
PBS_JOBID= 11198743
Free space on /tmp= 62320 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_8_70_3.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696047-1278020794/watcher-2696047-1278020794 -o /tmp/evaluation-result-2696047-1278020794/solver-2696047-1278020794 -C 1800 -W 2000 -M 1800  run HOME/instance-2696047-1278020794.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 0278ee4f163393ac33163ff791a7f96d
RANDOM SEED=1672171042

node012.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.258
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.51
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.258
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.45
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1337132 kB
Buffers:        146364 kB
Cached:         464312 kB
SwapCached:      10524 kB
Active:         261848 kB
Inactive:       362904 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1337132 kB
SwapTotal:     4192956 kB
SwapFree:      4135876 kB
Dirty:           16628 kB
Writeback:           0 kB
AnonPages:       12308 kB
Mapped:           8408 kB
Slab:            75032 kB
PageTables:       4180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182080 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62304 MiB
End job on node012 at 2010-07-02 00:11:30