Trace number 2674583

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PBPASSolver 2010-06-13? (TO) 1800.08 1800.62

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib/normalized-mps-v2-20-10-stein45.opb
MD5SUM5084bd7d25dcb1d535d550da78b2db16
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark30
Best CPU time to get the best result obtained on this benchmark23.5534
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 30
Optimality of the best value was proved YES
Number of variables45
Total number of constraints331
Number of constraints which are clauses330
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint45
Number of terms in the objective function 45
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 45
Number of bits of the sum of numbers in the objective function 6
Biggest number in a constraint 22
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 67
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.14	c 45 331 0 0 0 0 0 0
0.00/0.14	c 16 ~x381+8 ~x380+4 ~x379+2 ~x378+1 ~x377+1 x46+1 x45+1 x44+1 x43+1 x42+1 x41+1 x40+1 x39+1 x38+1 x37+1 x36+1 x35+1 x34+1 x33+1 x32+1 x31+1 x30+1 x29+1 x28+1 x27+1 x26+1 x25+1 x24+1 x23+1 x22+1 x21+1 x20+1 x19+1 x18+1 x17+1 x16+1 x15+1 x14+1 x13+1 x12+1 x11+1 x10+1 x9+1 x8+1 x7+1 x6+1 x5+1 x4+1 x3+1 x2-0=53
0.00/0.34	o 37
0.00/0.34	c 16 ~x2442+8 ~x2441+4 ~x2440+2 ~x2439+1 ~x2438+1 ~x46+1 ~x45+1 ~x44+1 ~x43+1 ~x42+1 ~x41+1 ~x40+1 ~x39+1 ~x38+1 ~x37+1 ~x36+1 ~x35+1 ~x34+1 ~x33+1 ~x32+1 ~x31+1 ~x30+1 ~x29+1 *** glibc detected *** ./PBPASSolver: double free or corruption (!prev): 0x08d6b6f0 ***
1800.08/1800.61	======= Backtrace: =========
1800.08/1800.61	/lib/libc.so.6[0x5a8595]
1800.08/1800.61	/lib/libc.so.6(cfree+0x59)[0x5a89d9]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6SolverD1Ev+0x31)[0xf7f8321d]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN21MiniSatSolversManagerD1Ev+0x5e)[0xf7f7cb8c]
1800.08/1800.61	HOME/libMiniSatManager.so(Free+0x1f)[0xf7f86d01]
1800.08/1800.61	HOME/libMiniSatManager.so(cFree+0xb)[0xf7f86bb2]
1800.08/1800.61	./PBPASSolver[0x80918d5]
1800.08/1800.61	./PBPASSolver[0x8049040]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver12detachClauseER6Clause+0x19a)[0xf7f81160]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver12removeClauseER6Clause+0x18)[0xf7f81490]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver8reduceDBEv+0xf0)[0xf7f81658]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver6searchEii+0x337)[0xf7f83e73]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver5solveERK3vecI3LitE+0x247)[0xf7f84335]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN6Solver5solveEv+0x24)[0xf7f808ee]
1800.08/1800.61	HOME/libMiniSatManager.so(_ZN21MiniSatSolversManager5SolveEi+0x10d)[0xf7f7d12f]
1800.08/1800.61	HOME/libMiniSatManager.so(Solve+0x1b)[0xf7f86e2d]
1800.08/1800.61	HOME/libMiniSatManager.so(cSolve+0x11)[0xf7f86b04]
1800.08/1800.61	./PBPASSolver[0x80917b1]
1800.08/1800.61	./PBPASSolver[0x80a051a]
1800.08/1800.61	./PBPASSolver[0x809060b]
1800.08/1800.61	./PBPASSolver[0x8091380]
1800.08/1800.61	./PBPASSolver[0x80487c8]
1800.08/1800.61	./PBPASSolver[0x80a71dd]
1800.08/1800.61	======= Memory map: ========
1800.08/1800.61	00521000-0053b000 r-xp 00000000 08:02 852598                             /lib/ld-2.5.so
1800.08/1800.61	0053b000-0053c000 r-xp 00019000 08:02 852598                             /lib/ld-2.5.so
1800.08/1800.61	0053c000-0053d000 rwxp 0001a000 08:02 852598                             /lib/ld-2.5.so
1800.08/1800.61	0053f000-0067e000 r-xp 00000000 08:02 850321                             /lib/libc-2.5.so
1800.08/1800.61	0067e000-00680000 r-xp 0013f000 08:02 850321                             /lib/libc-2.5.so
1800.08/1800.61	00680000-00681000 rwxp 00141000 08:02 850321                             /lib/libc-2.5.so
1800.08/1800.61	00681000-00684000 rwxp 00681000 00:00 0 
1800.08/1800.61	00750000-00775000 r-xp 00000000 08:02 850375                             /lib/libm-2.5.so
1800.08/1800.61	00775000-00776000 r-xp 00024000 08:02 850375                             /lib/libm-2.5.so
1800.08/1800.61	00776000-00777000 rwxp 00025000 08:02 850375                             /lib/libm-2.5.so
1800.08/1800.61	08048000-080a8000 r-xp 00000000 08:05 17399811                           HOME/PBPASSolver
1800.08/1800.61	080a8000-080cc000 rwxp 0005f000 08:05 17399811                           HOME/PBPASSolver
1800.08/1800.61	080cc000-080ce000 rwxp 080cc000 00:00 0 
1800.08/1800.61	08996000-09688000 rwxp 08996000 00:00 0                                  [heap]
1800.08/1800.61	f664a000-f668a000 rwxp f664a000 00:00 0 
1800.08/1800.61	f670a000-f6783000 rwxp f685e000 00:00 0 
1800.08/1800.61	f67bd000-f685a000 rwxp f67bd000 00:00 0 
1800.08/1800.61	f6882000-f688a000 rwxp f6882000 00:00 0 
1800.08/1800.61	f68a2000-f6942000 rwxp f68a2000 00:00 0 
1800.08/1800.61	f6962000-f7e6c000 rwxp f6962000 00:00 0 
1800.08/1800.61	f7e6c000-f7e78000 r-xp 00000000 00:16 3310098                            /home/evaluation/evaluation/tools64/lib/libgcc_s.so.1
1800.08/1800.61	f7e78000-f7e79000 rwxp 0000b000 00:16 3310098                            /home/evaluation/evaluation/tools64/lib/libgcc_s.so.1
1800.08/1800.61	f7e7e000-f7e86000 rwxp f7e7e000 00:00 0 
1800.08/1800.61	f7e86000-f7f67000 r-xp 00000000 00:16 3310071                            /home/evaluation/evaluation/tools64/lib/libstdc++.so.6.0.10
1800.08/1800.61	f7f67000-f7f68000 r-xp 000e1000 00:16 3310071                            /home/evaluation/evaluation/tools64/lib/libstdc++.so.6.0.10
1800.08/1800.61	f7f68000-f7f6c000 rwxp 000e2000 00:16 3310071                            /home/evaluation/evaluation/tools64/lib/libstdc++.so.6.0.10
1800.08/1800.61	f7f6c000-f7f72000 rwxp f7f6c000 00:00 0 
1800.08/1800.61	f7f72000-f7f89000 r-xp 00000000 08:05 17399812                           HOME/libMiniSatManager.so
1800.08/1800.61	f7f89000-f7f8a000 rwxp 00016000 08:05 17399812                           HOME/libMiniSatManager.so
1800.08/1800.61	f7f8a000-f7f8b000 rwxp f7f8a000 00:00 0 
1800.08/1800.61	ffe7a000-ffe8f000 rwxp 7ffffffea000 00:00 0                              [stack]
1800.08/1800.61	ffffe000-fffff000 r-xp ffffe000 00:00 0 

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2674583-1276793291/watcher-2674583-1276793291 -o /tmp/evaluation-result-2674583-1276793291/solver-2674583-1276793291 -C 1800 -W 2000 -M 1800 run HOME/instance-2674583-1276793291.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/105 22415
/proc/meminfo: memFree=1704648/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0

[startup+0.061345 s]
/proc/loadavg: 0.92 0.98 0.99 3/105 22415
/proc/meminfo: memFree=1704648/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101348 s]
/proc/loadavg: 0.92 0.98 0.99 3/105 22415
/proc/meminfo: memFree=1704648/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300367 s]
/proc/loadavg: 0.92 0.98 0.99 3/105 22415
/proc/meminfo: memFree=1704648/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700405 s]
/proc/loadavg: 0.92 0.98 0.99 3/105 22415
/proc/meminfo: memFree=1704648/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50148 s]
/proc/loadavg: 0.92 0.98 0.99 2/107 22418
/proc/meminfo: memFree=1679460/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=28220 CPUtime=1.49
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7073 0 0 0 144 5 0 0 25 0 1 0 20622646 28897280 6426 1992294400 134512640 134902295 4293453216 18446744073709551615 4160213617 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7055 6426 269 96 0 6267 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 36920

[startup+3.10164 s]
/proc/loadavg: 0.92 0.98 0.99 2/107 22418
/proc/meminfo: memFree=1679212/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=28616 CPUtime=3.08
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7173 0 0 0 303 5 0 0 25 0 1 0 20622646 29302784 6526 1992294400 134512640 134902295 4293453216 18446744073709551615 4160234784 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7154 6526 269 96 0 6366 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 37316

[startup+6.30194 s]
/proc/loadavg: 0.93 0.98 0.99 2/107 22418
/proc/meminfo: memFree=1678344/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=29300 CPUtime=6.29
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7339 0 0 0 623 6 0 0 25 0 1 0 20622646 30003200 6692 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232655 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7325 6692 269 96 0 6537 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 38000

[startup+12.7016 s]
/proc/loadavg: 0.93 0.98 0.99 2/107 22420
/proc/meminfo: memFree=1676980/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=30660 CPUtime=12.69
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7661 0 0 0 1263 6 0 0 25 0 1 0 20622646 31395840 7014 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232351 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7665 7014 269 96 0 6877 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 39360

[startup+25.5008 s]
/proc/loadavg: 0.95 0.98 0.99 2/107 22420
/proc/meminfo: memFree=1675988/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=31332 CPUtime=25.48
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7859 0 0 0 2542 6 0 0 25 0 1 0 20622646 32083968 7212 1992294400 134512640 134902295 4293453216 18446744073709551615 4160246717 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7833 7212 269 96 0 7045 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 40032

[startup+51.1013 s]
/proc/loadavg: 0.96 0.98 0.99 2/107 22420
/proc/meminfo: memFree=1675740/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=31600 CPUtime=51.07
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 7915 0 0 0 5101 6 0 0 25 0 1 0 20622646 32358400 7268 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232708 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 7900 7268 269 96 0 7112 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 40300

[startup+102.308 s]
/proc/loadavg: 0.98 0.98 0.99 2/107 22422
/proc/meminfo: memFree=1674872/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=32408 CPUtime=102.27
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8096 0 0 0 10221 6 0 0 25 0 1 0 20622646 33185792 7449 1992294400 134512640 134902295 4293453216 18446744073709551615 4160247094 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8102 7449 269 96 0 7314 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 41108

[startup+162.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22424
/proc/meminfo: memFree=1673384/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=33732 CPUtime=162.25
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8426 0 0 0 16218 7 0 0 25 0 1 0 20622646 34541568 7779 1992294400 134512640 134902295 4293453216 18446744073709551615 4160213626 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8433 7779 269 96 0 7645 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 42432

[startup+222.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22424
/proc/meminfo: memFree=1671896/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=35212 CPUtime=222.23
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8798 0 0 0 22216 7 0 0 25 0 1 0 20622646 36057088 8151 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232645 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8803 8151 269 96 0 8015 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 43912

[startup+282.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22426
/proc/meminfo: memFree=1671896/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=35212 CPUtime=282.21
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8818 0 0 0 28214 7 0 0 25 0 1 0 20622646 36057088 8171 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232592 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8803 8171 269 96 0 8015 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 43912

[startup+342.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22428
/proc/meminfo: memFree=1671896/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=35212 CPUtime=342.2
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8818 0 0 0 34213 7 0 0 25 0 1 0 20622646 36057088 8171 1992294400 134512640 134902295 4293453216 18446744073709551615 4160243838 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8803 8171 269 96 0 8015 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 43912

[startup+402.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22430
/proc/meminfo: memFree=1671896/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=35356 CPUtime=402.18
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 8840 0 0 0 40211 7 0 0 25 0 1 0 20622646 36204544 8193 1992294400 134512640 134902295 4293453216 18446744073709551615 4160249127 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 8839 8193 269 96 0 8051 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 44056

[startup+462.301 s]

################
# More data... #
################

/proc/22417/statm: 9502 8818 269 96 0 8714 0
Current children cumulated CPU time (s) 1121.96
Current children cumulated vsize (KiB) 46708

[startup+1182.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22459
/proc/meminfo: memFree=1668548/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=38276 CPUtime=1181.94
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9531 0 0 0 118187 7 0 0 25 0 1 0 20622646 39194624 8884 1992294400 134512640 134902295 4293453216 18446744073709551615 4160244200 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9569 8884 269 96 0 8781 0
Current children cumulated CPU time (s) 1181.94
Current children cumulated vsize (KiB) 46976

[startup+1242.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22461
/proc/meminfo: memFree=1667432/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39068 CPUtime=1241.92
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9742 0 0 0 124185 7 0 0 25 0 1 0 20622646 40005632 9095 1992294400 134512640 134902295 4293453216 18446744073709551615 4160229270 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9767 9095 269 96 0 8979 0
Current children cumulated CPU time (s) 1241.92
Current children cumulated vsize (KiB) 47768

[startup+1302.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22463
/proc/meminfo: memFree=1667308/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39068 CPUtime=1301.91
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9742 0 0 0 130184 7 0 0 25 0 1 0 20622646 40005632 9095 1992294400 134512640 134902295 4293453216 18446744073709551615 4160246731 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9767 9095 269 96 0 8979 0
Current children cumulated CPU time (s) 1301.91
Current children cumulated vsize (KiB) 47768

[startup+1362.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22465
/proc/meminfo: memFree=1667184/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39200 CPUtime=1361.89
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9784 0 0 0 136182 7 0 0 25 0 1 0 20622646 40140800 9137 1992294400 134512640 134902295 4293453216 18446744073709551615 4160246480 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9800 9137 269 96 0 9012 0
Current children cumulated CPU time (s) 1361.89
Current children cumulated vsize (KiB) 47900

[startup+1422.31 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22465
/proc/meminfo: memFree=1667184/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39344 CPUtime=1421.88
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9803 0 0 0 142181 7 0 0 25 0 1 0 20622646 40288256 9156 1992294400 134512640 134902295 4293453216 18446744073709551615 4160225756 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9836 9156 269 96 0 9048 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 48044

[startup+1482.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22467
/proc/meminfo: memFree=1667184/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39344 CPUtime=1481.85
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9803 0 0 0 148178 7 0 0 25 0 1 0 20622646 40288256 9156 1992294400 134512640 134902295 4293453216 18446744073709551615 4160246672 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9836 9156 269 96 0 9048 0
Current children cumulated CPU time (s) 1481.85
Current children cumulated vsize (KiB) 48044

[startup+1542.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22469
/proc/meminfo: memFree=1667060/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39484 CPUtime=1541.84
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9826 0 0 0 154177 7 0 0 25 0 1 0 20622646 40431616 9179 1992294400 134512640 134902295 4293453216 18446744073709551615 4160243904 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9871 9179 269 96 0 9083 0
Current children cumulated CPU time (s) 1541.84
Current children cumulated vsize (KiB) 48184

[startup+1602.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22471
/proc/meminfo: memFree=1667060/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=39484 CPUtime=1601.82
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9835 0 0 0 160175 7 0 0 25 0 1 0 20622646 40431616 9188 1992294400 134512640 134902295 4293453216 18446744073709551615 4160232597 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 9871 9188 269 96 0 9083 0
Current children cumulated CPU time (s) 1601.82
Current children cumulated vsize (KiB) 48184

[startup+1662.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22473
/proc/meminfo: memFree=1666316/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=40160 CPUtime=1661.81
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 9997 0 0 0 166173 8 0 0 25 0 1 0 20622646 41123840 9350 1992294400 134512640 134902295 4293453216 18446744073709551615 4160243838 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 10040 9350 269 96 0 9252 0
Current children cumulated CPU time (s) 1661.81
Current children cumulated vsize (KiB) 48860

[startup+1722.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22473
/proc/meminfo: memFree=1666192/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=40160 CPUtime=1721.79
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 10017 0 0 0 172171 8 0 0 25 0 1 0 20622646 41123840 9370 1992294400 134512640 134902295 4293453216 18446744073709551615 4160213705 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 10040 9370 269 96 0 9252 0
Current children cumulated CPU time (s) 1721.79
Current children cumulated vsize (KiB) 48860

[startup+1782.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22475
/proc/meminfo: memFree=1665944/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=40160 CPUtime=1781.78
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 10017 0 0 0 178170 8 0 0 25 0 1 0 20622646 41123840 9370 1992294400 134512640 134902295 4293453216 18446744073709551615 4160243905 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 10040 9370 269 96 0 9252 0
Current children cumulated CPU time (s) 1781.78
Current children cumulated vsize (KiB) 48860



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 0.99 0.98 0.99 2/107 22475
/proc/meminfo: memFree=1665944/2059040 swapFree=4140140/4192956
[pid=22415] ppid=22413 vsize=8700 CPUtime=0
/proc/22415/stat : 22415 (run) S 22413 22415 21973 0 -1 4202496 389 134 0 0 0 0 0 0 25 0 1 0 20622646 8908800 250 1992294400 4194304 4922060 140733581815888 18446744073709551615 207239093381 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/22415/statm: 2175 250 211 178 0 68 0
[pid=22417] ppid=22415 vsize=40160 CPUtime=1800.08
/proc/22417/stat : 22417 (PBPASSolver) R 22415 22415 21973 0 -1 4202496 10017 0 0 0 180000 8 0 0 25 0 1 0 20622646 41123840 9370 1992294400 134512640 134902295 4293453216 18446744073709551615 4160246428 0 0 4096 17608 0 0 0 17 1 0 0 0
/proc/22417/statm: 10040 9370 269 96 0 9252 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 48860

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22415 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1800.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.62
CPU time (s): 1800.08
CPU user time (s): 1800
CPU system time (s): 0.08
CPU usage (%): 99.9698
Max. virtual memory (cumulated for all children) (KiB): 48860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 523
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 3

runsolver used 3.13852 second user time and 8.34173 second system time

The end

Launcher Data

Begin job on node089 at 2010-06-17 18:48:12
IDJOB=2674583
IDBENCH=1865
IDSOLVER=1174
FILE ID=node089/2674583-1276793291
PBS_JOBID= 11176583
Free space on /tmp= 62552 MiB

SOLVER NAME= PBPASSolver 2010-06-13
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib/normalized-mps-v2-20-10-stein45.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2674583-1276793291/watcher-2674583-1276793291 -o /tmp/evaluation-result-2674583-1276793291/solver-2674583-1276793291 -C 1800 -W 2000 -M 1800  run HOME/instance-2674583-1276793291.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 5084bd7d25dcb1d535d550da78b2db16
RANDOM SEED=387687452

node089.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.48
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5999.47
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1705168 kB
Buffers:         95464 kB
Cached:         167908 kB
SwapCached:       5680 kB
Active:          96360 kB
Inactive:       179216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1705168 kB
SwapTotal:     4192956 kB
SwapFree:      4140140 kB
Dirty:             676 kB
Writeback:           0 kB
AnonPages:       10808 kB
Mapped:          12916 kB
Slab:            56724 kB
PageTables:       3980 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182004 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62516 MiB
End job on node089 at 2010-06-17 19:18:14