Trace number 2696203

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.19 992.819

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
namasivayam/tsp/normalized-t3002.11tsp11.1900565534.opb
MD5SUM0fea7c185f4d6e2091fba763db8ccbcc
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark52.791
Has Objective FunctionNO
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables231
Total number of constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 685
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.01	c pb_cplex 1.0 - 20100701
0.00/0.01	c Parsing opb file format. File HOME/instance-2696203-1278015153.opb.
0.00/0.01	c Instance file HOME/instance-2696203-1278015153.opb
0.00/0.01	c File size is 83375 bytes.
0.00/0.03	c Highest Coefficient sum: 685
0.00/0.03	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.04	c ============================[ Problem Statistics ]=============================
0.00/0.04	c |                                                                             |
0.00/0.04	c |  Parsing time:          0.03         s                                      |
0.00/0.04	c |  Number Variables:      231                                                 |
0.00/0.04	c |  Number Constraints:    2707                                                |
0.00/0.04	c ===============================================================================
1800.17/992.81	c Remaining time 1799.97 sec.
1800.17/992.81	c 
1800.17/992.81	c *** INTERRUPTED ***
1800.17/992.81	s UNKNOWN
1800.17/992.81	c Total CPU time              : 1791.63 s
1800.17/992.81	c Memory used           : 40.38 MB
1800.17/992.81	c CPU time              : 1791.63 s
1800.17/992.81	c 
1800.17/992.81	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696203-1278015153/watcher-2696203-1278015153 -o /tmp/evaluation-result-2696203-1278015153/solver-2696203-1278015153 -C 1800 -W 2000 -M 1800 run HOME/instance-2696203-1278015153.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 3/106 27189
/proc/meminfo: memFree=1580812/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0

[startup+0.0698949 s]
/proc/loadavg: 0.00 0.00 0.00 3/106 27189
/proc/meminfo: memFree=1580812/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101896 s]
/proc/loadavg: 0.00 0.00 0.00 3/106 27189
/proc/meminfo: memFree=1580812/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301917 s]
/proc/loadavg: 0.00 0.00 0.00 3/106 27189
/proc/meminfo: memFree=1580812/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701961 s]
/proc/loadavg: 0.00 0.00 0.00 3/106 27189
/proc/meminfo: memFree=1580812/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50105 s]
/proc/loadavg: 0.00 0.00 0.00 2/109 27192
/proc/meminfo: memFree=1569876/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=39172 CPUtime=1.85
/proc/27190/stat : 27190 (pb_cplex) S 27189 27189 27075 0 -1 4202496 5426 0 0 0 183 2 0 0 18 0 2 0 142807849 40112128 3772 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 9793 3772 984 2985 0 6335 0
[pid=27190/tid=27192] ppid=27189 vsize=39172 CPUtime=0.49
/proc/27190/task/27192/stat : 27192 (pb_cplex) R 27189 27189 27075 0 -1 4202560 676 0 0 0 49 0 0 0 17 0 2 0 142807940 40112128 3772 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.85
Current children cumulated vsize (KiB) 47872

[startup+3.10123 s]
/proc/loadavg: 0.16 0.03 0.01 2/109 27192
/proc/meminfo: memFree=1568388/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=39152 CPUtime=4.59
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 6195 0 0 0 454 5 0 0 16 0 2 0 142807849 40091648 3772 1992294400 134512640 146736320 4292581264 18446744073709551615 136017766 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 9788 3772 984 2985 0 6330 0
[pid=27190/tid=27192] ppid=27189 vsize=39152 CPUtime=2.03
/proc/27190/task/27192/stat : 27192 (pb_cplex) R 27189 27189 27075 0 -1 4202560 1400 0 0 0 201 2 0 0 19 0 2 0 142807940 40091648 3772 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.59
Current children cumulated vsize (KiB) 47852

[startup+6.30158 s]
/proc/loadavg: 0.16 0.03 0.01 3/109 27193
/proc/meminfo: memFree=1569132/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=37600 CPUtime=8.47
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 7977 0 0 0 840 7 0 0 20 0 2 0 142807849 38502400 3695 1992294400 134512640 146736320 4292581264 18446744073709551615 136403114 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 9400 3695 998 2985 0 5942 0
Current children cumulated CPU time (s) 8.47
Current children cumulated vsize (KiB) 46300

[startup+12.7013 s]
/proc/loadavg: 0.53 0.11 0.04 3/109 27194
/proc/meminfo: memFree=1565536/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=40080 CPUtime=19.93
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 14861 0 0 0 1980 13 0 0 25 0 2 0 142807849 41041920 4390 1992294400 134512640 146736320 4292581264 18446744073709551615 139044505 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10020 4390 998 2985 0 6562 0
[pid=27190/tid=27194] ppid=27189 vsize=40080 CPUtime=5.37
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 1592 0 0 0 536 1 0 0 17 0 2 0 142808391 41041920 4390 1992294400 134512640 146736320 4292581264 18446744073709551615 136004987 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 19.93
Current children cumulated vsize (KiB) 48780

[startup+25.5017 s]
/proc/loadavg: 0.68 0.16 0.05 3/109 27194
/proc/meminfo: memFree=1565784/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=40088 CPUtime=43.26
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 19676 0 0 0 4304 22 0 0 25 0 2 0 142807849 41050112 4404 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10022 4404 998 2985 0 6564 0
[pid=27190/tid=27194] ppid=27189 vsize=40088 CPUtime=16.53
/proc/27190/task/27194/stat : 27194 (pb_cplex) S 27189 27189 27075 0 -1 4202560 2782 0 0 0 1648 5 0 0 17 0 2 0 142808391 41050112 4404 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 2 4096 16387 18446604437820488640 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 43.26
Current children cumulated vsize (KiB) 48788

[startup+51.1015 s]
/proc/loadavg: 1.13 0.31 0.10 3/109 27194
/proc/meminfo: memFree=1565660/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41280 CPUtime=90.84
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 43197 0 0 0 9034 50 0 0 17 0 2 0 142807849 42270720 4696 1992294400 134512640 146736320 4292581264 18446744073709551615 136008450 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 10320 4696 998 2985 0 6862 0
[pid=27190/tid=27194] ppid=27189 vsize=41280 CPUtime=40.53
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 26300 0 0 0 4030 23 0 0 20 0 2 0 142808391 42270720 4696 1992294400 134512640 146736320 4292581264 18446744073709551615 136000487 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 90.84
Current children cumulated vsize (KiB) 49980

[startup+102.309 s]
/proc/loadavg: 1.68 0.59 0.21 3/109 27196
/proc/meminfo: memFree=1565412/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=40272 CPUtime=185.82
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 76153 0 0 0 18481 101 0 0 17 0 2 0 142807849 41238528 4597 1992294400 134512640 146736320 4292581264 18446744073709551615 139041156 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 10068 4597 998 2985 0 6610 0
[pid=27190/tid=27194] ppid=27189 vsize=40272 CPUtime=87.99
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 52312 0 0 0 8747 52 0 0 19 0 2 0 142808391 41238528 4597 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 185.82
Current children cumulated vsize (KiB) 48972

[startup+162.302 s]
/proc/loadavg: 1.67 0.78 0.30 4/109 27198
/proc/meminfo: memFree=1564544/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41512 CPUtime=278.66
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 98117 0 0 0 27723 143 0 0 16 0 2 0 142807849 42508288 4705 1992294400 134512640 146736320 4292581264 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10378 4705 1005 2985 0 6920 0
[pid=27190/tid=27194] ppid=27189 vsize=41512 CPUtime=124.95
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 59869 0 0 0 12425 70 0 0 17 0 2 0 142808391 42508288 4705 1992294400 134512640 146736320 4292581264 18446744073709551615 136403114 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 278.66
Current children cumulated vsize (KiB) 50212

[startup+222.301 s]
/proc/loadavg: 1.84 0.99 0.40 3/109 27200
/proc/meminfo: memFree=1564296/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=42708 CPUtime=387.86
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 109892 0 0 0 38596 190 0 0 17 0 2 0 142807849 43732992 4941 1992294400 134512640 146736320 4292581264 18446744073709551615 136403114 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 10677 4941 1005 2985 0 7219 0
[pid=27190/tid=27194] ppid=27189 vsize=42708 CPUtime=179.41
/proc/27190/task/27194/stat : 27194 (pb_cplex) S 27189 27189 27075 0 -1 4202560 70701 0 0 0 17844 97 0 0 17 0 2 0 142808391 43732992 4941 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 2 4096 16387 18446604437820488640 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 387.86
Current children cumulated vsize (KiB) 51408

[startup+282.302 s]
/proc/loadavg: 2.00 1.20 0.50 3/109 27200
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41684 CPUtime=497.39
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 134467 0 0 0 49501 238 0 0 19 0 2 0 142807849 42684416 4748 1992294400 134512640 146736320 4292581264 18446744073709551615 136004877 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10421 4748 1005 2985 0 6963 0
[pid=27190/tid=27194] ppid=27189 vsize=41684 CPUtime=235.43
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 70702 0 0 0 23426 117 0 0 17 0 2 0 142808391 42684416 4748 1992294400 134512640 146736320 4292581264 18446744073709551615 137412866 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 497.39
Current children cumulated vsize (KiB) 50384

[startup+342.302 s]
/proc/loadavg: 1.97 1.34 0.59 3/109 27202
/proc/meminfo: memFree=1564544/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41576 CPUtime=607.76
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 165566 0 0 0 60485 291 0 0 25 0 2 0 142807849 42573824 4676 1992294400 134512640 146736320 4292581264 18446744073709551615 136017516 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10394 4676 1005 2985 0 6936 0
[pid=27190/tid=27194] ppid=27189 vsize=41576 CPUtime=290.38
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 71957 0 0 0 28902 136 0 0 18 0 2 0 142808391 42573824 4676 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 607.76
Current children cumulated vsize (KiB) 50276

[startup+402.301 s]
/proc/loadavg: 1.93 1.44 0.67 3/109 27204
/proc/meminfo: memFree=1564792/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41728 CPUtime=717.69
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 173656 0 0 0 71431 338 0 0 25 0 2 0 142807849 42729472 4717 1992294400 134512640 146736320 4292581264 18446744073709551615 135526330 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10432 4717 1005 2985 0 6974 0
[pid=27190/tid=27194] ppid=27189 vsize=41728 CPUtime=343.7
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 76781 0 0 0 34209 161 0 0 16 0 2 0 142808391 42729472 4717 1992294400 134512640 146736320 4292581264 18446744073709551615 136007668 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 717.69
Current children cumulated vsize (KiB) 50428

[startup+462.302 s]
/proc/loadavg: 1.86 1.50 0.74 3/109 27206
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41904 CPUtime=826.47
/proc/27190/stat : 27190 (pb_cplex) S 27189 27189 27075 0 -1 4202496 196975 0 0 0 82260 387 0 0 25 0 2 0 142807849 42909696 4778 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10476 4778 1005 2985 0 7018 0
[pid=27190/tid=27194] ppid=27189 vsize=41904 CPUtime=395.38
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 79347 0 0 0 39355 183 0 0 17 0 2 0 142808391 42909696 4778 1992294400 134512640 146736320 4292581264 18446744073709551615 136004909 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 826.47
Current children cumulated vsize (KiB) 50604

[startup+522.301 s]
/proc/loadavg: 1.78 1.53 0.79 3/109 27208
/proc/meminfo: memFree=1564296/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41904 CPUtime=936.53
/proc/27190/stat : 27190 (pb_cplex) S 27189 27189 27075 0 -1 4202496 229326 0 0 0 93208 445 0 0 25 0 2 0 142807849 42909696 4786 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10476 4786 1005 2985 0 7018 0
[pid=27190/tid=27194] ppid=27189 vsize=41904 CPUtime=448.44
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 79347 0 0 0 44638 206 0 0 16 0 2 0 142808391 42909696 4786 1992294400 134512640 146736320 4292581264 18446744073709551615 136018931 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 936.53
Current children cumulated vsize (KiB) 50604

[startup+582.302 s]
/proc/loadavg: 1.96 1.63 0.87 3/109 27208
/proc/meminfo: memFree=1564544/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1045.95
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 257935 0 0 0 104102 493 0 0 18 0 2 0 142807849 42336256 4711 1992294400 134512640 146736320 4292581264 18446744073709551615 136008065 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4711 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=501.54
/proc/27190/task/27194/stat : 27194 (pb_cplex) S 27189 27189 27075 0 -1 4202560 102165 0 0 0 49920 234 0 0 18 0 2 0 142808391 42336256 4711 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 2 4096 16387 18446604437820488640 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1045.95
Current children cumulated vsize (KiB) 50044

[startup+642.301 s]
/proc/loadavg: 2.07 1.71 0.94 3/109 27210
/proc/meminfo: memFree=1564544/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1156.72
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 290418 0 0 0 115127 545 0 0 25 0 2 0 142807849 42336256 4673 1992294400 134512640 146736320 4292581264 18446744073709551615 135854482 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4673 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=556.02
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 132798 0 0 0 55337 265 0 0 17 0 2 0 142808391 42336256 4673 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1156.72
Current children cumulated vsize (KiB) 50044

[startup+702.302 s]
/proc/loadavg: 2.07 1.77 1.01 3/109 27212
/proc/meminfo: memFree=1564668/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1266.06
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 323273 0 0 0 126005 601 0 0 25 0 2 0 142807849 42336256 4681 1992294400 134512640 146736320 4292581264 18446744073709551615 135526124 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4681 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=609.19
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 164185 0 0 0 60616 303 0 0 17 0 2 0 142808391 42336256 4681 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1266.06
Current children cumulated vsize (KiB) 50044

[startup+762.309 s]
/proc/loadavg: 2.05 1.83 1.08 4/109 27214
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1376.47
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 356913 0 0 0 136995 652 0 0 25 0 2 0 142807849 42336256 4686 1992294400 134512640 146736320 4292581264 18446744073709551615 136007626 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4686 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=662.43
/proc/27190/task/27194/stat : 27194 (pb_cplex) S 27189 27189 27075 0 -1 4202560 195771 0 0 0 65909 334 0 0 16 0 2 0 142808391 42336256 4686 1992294400 134512640 146736320 4292581264 18446744073709551615 144580073 0 2 4096 16387 18446604437820488640 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1376.47
Current children cumulated vsize (KiB) 50044

[startup+822.302 s]
/proc/loadavg: 2.05 1.84 1.13 3/109 27216
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1486.81
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 390326 0 0 0 147972 709 0 0 18 0 2 0 142807849 42336256 4710 1992294400 134512640 146736320 4292581264 18446744073709551615 136007670 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4710 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=715.73
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 227274 0 0 0 71203 370 0 0 18 0 2 0 142808391 42336256 4710 1992294400 134512640 146736320 4292581264 18446744073709551615 136008245 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1486.81
Current children cumulated vsize (KiB) 50044

[startup+882.302 s]
/proc/loadavg: 1.99 1.86 1.18 3/109 27216
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1597.45
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 423519 0 0 0 158981 764 0 0 25 0 2 0 142807849 42336256 4710 1992294400 134512640 146736320 4292581264 18446744073709551615 139044554 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4710 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=770.3
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 258615 0 0 0 76625 405 0 0 17 0 2 0 142808391 42336256 4710 1992294400 134512640 146736320 4292581264 18446744073709551615 136403114 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1597.45
Current children cumulated vsize (KiB) 50044

[startup+942.3 s]
/proc/loadavg: 1.96 1.86 1.22 3/109 27218
/proc/meminfo: memFree=1564420/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1707.65
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 456372 0 0 0 169952 813 0 0 25 0 2 0 142807849 42336256 4695 1992294400 134512640 146736320 4292581264 18446744073709551615 139044580 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/27190/statm: 10336 4695 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=823.44
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 290038 0 0 0 81907 437 0 0 18 0 2 0 142808391 42336256 4695 1992294400 134512640 146736320 4292581264 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1707.65
Current children cumulated vsize (KiB) 50044



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+992.802 s]
/proc/loadavg: 1.96 1.88 1.26 3/109 27220
/proc/meminfo: memFree=1564172/2059040 swapFree=4139620/4192956
[pid=27189] ppid=27187 vsize=8700 CPUtime=0
/proc/27189/stat : 27189 (run) S 27187 27189 27075 0 -1 4202496 364 0 0 0 0 0 0 0 19 0 1 0 142807848 8908800 249 1992294400 4194304 4922060 140735621529856 18446744073709551615 269658725509 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/27189/statm: 2175 249 208 178 0 68 0
[pid=27190] ppid=27189 vsize=41344 CPUtime=1800.17
/proc/27190/stat : 27190 (pb_cplex) R 27189 27189 27075 0 -1 4202496 478513 0 0 0 179161 856 0 0 16 0 2 0 142807849 42336256 4714 1992294400 134512640 146736320 4292581264 18446744073709551615 136008053 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/27190/statm: 10336 4714 1005 2985 0 6878 0
[pid=27190/tid=27194] ppid=27189 vsize=41344 CPUtime=870.66
/proc/27190/task/27194/stat : 27194 (pb_cplex) R 27189 27189 27075 0 -1 4202560 311733 0 0 0 86605 461 0 0 25 0 2 0 142808391 42336256 4714 1992294400 134512640 146736320 4292581264 18446744073709551615 135468509 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.17
Current children cumulated vsize (KiB) 50044

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 992.819
CPU time (s): 1800.19
CPU user time (s): 1791.63
CPU system time (s): 8.5657
CPU usage (%): 181.321
Max. virtual memory (cumulated for all children) (KiB): 61264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1791.63
system time used= 8.5657
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 478887
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 84698
involuntary context switches= 29903

runsolver used 1.86072 second user time and 5.34319 second system time

The end

Launcher Data 

Begin job on node042 at 2010-07-01 22:12:33
IDJOB=2696203
IDBENCH=1289
IDSOLVER=1209
FILE ID=node042/2696203-1278015153
PBS_JOBID= 11198722
Free space on /tmp= 62124 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900565534.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696203-1278015153/watcher-2696203-1278015153 -o /tmp/evaluation-result-2696203-1278015153/solver-2696203-1278015153 -C 1800 -W 2000 -M 1800  run HOME/instance-2696203-1278015153.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 0fea7c185f4d6e2091fba763db8ccbcc
RANDOM SEED=1978957757

node042.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.42
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.45
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1581340 kB
Buffers:        114628 kB
Cached:         264628 kB
SwapCached:       6148 kB
Active:         152164 kB
Inactive:       240092 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1581340 kB
SwapTotal:     4192956 kB
SwapFree:      4139620 kB
Dirty:           16844 kB
Writeback:           0 kB
AnonPages:       11572 kB
Mapped:          11856 kB
Slab:            63528 kB
PageTables:       4184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   183336 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62108 MiB
End job on node042 at 2010-07-01 22:29:06