Trace number 2697151

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.15 979.82

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_200_10_2.opb
MD5SUM5255c8da63867fe6fe080ca048384827
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-49
Best CPU time to get the best result obtained on this benchmark1800.04
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -48
Optimality of the best value was proved NO
Number of variables200
Total number of constraints200
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints200
Minimum length of a constraint10
Maximum length of a constraint19
Number of terms in the objective function 200
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 200
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)2492
Sum of products size (including duplicates)4984
Number of different products1246
Sum of products size2492

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2697151-1278050367.opb.
0.00/0.00	c Instance file HOME/instance-2697151-1278050367.opb
0.00/0.00	c File size is 102705 bytes.
0.00/0.05	c Highest Coefficient sum: 19
0.00/0.05	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.06	c ============================[ Problem Statistics ]=============================
0.00/0.06	c |                                                                             |
0.00/0.06	c |  Parsing time:          0.05         s                                      |
0.00/0.06	c |  Number Variables:      1446                                                |
0.00/0.06	c |  Number Constraints:    2692                                                |
0.00/0.06	c ===============================================================================
1800.15/979.81	c Remaining time 1799.95 sec.
1800.15/979.81	c 
1800.15/979.81	c *** INTERRUPTED ***
1800.15/979.81	s UNKNOWN
1800.15/979.81	c Total CPU time              : 1781.57 s
1800.15/979.81	c Memory used           : 119.39 MB
1800.15/979.81	c CPU time              : 1781.57 s
1800.15/979.81	c 
1800.15/979.81	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697151-1278050367/watcher-2697151-1278050367 -o /tmp/evaluation-result-2697151-1278050367/solver-2697151-1278050367 -C 1800 -W 2000 -M 1800 run HOME/instance-2697151-1278050367.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.58 1.71 1.70 3/106 1392
/proc/meminfo: memFree=1336360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) R 1390 1392 1095 0 -1 4202496 349 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972515733 0 65538 4100 65536 0 0 0 17 1 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0

[startup+0.0391869 s]
/proc/loadavg: 1.58 1.71 1.70 3/106 1392
/proc/meminfo: memFree=1336360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101207 s]
/proc/loadavg: 1.58 1.71 1.70 3/106 1392
/proc/meminfo: memFree=1336360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301244 s]
/proc/loadavg: 1.58 1.71 1.70 3/106 1392
/proc/meminfo: memFree=1336360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.70131 s]
/proc/loadavg: 1.58 1.71 1.70 3/106 1392
/proc/meminfo: memFree=1336360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50146 s]
/proc/loadavg: 1.58 1.71 1.70 2/108 1394
/proc/meminfo: memFree=1331500/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=33060 CPUtime=1.55
/proc/1393/stat : 1393 (pb_cplex) S 1392 1392 1095 0 -1 4202496 3629 0 0 0 154 1 0 0 18 0 2 0 146329008 33853440 2685 1992294400 134512640 146736320 4289651136 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 8265 2685 1037 2985 0 4807 0
Current children cumulated CPU time (s) 1.55
Current children cumulated vsize (KiB) 41760

[startup+3.10075 s]
/proc/loadavg: 1.58 1.71 1.70 4/109 1395
/proc/meminfo: memFree=1329508/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=33060 CPUtime=4.2
/proc/1393/stat : 1393 (pb_cplex) S 1392 1392 1095 0 -1 4202496 3656 0 0 0 416 4 0 0 16 0 2 0 146329008 33853440 2706 1992294400 134512640 146736320 4289651136 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 8265 2706 1031 2985 0 4807 0
[pid=1393/tid=1395] ppid=1392 vsize=33060 CPUtime=1.64
/proc/1393/task/1395/stat : 1395 (pb_cplex) R 1392 1392 1095 0 -1 4202560 217 0 0 0 162 2 0 0 16 0 2 0 146329116 33853440 2706 1992294400 134512640 146736320 4289651136 18446744073709551615 136008170 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.2
Current children cumulated vsize (KiB) 41760

[startup+6.30132 s]
/proc/loadavg: 1.69 1.74 1.70 2/108 1397
/proc/meminfo: memFree=1328656/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=34824 CPUtime=8.86
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 4605 0 0 0 879 7 0 0 18 0 2 0 146329008 35659776 3122 1992294400 134512640 146736320 4289651136 18446744073709551615 136008065 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 8706 3122 1056 2985 0 5248 0
Current children cumulated CPU time (s) 8.86
Current children cumulated vsize (KiB) 43524

[startup+12.7005 s]
/proc/loadavg: 1.64 1.72 1.70 3/109 1399
/proc/meminfo: memFree=1324928/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=37052 CPUtime=18.54
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 6648 0 0 0 1841 13 0 0 16 0 2 0 146329008 37941248 3760 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 9263 3760 1057 2985 0 5805 0
[pid=1393/tid=1399] ppid=1392 vsize=37052 CPUtime=3.96
/proc/1393/task/1399/stat : 1399 (pb_cplex) R 1392 1392 1095 0 -1 4202560 167 0 0 0 394 2 0 0 17 0 2 0 146329645 37941248 3760 1992294400 134512640 146736320 4289651136 18446744073709551615 136001884 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.54
Current children cumulated vsize (KiB) 45752

[startup+25.5018 s]
/proc/loadavg: 1.72 1.74 1.70 3/109 1399
/proc/meminfo: memFree=1324184/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=38368 CPUtime=41.65
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 7919 0 0 0 4134 31 0 0 16 0 2 0 146329008 39288832 3953 1992294400 134512640 146736320 4289651136 18446744073709551615 136388075 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 9592 3953 1057 2985 0 6134 0
[pid=1393/tid=1399] ppid=1392 vsize=38368 CPUtime=15.32
/proc/1393/task/1399/stat : 1399 (pb_cplex) R 1392 1392 1095 0 -1 4202560 1342 0 0 0 1521 11 0 0 17 0 2 0 146329645 39288832 3953 1992294400 134512640 146736320 4289651136 18446744073709551615 135526870 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 41.65
Current children cumulated vsize (KiB) 47068

[startup+51.1015 s]
/proc/loadavg: 1.79 1.76 1.71 4/109 1399
/proc/meminfo: memFree=1319224/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=44468 CPUtime=89.41
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 12211 0 0 0 8867 74 0 0 19 0 2 0 146329008 45535232 5261 1992294400 134512640 146736320 4289651136 18446744073709551615 136933014 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/1393/statm: 11117 5261 1057 2985 0 7659 0
[pid=1393/tid=1399] ppid=1392 vsize=44468 CPUtime=38.97
/proc/1393/task/1399/stat : 1399 (pb_cplex) R 1392 1392 1095 0 -1 4202560 4643 0 0 0 3864 33 0 0 19 0 2 0 146329645 45535232 5261 1992294400 134512640 146736320 4289651136 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 89.41
Current children cumulated vsize (KiB) 53168

[startup+102.31 s]
/proc/loadavg: 1.88 1.79 1.72 2/109 1411
/proc/meminfo: memFree=1319332/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=42456 CPUtime=184.89
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 29072 0 0 0 18345 144 0 0 17 0 2 0 146329008 43474944 5133 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 10614 5133 1081 2985 0 7156 0
[pid=1393/tid=1400] ppid=1392 vsize=42456 CPUtime=29.05
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 927 0 0 0 2878 27 0 0 17 0 2 0 146336005 43474944 5133 1992294400 134512640 146736320 4289651136 18446744073709551615 135459400 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 184.89
Current children cumulated vsize (KiB) 51156

[startup+162.302 s]
/proc/loadavg: 1.91 1.81 1.73 3/109 1413
/proc/meminfo: memFree=1314016/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=48612 CPUtime=294.92
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 32562 0 0 0 29237 255 0 0 18 0 2 0 146329008 49778688 6520 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 12153 6520 1081 2985 0 8695 0
[pid=1393/tid=1400] ppid=1392 vsize=48612 CPUtime=83.67
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 3348 0 0 0 8284 83 0 0 18 0 2 0 146336005 49778688 6520 1992294400 134512640 146736320 4289651136 18446744073709551615 135467806 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 294.92
Current children cumulated vsize (KiB) 57312

[startup+222.302 s]
/proc/loadavg: 1.92 1.83 1.74 3/109 1413
/proc/meminfo: memFree=1307692/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=54068 CPUtime=404.87
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 35777 0 0 0 40120 367 0 0 17 0 2 0 146329008 55365632 8060 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 13517 8060 1081 2985 0 10059 0
[pid=1393/tid=1400] ppid=1392 vsize=54068 CPUtime=138.14
/proc/1393/task/1400/stat : 1400 (pb_cplex) S 1392 1392 1095 0 -1 4202560 5712 0 0 0 13673 141 0 0 17 0 2 0 146336005 55365632 8060 1992294400 134512640 146736320 4289651136 18446744073709551615 144580073 0 2 4096 16387 18446604437846353792 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 404.87
Current children cumulated vsize (KiB) 62768

[startup+282.301 s]
/proc/loadavg: 1.93 1.84 1.75 3/109 1415
/proc/meminfo: memFree=1301368/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=60904 CPUtime=514.9
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 38651 0 0 0 51016 474 0 0 18 0 2 0 146329008 62365696 9664 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 15226 9664 1081 2985 0 11768 0
[pid=1393/tid=1400] ppid=1392 vsize=60904 CPUtime=192.65
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 7672 0 0 0 19071 194 0 0 17 0 2 0 146336005 62365696 9664 1992294400 134512640 146736320 4289651136 18446744073709551615 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 514.9
Current children cumulated vsize (KiB) 69604

[startup+342.3 s]
/proc/loadavg: 1.97 1.87 1.76 3/109 1417
/proc/meminfo: memFree=1297400/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=64672 CPUtime=624.47
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 40919 0 0 0 61853 594 0 0 18 0 2 0 146329008 66224128 10481 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 16168 10481 1081 2985 0 12710 0

################
# More data... #
################

[pid=1393] ppid=1392 vsize=69284 CPUtime=734.48
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 43130 0 0 0 72737 711 0 0 18 0 2 0 146329008 70946816 11757 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 17321 11757 1081 2985 0 13863 0
[pid=1393/tid=1400] ppid=1392 vsize=69284 CPUtime=301.27
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 10884 0 0 0 29814 313 0 0 17 0 2 0 146336005 70946816 11757 1992294400 134512640 146736320 4289651136 18446744073709551615 138424117 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 734.48
Current children cumulated vsize (KiB) 77984

[startup+462.301 s]
/proc/loadavg: 1.75 1.82 1.75 3/109 1421
/proc/meminfo: memFree=1287728/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=74920 CPUtime=844.47
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 45833 0 0 0 83621 826 0 0 18 0 2 0 146329008 76718080 13091 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 18730 13091 1081 2985 0 15272 0
[pid=1393/tid=1400] ppid=1392 vsize=74920 CPUtime=356.05
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 12858 0 0 0 35231 374 0 0 17 0 2 0 146336005 76718080 13091 1992294400 134512640 146736320 4289651136 18446744073709551615 136403132 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 844.47
Current children cumulated vsize (KiB) 83620

[startup+522.301 s]
/proc/loadavg: 1.82 1.83 1.76 3/109 1421
/proc/meminfo: memFree=1282024/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=80084 CPUtime=954.49
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 48390 0 0 0 94509 940 0 0 18 0 2 0 146329008 82006016 14476 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 20021 14476 1081 2985 0 16563 0
[pid=1393/tid=1400] ppid=1392 vsize=80084 CPUtime=411.06
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 14335 0 0 0 40675 431 0 0 17 0 2 0 146336005 82006016 14476 1992294400 134512640 146736320 4289651136 18446744073709551615 136008180 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 954.49
Current children cumulated vsize (KiB) 88784

[startup+582.301 s]
/proc/loadavg: 1.79 1.82 1.75 2/109 1423
/proc/meminfo: memFree=1277064/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=86224 CPUtime=1065.01
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 50446 0 0 0 105443 1058 0 0 17 0 2 0 146329008 88293376 15795 1992294400 134512640 146736320 4289651136 18446744073709551615 136384887 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/1393/statm: 21556 15795 1081 2985 0 18098 0
[pid=1393/tid=1400] ppid=1392 vsize=86224 CPUtime=465.77
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 15002 0 0 0 46085 492 0 0 18 0 2 0 146336005 88293376 15795 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1065.01
Current children cumulated vsize (KiB) 94924

[startup+642.301 s]
/proc/loadavg: 1.92 1.85 1.76 3/109 1425
/proc/meminfo: memFree=1271360/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=90824 CPUtime=1175.18
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 52605 0 0 0 116342 1176 0 0 17 0 2 0 146329008 93003776 17120 1992294400 134512640 146736320 4289651136 18446744073709551615 139044547 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/1393/statm: 22706 17120 1081 2985 0 19248 0
[pid=1393/tid=1400] ppid=1392 vsize=90824 CPUtime=521.2
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 16315 0 0 0 51567 553 0 0 18 0 2 0 146336005 93003776 17120 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1175.18
Current children cumulated vsize (KiB) 99524

[startup+702.302 s]
/proc/loadavg: 1.90 1.86 1.77 3/109 1427
/proc/meminfo: memFree=1265780/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=97160 CPUtime=1286.07
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 54893 0 0 0 127311 1296 0 0 17 0 2 0 146329008 99491840 18516 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 24290 18516 1081 2985 0 20832 0
[pid=1393/tid=1400] ppid=1392 vsize=97160 CPUtime=575.95
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 17058 0 0 0 56985 610 0 0 17 0 2 0 146336005 99491840 18516 1992294400 134512640 146736320 4289651136 18446744073709551615 136001985 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1286.07
Current children cumulated vsize (KiB) 105860

[startup+762.31 s]
/proc/loadavg: 1.90 1.86 1.78 3/109 1429
/proc/meminfo: memFree=1260696/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=101452 CPUtime=1396.77
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 56852 0 0 0 138257 1420 0 0 17 0 2 0 146329008 103886848 19810 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 25363 19810 1081 2985 0 21905 0
[pid=1393/tid=1400] ppid=1392 vsize=101452 CPUtime=630.81
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 17652 0 0 0 62406 675 0 0 18 0 2 0 146336005 103886848 19810 1992294400 134512640 146736320 4289651136 18446744073709551615 135467865 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1396.77
Current children cumulated vsize (KiB) 110152

[startup+822.301 s]
/proc/loadavg: 1.90 1.87 1.78 3/109 1429
/proc/meminfo: memFree=1254868/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=108496 CPUtime=1507.96
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 58947 0 0 0 149258 1538 0 0 17 0 2 0 146329008 111099904 21317 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 27124 21317 1081 2985 0 23666 0
[pid=1393/tid=1400] ppid=1392 vsize=108496 CPUtime=685.91
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 18371 0 0 0 67856 735 0 0 18 0 2 0 146336005 111099904 21317 1992294400 134512640 146736320 4289651136 18446744073709551615 136001705 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1507.96
Current children cumulated vsize (KiB) 117196

[startup+882.301 s]
/proc/loadavg: 2.04 1.91 1.80 3/109 1431
/proc/meminfo: memFree=1249784/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=112540 CPUtime=1619.22
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 60653 0 0 0 160254 1668 0 0 17 0 2 0 146329008 115240960 22547 1992294400 134512640 146736320 4289651136 18446744073709551615 139046801 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/1393/statm: 28135 22547 1081 2985 0 24677 0
[pid=1393/tid=1400] ppid=1392 vsize=112540 CPUtime=741.08
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 19219 0 0 0 73310 798 0 0 18 0 2 0 146336005 115240960 22547 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1619.22
Current children cumulated vsize (KiB) 121240

[startup+942.301 s]
/proc/loadavg: 1.98 1.92 1.81 3/109 1433
/proc/meminfo: memFree=1244328/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=118376 CPUtime=1730.49
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 62601 0 0 0 171264 1785 0 0 18 0 2 0 146329008 121217024 23930 1992294400 134512640 146736320 4289651136 18446744073709551615 136388115 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/1393/statm: 29594 23930 1081 2985 0 26136 0
[pid=1393/tid=1400] ppid=1392 vsize=118376 CPUtime=795.99
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 20403 0 0 0 78741 858 0 0 18 0 2 0 146336005 121217024 23930 1992294400 134512640 146736320 4289651136 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1730.49
Current children cumulated vsize (KiB) 127076



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+979.801 s]
/proc/loadavg: 2.06 1.95 1.82 3/109 1435
/proc/meminfo: memFree=1240608/2059040 swapFree=4139744/4192956
[pid=1392] ppid=1390 vsize=8700 CPUtime=0
/proc/1392/stat : 1392 (run) S 1390 1392 1095 0 -1 4202496 366 0 0 0 0 0 0 0 17 0 1 0 146329008 8908800 249 1992294400 4194304 4922060 140736470791680 18446744073709551615 236972514437 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/1392/statm: 2175 249 208 178 0 68 0
[pid=1393] ppid=1392 vsize=122248 CPUtime=1800.15
/proc/1393/stat : 1393 (pb_cplex) R 1392 1392 1095 0 -1 4202496 63927 0 0 0 178154 1861 0 0 18 0 2 0 146329008 125181952 24844 1992294400 134512640 146736320 4289651136 18446744073709551615 135446792 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/1393/statm: 30562 24844 1081 2985 0 27104 0
[pid=1393/tid=1400] ppid=1392 vsize=122248 CPUtime=830.7
/proc/1393/task/1400/stat : 1400 (pb_cplex) R 1392 1392 1095 0 -1 4202560 21209 0 0 0 82175 895 0 0 17 0 2 0 146336005 125181952 24844 1992294400 134512640 146736320 4289651136 18446744073709551615 135999691 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 130948

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1392 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 1800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 979.82
CPU time (s): 1800.15
CPU user time (s): 1781.54
CPU system time (s): 18.61
CPU usage (%): 183.722
Max. virtual memory (cumulated for all children) (KiB): 130948

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 366
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 2

runsolver used 1.65175 second user time and 4.65929 second system time

The end

Launcher Data 

Begin job on node044 at 2010-07-02 07:59:27
IDJOB=2697151
IDBENCH=48185
IDSOLVER=1209
FILE ID=node044/2697151-1278050367
PBS_JOBID= 11198848
Free space on /tmp= 62232 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_200_10_2.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697151-1278050367/watcher-2697151-1278050367 -o /tmp/evaluation-result-2697151-1278050367/solver-2697151-1278050367 -C 1800 -W 2000 -M 1800  run HOME/instance-2697151-1278050367.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 5255c8da63867fe6fe080ca048384827
RANDOM SEED=1458427621

node044.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.266
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.53
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.266
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.46
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1337384 kB
Buffers:        186004 kB
Cached:         436264 kB
SwapCached:       7056 kB
Active:         361840 kB
Inactive:       274516 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1337384 kB
SwapTotal:     4192956 kB
SwapFree:      4139744 kB
Dirty:           16636 kB
Writeback:           0 kB
AnonPages:       12332 kB
Mapped:          12068 kB
Slab:            63308 kB
PageTables:       4156 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   181524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-2697151-1278050367.opb

Free space on /tmp at the end= 62216 MiB
End job on node044 at 2010-07-02 08:15:47