Trace number 3693705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed? (TO) 1802.2 1802.48

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb
MD5SUM8f97c77928b15936b90881f480455177
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-6736
Best CPU time to get the best result obtained on this benchmark1801.43
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 892
Biggest coefficient in the objective function 842
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 750251
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 842
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 750251
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c SCIP version 2.1.1.4 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.6.0.3] [GitHash: a3bf3a4-dirty]
0.00/0.00	c Copyright (c) 2002-2012 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3693705-1338047444.opb>
1.99/2.09	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
1.99/2.09	c problem read in 2.10
4.69/4.71	c presolving:
8.48/8.53	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
9.59/9.63	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3693705-1338047444/watcher-3693705-1338047444 -o /tmp/evaluation-result-3693705-1338047444/solver-3693705-1338047444 -C 1800 -W 1900 -M 15500 HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3693705-1338047444.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10563
/proc/meminfo: memFree=26964492/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=11776 CPUtime=0 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 1681 0 0 0 0 0 0 0 20 0 1 0 270869867 12058624 1636 33554432000 4194304 10169799 140735773646608 140735038010152 7543003 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 2944 1636 412 1459 0 1476 0

[startup+0.0775419 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10563
/proc/meminfo: memFree=26964492/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=37044 CPUtime=0.07 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 8006 0 0 0 6 1 0 0 20 0 1 0 270869867 37933056 7961 33554432000 4194304 10169799 140735773646608 140735773511304 8982256 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 9470 7969 412 1459 0 8002 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 37044

[startup+0.10034 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10563
/proc/meminfo: memFree=26964492/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=43776 CPUtime=0.09 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 9683 0 0 0 8 1 0 0 20 0 1 0 270869867 44826624 9638 33554432000 4194304 10169799 140735773646608 140735773511304 7543003 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 10944 9638 412 1459 0 9476 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 43776

[startup+0.300178 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10563
/proc/meminfo: memFree=26964492/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=85120 CPUtime=0.28 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 20010 0 0 0 26 2 0 0 20 0 1 0 270869867 87162880 19965 33554432000 4194304 10169799 140735773646608 140735773511304 8886066 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 21280 19965 412 1459 0 19812 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 85120

[startup+0.700176 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10563
/proc/meminfo: memFree=26964492/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=190280 CPUtime=0.69 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 46246 0 0 0 63 6 0 0 20 0 1 0 270869867 194846720 46201 33554432000 4194304 10169799 140735773646608 140735773511304 5471578 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 47570 46201 412 1459 0 46102 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 190280

[startup+1.50018 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10564
/proc/meminfo: memFree=26704664/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=385920 CPUtime=1.49 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 95054 0 0 0 136 13 0 0 20 0 1 0 270869867 395182080 95009 33554432000 4194304 10169799 140735773646608 140735773512936 8886066 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 96480 95009 412 1459 0 95012 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 385920

[startup+3.10028 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10564
/proc/meminfo: memFree=26530560/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=935660 CPUtime=3.09 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 231456 0 0 0 279 30 0 0 20 0 1 0 270869867 958115840 232381 33554432000 4194304 10169799 140735773646608 140735773645208 5757893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 233915 232381 489 1459 0 232447 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 935660

[startup+6.30026 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10564
/proc/meminfo: memFree=25729848/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=1330708 CPUtime=6.29 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 353076 0 0 0 567 62 0 0 20 0 1 0 270869867 1362644992 329913 33554432000 4194304 10169799 140735773646608 140735773644488 8961143 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 332677 329913 554 1459 0 331209 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1330708

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10564
/proc/meminfo: memFree=25073916/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=1903132 CPUtime=12.69 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 507577 0 0 0 1150 119 0 0 20 0 1 0 270869867 1948807168 471300 33554432000 4194304 10169799 140735773646608 140735773643256 8922280 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 475783 471300 608 1459 0 474315 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1903132

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10564
/proc/meminfo: memFree=25065756/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=1910748 CPUtime=25.48 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 509352 0 0 0 2429 119 0 0 20 0 1 0 270869867 1956605952 473075 33554432000 4194304 10169799 140735773646608 140735773643160 8922310 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 477687 473075 608 1459 0 476219 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1910748

[startup+51.1002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10564
/proc/meminfo: memFree=25061616/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=1914396 CPUtime=51.09 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 510342 0 0 0 4989 120 0 0 20 0 1 0 270869867 1960341504 474065 33554432000 4194304 10169799 140735773646608 140735773644136 8922280 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 478599 474065 608 1459 0 477131 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1914396

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10565
/proc/meminfo: memFree=22939756/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=2712716 CPUtime=102.28 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 705324 0 0 0 10083 145 0 0 20 0 1 0 270869867 2777821184 668024 33554432000 4194304 10169799 140735773646608 140735773642872 7432582 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 678179 668024 608 1459 0 676711 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2712716

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10565
/proc/meminfo: memFree=22343084/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3308080 CPUtime=162.26 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 831945 0 0 0 16063 163 0 0 20 0 1 0 270869867 3387473920 813519 33554432000 4194304 10169799 140735773646608 140735773642872 8922305 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 827020 813519 608 1459 0 825552 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 3308080

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10565
/proc/meminfo: memFree=22339652/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3309104 CPUtime=222.25 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 832413 0 0 0 22062 163 0 0 20 0 1 0 270869867 3388522496 813987 33554432000 4194304 10169799 140735773646608 140735773642872 8922310 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 827276 813987 608 1459 0 825808 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 3309104

[startup+282.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 10565
/proc/meminfo: memFree=22331248/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3313008 CPUtime=282.25 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 833631 0 0 0 28061 164 0 0 20 0 1 0 270869867 3392520192 815205 33554432000 4194304 10169799 140735773646608 140735773642872 8922310 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 828252 815205 608 1459 0 826784 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 3313008

[startup+342.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 10565
/proc/meminfo: memFree=22328552/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3313008 CPUtime=342.24 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 833849 0 0 0 34060 164 0 0 20 0 1 0 270869867 3392520192 815423 33554432000 4194304 10169799 140735773646608 140735773642872 8922300 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 828252 815423 608 1459 0 826784 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 3313008

[startup+402.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 10566
/proc/meminfo: memFree=22321884/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3313900 CPUtime=402.23 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 834317 0 0 0 40058 165 0 0 20 0 1 0 270869867 3393433600 815858 33554432000 4194304 10169799 140735773646608 140735773643400 8922300 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 828475 815858 608 1459 0 827007 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 3313900

[startup+462.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 10566
/proc/meminfo: memFree=22307900/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3315756 CPUtime=462.22 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 835005 0 0 0 46057 165 0 0 20 0 1 0 270869867 3395334144 816546 33554432000 4194304 10169799 140735773646608 140735773642872 8922351 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 828939 816546 608 1459 0 827471 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 3315756

[startup+522.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/177 10566
/proc/meminfo: memFree=22305200/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3315756 CPUtime=522.21 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 835225 0 0 0 52056 165 0 0 20 0 1 0 270869867 3395334144 816766 33554432000 4194304 10169799 140735773646608 140735773642872 8922280 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 828939 816766 608 1459 0 827471 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 3315756

[startup+582.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/178 10569
/proc/meminfo: memFree=22298156/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3316780 CPUtime=582.2 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 835712 0 0 0 58055 165 0 0 20 0 1 0 270869867 3396382720 817253 33554432000 4194304 10169799 140735773646608 140735773642872 8922290 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 829195 817253 608 1459 0 827727 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3316780

[startup+642.3 s]

################
# More data... #
################

/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 839233 0 0 0 100048 166 0 0 20 0 1 0 270869867 3404828672 820708 33554432000 4194304 10169799 140735773646608 140735773642872 8922290 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 831257 820708 608 1459 0 829789 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 3325028

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10594
/proc/meminfo: memFree=22255196/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3326052 CPUtime=1062.13 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 839641 0 0 0 106047 166 0 0 20 0 1 0 270869867 3405877248 821116 33554432000 4194304 10169799 140735773646608 140735773642872 8922280 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 831513 821116 608 1459 0 830045 0
Current children cumulated CPU time (s) 1062.13
Current children cumulated vsize (KiB) 3326052

[startup+1122.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 10594
/proc/meminfo: memFree=22252436/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3327908 CPUtime=1122.12 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 840295 0 0 0 112046 166 0 0 20 0 1 0 270869867 3407777792 821770 33554432000 4194304 10169799 140735773646608 140735773642872 8922295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 831977 821770 608 1459 0 830509 0
Current children cumulated CPU time (s) 1122.12
Current children cumulated vsize (KiB) 3327908

[startup+1182.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 10597
/proc/meminfo: memFree=22249860/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3327908 CPUtime=1182.11 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 840415 0 0 0 118045 166 0 0 20 0 1 0 270869867 3407777792 821890 33554432000 4194304 10169799 140735773646608 140735773642872 8922365 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 831977 821890 608 1459 0 830509 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 3327908

[startup+1242.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 10597
/proc/meminfo: memFree=22244856/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3329956 CPUtime=1242.1 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 841073 0 0 0 124044 166 0 0 20 0 1 0 270869867 3409874944 822548 33554432000 4194304 10169799 140735773646608 140735773642872 8922295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 832489 822548 608 1459 0 831021 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 3329956

[startup+1302.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 10598
/proc/meminfo: memFree=22239436/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3330976 CPUtime=1302.1 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 841518 0 0 0 130043 167 0 0 20 0 1 0 270869867 3410919424 822993 33554432000 4194304 10169799 140735773646608 140735773642872 8922290 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 832744 822993 608 1459 0 831276 0
Current children cumulated CPU time (s) 1302.1
Current children cumulated vsize (KiB) 3330976

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 10598
/proc/meminfo: memFree=22236908/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3330976 CPUtime=1362.09 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 841639 0 0 0 136042 167 0 0 20 0 1 0 270869867 3410919424 823114 33554432000 4194304 10169799 140735773646608 140735773642872 8922295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 832744 823114 608 1459 0 831276 0
Current children cumulated CPU time (s) 1362.09
Current children cumulated vsize (KiB) 3330976

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10598
/proc/meminfo: memFree=22233464/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3332832 CPUtime=1422.08 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 842248 0 0 0 142041 167 0 0 20 0 1 0 270869867 3412819968 823723 33554432000 4194304 10169799 140735773646608 140735773642872 8922290 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 833208 823723 608 1459 0 831740 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 3332832

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10598
/proc/meminfo: memFree=22231896/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3332700 CPUtime=1482.06 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 842438 0 0 0 148039 167 0 0 20 0 1 0 270869867 3412684800 823880 33554432000 4194304 10169799 140735773646608 140735773643192 8922290 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 833175 823880 608 1459 0 831707 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 3332700

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10598
/proc/meminfo: memFree=22229740/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3333724 CPUtime=1542.05 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 842817 0 0 0 154038 167 0 0 20 0 1 0 270869867 3413733376 824259 33554432000 4194304 10169799 140735773646608 140735773642872 8922305 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 833431 824259 608 1459 0 831963 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 3333724

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10599
/proc/meminfo: memFree=22227552/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3334748 CPUtime=1602.04 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 843216 0 0 0 160037 167 0 0 20 0 1 0 270869867 3414781952 824658 33554432000 4194304 10169799 140735773646608 140735773642872 8922305 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 833687 824658 608 1459 0 832219 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 3334748

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10599
/proc/meminfo: memFree=22222976/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3335772 CPUtime=1662.04 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 843671 0 0 0 166037 167 0 0 20 0 1 0 270869867 3415830528 825113 33554432000 4194304 10169799 140735773646608 140735773642872 8922305 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 833943 825113 608 1459 0 832475 0
Current children cumulated CPU time (s) 1662.04
Current children cumulated vsize (KiB) 3335772

[startup+1722.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 10599
/proc/meminfo: memFree=22221904/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3336604 CPUtime=1722.02 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 844005 0 0 0 172035 167 0 0 20 0 1 0 270869867 3416682496 825447 33554432000 4194304 10169799 140735773646608 140735773642872 8922285 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 834151 825447 608 1459 0 832683 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 3336604

[startup+1782.3 s]
/proc/loadavg: 1.94 1.99 1.99 2/172 10627
/proc/meminfo: memFree=25596740/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3338652 CPUtime=1782.01 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 844673 0 0 0 178034 167 0 0 20 0 1 0 270869867 3418779648 826177 33554432000 4194304 10169799 140735773646608 140735773642872 8922305 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 834663 826177 608 1459 0 833195 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 3338652



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 1.74 1.94 1.98 2/172 10627
/proc/meminfo: memFree=25596520/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3338652 CPUtime=1800.02 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 844756 0 0 0 179835 167 0 0 20 0 1 0 270869867 3418779648 826260 33554432000 4194304 10169799 140735773646608 140735773642872 8922280 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 834663 826260 608 1459 0 833195 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 3338652

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -10563

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 1.74 1.94 1.98 2/173 10628
/proc/meminfo: memFree=25596520/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3338652 CPUtime=1801.11 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 844758 0 0 0 179944 167 0 0 20 0 1 0 270869867 3418779648 826262 33554432000 4194304 10169799 140735773646608 140735773642304 8922295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 834663 826262 608 1459 0 833195 0
Current children cumulated CPU time (s) 1801.11
Current children cumulated vsize (KiB) 3338652

[startup+1802.2 s]
/proc/loadavg: 1.74 1.94 1.98 2/173 10628
/proc/meminfo: memFree=25596388/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=3338652 CPUtime=1801.91 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4202496 844761 0 0 0 180024 167 0 0 20 0 1 0 270869867 3418779648 826265 33554432000 4194304 10169799 140735773646608 140735773642304 8922310 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 834663 826265 608 1459 0 833195 0
Current children cumulated CPU time (s) 1801.91
Current children cumulated vsize (KiB) 3338652

[startup+1802.4 s]
/proc/loadavg: 1.74 1.94 1.98 2/173 10628
/proc/meminfo: memFree=25596388/32873648 swapFree=6856/6856
[pid=10563] ppid=10561 vsize=0 CPUtime=1802.12 cores=1,3,5,7
/proc/10563/stat : 10563 (scip-2.1.1.4sfi) R 10561 10563 7220 0 -1 4203524 844761 0 0 0 180035 177 0 0 20 0 1 0 270869867 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/10563/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.48
CPU time (s): 1802.2
CPU user time (s): 1800.35
CPU system time (s): 1.84872
CPU usage (%): 99.9847
Max. virtual memory (cumulated for all children) (KiB): 3338652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.35
system time used= 1.84872
maximum resident set size= 3305060
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 844761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1857

runsolver used 2.99055 second user time and 9.14361 second system time

The end

Launcher Data

Begin job on node125 at 2012-05-26 17:50:44
IDJOB=3693705
IDBENCH=91040
IDSOLVER=2272
FILE ID=node125/3693705-1338047444
RUNJOBID= node125-1338029661-8140
PBS_JOBID= 14624346
Free space on /tmp= 71224 MiB

SOLVER NAME= SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_fibo_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb
COMMAND LINE= HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3693705-1338047444/watcher-3693705-1338047444 -o /tmp/evaluation-result-3693705-1338047444/solver-3693705-1338047444 -C 1800 -W 1900 -M 15500  HOME/scip-2.1.1.4sfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3693705-1338047444.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8f97c77928b15936b90881f480455177
RANDOM SEED=930436437

node125.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26964384 kB
Buffers:          253464 kB
Cached:          2962572 kB
SwapCached:            0 kB
Active:          3067220 kB
Inactive:        2057492 kB
Active(anon):    1911216 kB
Inactive(anon):        0 kB
Active(file):    1156004 kB
Inactive(file):  2057492 kB
Unevictable:        6856 kB
Mlocked:            6856 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             82616 kB
Writeback:             0 kB
AnonPages:       1859900 kB
Mapped:            16636 kB
Shmem:               200 kB
Slab:             643916 kB
SReclaimable:      87976 kB
SUnreclaim:       555940 kB
KernelStack:        1480 kB
PageTables:         8044 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    2032084 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     86016 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71252 MiB
End job on node125 at 2012-05-26 18:20:47