Trace number 3692549

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed? (TO) 1802.17 1802.47

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null50mast_rapportOE1.0_TMAX15_K192_cod2.opb
MD5SUMbddfe521cf91a77d0e4de5a51a3aa343
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-1051
Best CPU time to get the best result obtained on this benchmark1800.29
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1427
Biggest coefficient in the objective function 1024
Number of bits for the biggest coefficient in the objective function 11
Sum of the numbers in the objective function 914879
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 1024
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 914879
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 2.1.1.4 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.6.0.3] [GitHash: 947bdb7-dirty]
0.00/0.00	c Copyright (c) 2002-2012 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3692549-1338047251.opb>
2.10/2.15	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
2.10/2.15	c problem read in 2.15
3.98/4.09	c presolving:
7.70/7.79	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
8.79/8.89	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3692549-1338047251/watcher-3692549-1338047251 -o /tmp/evaluation-result-3692549-1338047251/solver-3692549-1338047251 -C 1800 -W 1900 -M 15500 HOME/scip-2.1.1.4expfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3692549-1338047251.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.02 2.01 2/176 3633
/proc/meminfo: memFree=26206424/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=12024 CPUtime=0 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 1835 0 0 0 0 0 0 0 20 0 1 0 270851214 12312576 1789 33554432000 4194304 10219143 140735821545888 140735821544760 8891101 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 3006 1801 398 1471 0 1526 0

[startup+0.0545399 s]
/proc/loadavg: 2.08 2.02 2.01 2/176 3633
/proc/meminfo: memFree=26206424/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=34580 CPUtime=0.04 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 7378 0 0 0 4 0 0 0 20 0 1 0 270851214 35409920 7332 33554432000 4194304 10219143 140735821545888 140735821544760 4195320 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 8645 7332 421 1471 0 7165 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34580

[startup+0.100278 s]
/proc/loadavg: 2.08 2.02 2.01 2/176 3633
/proc/meminfo: memFree=26206424/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=48608 CPUtime=0.09 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 10896 0 0 0 8 1 0 0 20 0 1 0 270851214 49774592 10850 33554432000 4194304 10219143 140735821545888 140735821544760 7593578 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 12152 10850 421 1471 0 10672 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 48608

[startup+0.300227 s]
/proc/loadavg: 2.08 2.02 2.01 2/176 3633
/proc/meminfo: memFree=26206424/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=93160 CPUtime=0.28 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 22042 0 0 0 26 2 0 0 20 0 1 0 270851214 95395840 21996 33554432000 4194304 10219143 140735821545888 140735821411064 4195176 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 23290 21996 421 1471 0 21810 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 93160

[startup+0.70023 s]
/proc/loadavg: 2.08 2.02 2.01 2/176 3633
/proc/meminfo: memFree=26206424/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=211832 CPUtime=0.69 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 51616 0 0 0 63 6 0 0 20 0 1 0 270851214 216915968 51570 33554432000 4194304 10219143 140735821545888 140735821411064 8772075 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 52958 51570 421 1471 0 51478 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 211832

[startup+1.50023 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 3634
/proc/meminfo: memFree=25915620/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=432252 CPUtime=1.49 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 106645 0 0 0 135 14 0 0 20 0 1 0 270851214 442626048 106599 33554432000 4194304 10219143 140735821545888 140735821410808 7123353 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 108063 106599 421 1471 0 106583 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 432252

[startup+3.10023 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 3634
/proc/meminfo: memFree=25715468/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=1081684 CPUtime=3.08 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 268560 0 0 0 273 35 0 0 20 0 1 0 270851214 1107644416 268913 33554432000 4194304 10219143 140735821545888 140735821542088 4423238 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/3633/statm: 270466 268937 483 1471 0 268986 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 1081684

[startup+6.30024 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 3634
/proc/meminfo: memFree=24888996/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=1631076 CPUtime=6.29 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 403165 0 0 0 554 75 0 0 20 0 1 0 270851214 1670221824 404791 33554432000 4194304 10219143 140735821545888 140735821542888 9008087 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 407769 404791 560 1471 0 406289 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1631076

[startup+12.7002 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 3634
/proc/meminfo: memFree=24319576/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=1903988 CPUtime=12.69 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 492557 0 0 0 1148 121 0 0 20 0 1 0 270851214 1949683712 471616 33554432000 4194304 10219143 140735821545888 140735821541384 8969184 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 475997 471616 612 1471 0 474517 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1903988

[startup+25.5003 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 3634
/proc/meminfo: memFree=24312560/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=1911412 CPUtime=25.48 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 493774 0 0 0 2427 121 0 0 20 0 1 0 270851214 1957285888 473344 33554432000 4194304 10219143 140735821545888 140735821541288 8969224 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 477853 473344 612 1471 0 476373 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1911412

[startup+51.1003 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 3634
/proc/meminfo: memFree=24309024/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=1915060 CPUtime=51.08 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 494758 0 0 0 4987 121 0 0 20 0 1 0 270851214 1961021440 474328 33554432000 4194304 10219143 140735821545888 140735821542264 8969244 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 478765 474328 612 1471 0 477285 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1915060

[startup+102.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 3634
/proc/meminfo: memFree=22912064/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3346596 CPUtime=102.27 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 822560 0 0 0 10063 164 0 0 20 0 1 0 270851214 3426914304 822689 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 836649 822689 612 1471 0 835169 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 3346596

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 3637
/proc/meminfo: memFree=22907476/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3348644 CPUtime=162.27 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 823282 0 0 0 16062 165 0 0 20 0 1 0 270851214 3429011456 823411 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 837161 823411 612 1471 0 835681 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 3348644

[startup+222.307 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 3675
/proc/meminfo: memFree=23976272/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3348644 CPUtime=222.26 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 823519 0 0 0 22061 165 0 0 20 0 1 0 270851214 3429011456 823648 33554432000 4194304 10219143 140735821545888 140735821541000 8969224 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 837161 823648 612 1471 0 835681 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 3348644

[startup+282.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3676
/proc/meminfo: memFree=23836620/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3352548 CPUtime=282.24 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 824716 0 0 0 28059 165 0 0 20 0 1 0 270851214 3433009152 825012 33554432000 4194304 10219143 140735821545888 140735821541000 8969239 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 838137 825012 612 1471 0 836657 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 3352548

[startup+342.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 3676
/proc/meminfo: memFree=23832864/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3352548 CPUtime=342.23 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 824941 0 0 0 34058 165 0 0 20 0 1 0 270851214 3433009152 825236 33554432000 4194304 10219143 140735821545888 140735821541000 8969254 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 838137 825236 612 1471 0 836657 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 3352548

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3676
/proc/meminfo: memFree=23819748/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3353572 CPUtime=402.22 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 825420 0 0 0 40057 165 0 0 20 0 1 0 270851214 3434057728 826010 33554432000 4194304 10219143 140735821545888 140735821541000 8969239 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 838393 826010 612 1471 0 836913 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 3353572

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3676
/proc/meminfo: memFree=23793608/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3355428 CPUtime=462.21 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 826104 0 0 0 46056 165 0 0 20 0 1 0 270851214 3435958272 829115 33554432000 4194304 10219143 140735821545888 140735821541000 8969254 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 838857 829115 612 1471 0 837377 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 3355428

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3676
/proc/meminfo: memFree=23810264/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3355428 CPUtime=522.21 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 826329 0 0 0 52055 166 0 0 20 0 1 0 270851214 3435958272 829829 33554432000 4194304 10219143 140735821545888 140735821541000 8969234 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 838857 829829 612 1471 0 837377 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 3355428

[startup+582.3 s]
/proc/loadavg: 2.12 2.03 2.01 3/177 3677
/proc/meminfo: memFree=23805640/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3356452 CPUtime=582.2 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 826873 0 0 0 58054 166 0 0 20 0 1 0 270851214 3437006848 830687 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 839113 830687 612 1471 0 837633 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3356452

[startup+642.3 s]

################
# More data... #
################

/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 831031 0 0 0 106044 168 0 0 20 0 1 0 270851214 3448672256 838020 33554432000 4194304 10219143 140735821545888 140735821541000 8969249 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 841961 838020 612 1471 0 840481 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 3367844

[startup+1122.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 3704
/proc/meminfo: memFree=23595732/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3369892 CPUtime=1122.11 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 831613 0 0 0 112043 168 0 0 20 0 1 0 270851214 3450769408 838602 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 842473 838602 612 1471 0 840993 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 3369892

[startup+1182.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3705
/proc/meminfo: memFree=23566124/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3370916 CPUtime=1182.1 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 831942 0 0 0 118042 168 0 0 20 0 1 0 270851214 3451817984 838931 33554432000 4194304 10219143 140735821545888 140735821541000 8969234 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 842729 838931 612 1471 0 841249 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 3370916

[startup+1242.3 s]
/proc/loadavg: 2.17 2.04 2.01 3/177 3705
/proc/meminfo: memFree=23758080/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3372772 CPUtime=1242.09 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 832478 0 0 0 124041 168 0 0 20 0 1 0 270851214 3453718528 839589 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 843193 839589 612 1471 0 841713 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 3372772

[startup+1302.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 3705
/proc/meminfo: memFree=23753252/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3373796 CPUtime=1302.08 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 832805 0 0 0 130040 168 0 0 20 0 1 0 270851214 3454767104 839950 33554432000 4194304 10219143 140735821545888 140735821541000 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 843449 839950 612 1471 0 841969 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 3373796

[startup+1362.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 3708
/proc/meminfo: memFree=23723800/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3375844 CPUtime=1362.07 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 833388 0 0 0 136039 168 0 0 20 0 1 0 270851214 3456864256 840534 33554432000 4194304 10219143 140735821545888 140735821541000 8969249 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 843961 840534 612 1471 0 842481 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 3375844

[startup+1422.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 3708
/proc/meminfo: memFree=23688264/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3376676 CPUtime=1422.07 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 833666 0 0 0 142038 169 0 0 20 0 1 0 270851214 3457716224 840814 33554432000 4194304 10219143 140735821545888 140735821541000 8969239 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 844169 840814 612 1471 0 842689 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 3376676

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3709
/proc/meminfo: memFree=23652152/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3378724 CPUtime=1482.06 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 834248 0 0 0 148037 169 0 0 20 0 1 0 270851214 3459813376 841398 33554432000 4194304 10219143 140735821545888 140735821541000 8969260 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 844681 841398 612 1471 0 843201 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 3378724

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3709
/proc/meminfo: memFree=23631352/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3378724 CPUtime=1542.05 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 834319 0 0 0 154036 169 0 0 20 0 1 0 270851214 3459813376 841776 33554432000 4194304 10219143 140735821545888 140735821541000 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 844681 841776 612 1471 0 843201 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 3378724

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3709
/proc/meminfo: memFree=23714228/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3381604 CPUtime=1602.03 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 835109 0 0 0 160034 169 0 0 20 0 1 0 270851214 3462762496 842567 33554432000 4194304 10219143 140735821545888 140735821541000 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 845401 842567 612 1471 0 843921 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 3381604

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3709
/proc/meminfo: memFree=23713016/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3382628 CPUtime=1662.02 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 835437 0 0 0 166033 169 0 0 20 0 1 0 270851214 3463811072 842894 33554432000 4194304 10219143 140735821545888 140735821541000 8969244 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 845657 842894 612 1471 0 844177 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 3382628

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3709
/proc/meminfo: memFree=23660656/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3435572 CPUtime=1722.01 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 847965 0 0 0 172030 171 0 0 20 0 1 0 270851214 3518025728 855931 33554432000 4194304 10219143 140735821545888 140735821541208 8969224 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 858893 855931 612 1471 0 857413 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 3435572

[startup+1782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 3710
/proc/meminfo: memFree=23465368/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1781.99 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892149 0 0 0 178022 177 0 0 20 0 1 0 270851214 3716456448 902708 33554432000 4194304 10219143 140735821545888 140735821541048 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902708 612 1471 0 905858 0
Current children cumulated CPU time (s) 1781.99
Current children cumulated vsize (KiB) 3629352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3710
/proc/meminfo: memFree=23465476/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1800.1 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892215 0 0 0 179833 177 0 0 20 0 1 0 270851214 3716456448 902774 33554432000 4194304 10219143 140735821545888 140735821541048 8969244 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902774 612 1471 0 905858 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 3629352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -3633

Solver just ended. Dumping a history of the last processes samples

[startup+1801.5 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 3711
/proc/meminfo: memFree=23465204/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1801.19 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892230 0 0 0 179942 177 0 0 20 0 1 0 270851214 3716456448 902789 33554432000 4194304 10219143 140735821545888 140735821540480 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902789 612 1471 0 905858 0
Current children cumulated CPU time (s) 1801.19
Current children cumulated vsize (KiB) 3629352

[startup+1801.91 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 3711
/proc/meminfo: memFree=23465204/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1801.59 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892230 0 0 0 179982 177 0 0 20 0 1 0 270851214 3716456448 902789 33554432000 4194304 10219143 140735821545888 140735821540480 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902789 612 1471 0 905858 0
Current children cumulated CPU time (s) 1801.59
Current children cumulated vsize (KiB) 3629352

[startup+1802.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 3711
/proc/meminfo: memFree=23465204/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1801.99 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892230 0 0 0 180022 177 0 0 20 0 1 0 270851214 3716456448 902789 33554432000 4194304 10219143 140735821545888 140735821540480 8969229 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902789 612 1471 0 905858 0
Current children cumulated CPU time (s) 1801.99
Current children cumulated vsize (KiB) 3629352

[startup+1802.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 3711
/proc/meminfo: memFree=23465204/32873648 swapFree=6852/6852
[pid=3633] ppid=3631 vsize=3629352 CPUtime=1802.09 cores=0,2,4,6
/proc/3633/stat : 3633 (scip-2.1.1.4exp) R 3631 3633 1296 0 -1 4202496 892230 0 0 0 180032 177 0 0 20 0 1 0 270851214 3716456448 902789 33554432000 4194304 10219143 140735821545888 140735821540480 8969254 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/3633/statm: 907338 902789 612 1471 0 905858 0
Current children cumulated CPU time (s) 1802.09
Current children cumulated vsize (KiB) 3629352

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.47
CPU time (s): 1802.17
CPU user time (s): 1800.33
CPU system time (s): 1.84272
CPU usage (%): 99.9834
Max. virtual memory (cumulated for all children) (KiB): 3629352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.33
system time used= 1.84272
maximum resident set size= 3611156
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 892230
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 40
involuntary context switches= 1902

runsolver used 3.24851 second user time and 9.1936 second system time

The end

Launcher Data 

Begin job on node116 at 2012-05-26 17:47:32
IDJOB=3692549
IDBENCH=91127
IDSOLVER=2271
FILE ID=node116/3692549-1338047251
RUNJOBID= node116-1338028819-2418
PBS_JOBID= 14624355
Free space on /tmp= 71548 MiB

SOLVER NAME= SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_luby_20null50mast_rapportOE1.0_TMAX15_K192_cod2.opb
COMMAND LINE= HOME/scip-2.1.1.4expfix.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3692549-1338047251/watcher-3692549-1338047251 -o /tmp/evaluation-result-3692549-1338047251/solver-3692549-1338047251 -C 1800 -W 1900 -M 15500  HOME/scip-2.1.1.4expfix.linux.x86_64.gnu.opt.spx -f HOME/instance-3692549-1338047251.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bddfe521cf91a77d0e4de5a51a3aa343
RANDOM SEED=1073250510

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26206424 kB
Buffers:          255100 kB
Cached:          3376484 kB
SwapCached:            0 kB
Active:          2980348 kB
Inactive:        2912520 kB
Active(anon):    2263592 kB
Inactive(anon):        0 kB
Active(file):     716756 kB
Inactive(file):  2912520 kB
Unevictable:        6852 kB
Mlocked:            6852 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             40952 kB
Writeback:           100 kB
AnonPages:       2269788 kB
Mapped:            16864 kB
Shmem:               200 kB
Slab:             633052 kB
SReclaimable:      77368 kB
SUnreclaim:       555684 kB
KernelStack:        1448 kB
PageTables:         8732 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    2417628 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    866304 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71520 MiB
End job on node116 at 2012-05-26 18:17:34