Trace number 3712466

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.14 900.43

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900557362--soft-33-100-0.wbo
MD5SUM908c51b3c7715396d94712713af78fd9
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark5
Best CPU time to get the best result obtained on this benchmark64.1742
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1868
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 94981
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 94980
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 709
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712466-1338197881.wbo.
0.00/0.00	c Instance file HOME/instance-3712466-1338197881.wbo
0.00/0.00	c File size is 92616 bytes.
0.00/0.01	c Highest Coefficient sum: 709
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2099                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    5                                                   |
0.00/0.01	c |  Number PB Constraints: 18                                                  |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.14/900.41	o 273
1800.14/900.41	o 264
1800.14/900.41	o 258
1800.14/900.41	o 239
1800.14/900.41	o 236
1800.14/900.41	o 228
1800.14/900.41	o 204
1800.14/900.41	o 194
1800.14/900.41	o 167
1800.14/900.41	o 163
1800.14/900.41	o 161
1800.14/900.41	o 152
1800.14/900.41	o 150
1800.14/900.41	o 147
1800.14/900.41	o 146
1800.14/900.41	o 136
1800.14/900.41	o 124
1800.14/900.41	o 118
1800.14/900.41	o 114
1800.14/900.41	o 103
1800.14/900.41	o 102
1800.14/900.41	o 84
1800.14/900.41	o 80
1800.14/900.41	o 79
1800.14/900.41	o 77
1800.14/900.41	o 72
1800.14/900.41	o 69
1800.14/900.41	o 57
1800.14/900.41	o 33
1800.14/900.41	o 32
1800.14/900.41	o 24
1800.14/900.41	o 23
1800.14/900.41	o 14
1800.14/900.41	o 12
1800.14/900.41	o 11
1800.14/900.41	o 9
1800.14/900.41	o 8
1800.14/900.41	o 7
1800.14/900.41	o 6
1800.14/900.41	o 5
1800.14/900.41	c ===============================================================================
1800.14/900.41	c Wall Clock Time: 900.41 s
1800.14/900.41	c Best Solution: 5
1800.14/900.41	s SATISFIABLE
1800.14/900.41	v -x1 -x2 -x3 -x4 -x5 x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 x18 -x19 -x20 x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 x167 -x168 -x169 -x170 -x171 -x172 x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 x184 -x185 -x186 -x187 -x188 x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 x231

Verifier Data 

OK	5

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712466-1338197881/watcher-3712466-1338197881 -o /tmp/evaluation-result-3712466-1338197881/solver-3712466-1338197881 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712466-1338197881.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 3.97 3.81 4/178 15528
/proc/meminfo: memFree=31267152/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=4316 CPUtime=0 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) R 15526 15528 14514 0 -1 4202496 374 0 0 0 0 0 0 0 20 0 1 0 285913613 4419584 327 33554432000 4194304 5964478 140735984197328 140737211171848 4395323 0 0 4096 16387 0 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 1079 327 165 433 0 620 0

[startup+0.102061 s]
/proc/loadavg: 3.99 3.97 3.81 4/178 15528
/proc/meminfo: memFree=31267152/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=0.18 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 2897 0 0 0 18 0 0 0 20 0 3 0 285913613 167882752 2154 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 2154 198 433 0 40551 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163948

[startup+0.200191 s]
/proc/loadavg: 3.99 3.97 3.81 4/178 15528
/proc/meminfo: memFree=31267152/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=0.37 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 3351 0 0 0 37 0 0 0 20 0 3 0 285913613 167882752 2545 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 2545 198 433 0 40551 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 163948

[startup+0.300152 s]
/proc/loadavg: 3.99 3.97 3.81 4/178 15528
/proc/meminfo: memFree=31267152/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=0.57 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 4024 0 0 0 57 0 0 0 20 0 3 0 285913613 167882752 2974 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 2974 198 433 0 40551 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 163948

[startup+0.700146 s]
/proc/loadavg: 3.99 3.97 3.81 4/178 15528
/proc/meminfo: memFree=31267152/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=1.38 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 5170 0 0 0 137 1 0 0 20 0 3 0 285913613 167882752 3753 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 3753 198 433 0 40551 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 163948

[startup+1.50021 s]
/proc/loadavg: 3.99 3.97 3.81 5/181 15531
/proc/meminfo: memFree=31250552/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=2.97 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 7204 0 0 0 296 1 0 0 20 0 3 0 285913613 167882752 5108 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 5108 198 433 0 40551 0
[pid=15528/tid=15530] ppid=15526 vsize=163948 CPUtime=1.47 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 2809 0 0 0 146 1 0 0 20 0 3 0 285913614 167882752 5108 33554432000 4194304 5964478 140735984197328 140442966517752 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=163948 CPUtime=1.46 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 3372 0 0 0 146 0 0 0 20 0 3 0 285913614 167882752 5108 33554432000 4194304 5964478 140735984197328 140442956028568 4403512 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 163948

[startup+3.10034 s]
/proc/loadavg: 3.99 3.97 3.81 5/181 15531
/proc/meminfo: memFree=31243980/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=163948 CPUtime=6.17 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 10432 0 0 0 615 2 0 0 20 0 3 0 285913613 167882752 8011 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 40987 8011 198 433 0 40551 0
[pid=15528/tid=15530] ppid=15526 vsize=163948 CPUtime=3.06 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 5361 0 0 0 304 2 0 0 20 0 3 0 285913614 167882752 8011 33554432000 4194304 5964478 140735984197328 140442966517744 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=163948 CPUtime=3.06 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 4048 0 0 0 306 0 0 0 20 0 3 0 285913614 167882752 8011 33554432000 4194304 5964478 140735984197328 140442956028568 4222416 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 163948

[startup+6.30035 s]
/proc/loadavg: 3.99 3.97 3.81 5/181 15531
/proc/meminfo: memFree=31213872/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=164348 CPUtime=12.57 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 16511 0 0 0 1252 5 0 0 20 0 3 0 285913613 168292352 13951 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 41087 13951 198 433 0 40651 0
[pid=15528/tid=15530] ppid=15526 vsize=164348 CPUtime=6.26 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 10647 0 0 0 622 4 0 0 20 0 3 0 285913614 168292352 13951 33554432000 4194304 5964478 140735984197328 140442966517560 4400512 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=164348 CPUtime=6.25 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 4841 0 0 0 625 0 0 0 20 0 3 0 285913614 168292352 13951 33554432000 4194304 5964478 140735984197328 140442956028216 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 164348

[startup+12.7003 s]
/proc/loadavg: 4.07 3.99 3.81 5/181 15531
/proc/meminfo: memFree=31144308/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=230280 CPUtime=25.36 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 28704 0 0 0 2527 9 0 0 20 0 3 0 285913613 235806720 26011 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 57570 26011 198 433 0 57134 0
[pid=15528/tid=15530] ppid=15526 vsize=230280 CPUtime=12.64 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 20582 0 0 0 1256 8 0 0 20 0 3 0 285913614 235806720 26011 33554432000 4194304 5964478 140735984197328 140442966517752 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=230280 CPUtime=12.63 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 7099 0 0 0 1262 1 0 0 20 0 3 0 285913614 235806720 26011 33554432000 4194304 5964478 140735984197328 140442956028568 4400526 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 230280

[startup+25.5004 s]
/proc/loadavg: 4.06 3.99 3.82 5/181 15531
/proc/meminfo: memFree=31045024/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=296660 CPUtime=50.96 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 45838 0 0 0 5079 17 0 0 20 0 3 0 285913613 303779840 43145 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 74165 43145 198 433 0 73729 0
[pid=15528/tid=15530] ppid=15526 vsize=296660 CPUtime=25.41 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 32905 0 0 0 2528 13 0 0 20 0 3 0 285913614 303779840 43145 33554432000 4194304 5964478 140735984197328 140442966517752 5139150 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=296660 CPUtime=25.4 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 11910 0 0 0 2537 3 0 0 20 0 3 0 285913614 303779840 43145 33554432000 4194304 5964478 140735984197328 140442956028216 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 296660

[startup+51.1004 s]
/proc/loadavg: 4.09 4.00 3.82 5/181 15531
/proc/meminfo: memFree=30889108/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=363972 CPUtime=102.15 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 71473 0 0 0 10187 28 0 0 20 0 3 0 285913613 372707328 68719 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 90993 68719 198 433 0 90557 0
[pid=15528/tid=15530] ppid=15526 vsize=363972 CPUtime=50.94 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 44111 0 0 0 5077 17 0 0 20 0 3 0 285913614 372707328 68719 33554432000 4194304 5964478 140735984197328 140442966517664 4400526 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=363972 CPUtime=50.93 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 26339 0 0 0 5083 10 0 0 20 0 3 0 285913614 372707328 68719 33554432000 4194304 5964478 140735984197328 140442956028216 4399899 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 363972

[startup+102.3 s]
/proc/loadavg: 4.04 4.00 3.83 5/181 15531
/proc/meminfo: memFree=30607800/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=628412 CPUtime=204.54 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 123785 0 0 0 20406 48 0 0 20 0 3 0 285913613 643493888 121029 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 157103 121029 198 433 0 156667 0
[pid=15528/tid=15530] ppid=15526 vsize=628412 CPUtime=102.02 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 82709 0 0 0 10169 33 0 0 20 0 3 0 285913614 643493888 121029 33554432000 4194304 5964478 140735984197328 140442966517856 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=628412 CPUtime=102 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 40053 0 0 0 10184 16 0 0 20 0 3 0 285913614 643493888 121029 33554432000 4194304 5964478 140735984197328 140442956027976 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 628412

[startup+162.3 s]
/proc/loadavg: 4.04 4.01 3.84 5/182 15534
/proc/meminfo: memFree=30338028/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=760660 CPUtime=324.49 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 163011 0 0 0 32381 68 0 0 20 0 3 0 285913613 778915840 160488 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 190165 160488 198 433 0 189729 0
[pid=15528/tid=15530] ppid=15526 vsize=760660 CPUtime=161.85 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 106422 0 0 0 16138 47 0 0 20 0 3 0 285913614 778915840 160488 33554432000 4194304 5964478 140735984197328 140442966517752 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=760660 CPUtime=161.82 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 55566 0 0 0 16158 24 0 0 20 0 3 0 285913614 778915840 160488 33554432000 4194304 5964478 140735984197328 140442956028320 4403701 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.49
Current children cumulated vsize (KiB) 760660

[startup+222.307 s]
/proc/loadavg: 4.01 4.01 3.85 5/181 15535
/proc/meminfo: memFree=30129752/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=958216 CPUtime=444.43 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 204698 0 0 0 44348 95 0 0 20 0 3 0 285913613 981213184 202175 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 239554 202175 198 433 0 239118 0
[pid=15528/tid=15530] ppid=15526 vsize=958216 CPUtime=221.68 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 147972 0 0 0 22093 75 0 0 20 0 3 0 285913614 981213184 202175 33554432000 4194304 5964478 140735984197328 140442966517752 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=958216 CPUtime=221.65 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 55703 0 0 0 22140 25 0 0 20 0 3 0 285913614 981213184 202175 33554432000 4194304 5964478 140735984197328 140442956028320 4221984 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.43
Current children cumulated vsize (KiB) 958216

[startup+282.3 s]
/proc/loadavg: 4.00 4.00 3.85 5/181 15535
/proc/meminfo: memFree=29926516/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=959296 CPUtime=564.36 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 225808 0 0 0 56328 108 0 0 20 0 3 0 285913613 982319104 223278 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 239824 223278 198 433 0 239388 0
[pid=15528/tid=15530] ppid=15526 vsize=959296 CPUtime=281.48 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 161682 0 0 0 28062 86 0 0 20 0 3 0 285913614 982319104 223278 33554432000 4194304 5964478 140735984197328 140442966517856 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=959296 CPUtime=281.49 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 63103 0 0 0 28120 29 0 0 20 0 3 0 285913614 982319104 223278 33554432000 4194304 5964478 140735984197328 140442956027976 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.36
Current children cumulated vsize (KiB) 959296

[startup+342.3 s]
/proc/loadavg: 4.00 4.00 3.86 5/181 15535
/proc/meminfo: memFree=29837268/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=960524 CPUtime=684.3 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 231212 0 0 0 68320 110 0 0 20 0 3 0 285913613 983576576 228648 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 240131 228648 198 433 0 239695 0

################
# More data... #
################

[pid=15528/tid=15531] ppid=15526 vsize=960524 CPUtime=341.31 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 68456 0 0 0 34098 33 0 0 20 0 3 0 285913614 983576576 228648 33554432000 4194304 5964478 140735984197328 140442956027976 4400526 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.3
Current children cumulated vsize (KiB) 960524

[startup+402.3 s]
/proc/loadavg: 4.00 4.00 3.86 5/181 15535
/proc/meminfo: memFree=29680436/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1091784 CPUtime=804.25 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 245865 0 0 0 80304 121 0 0 20 0 3 0 285913613 1117986816 243149 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 272946 243149 198 433 0 272510 0
[pid=15528/tid=15530] ppid=15526 vsize=1091784 CPUtime=401.12 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 170038 0 0 0 40017 95 0 0 20 0 3 0 285913614 1117986816 243149 33554432000 4194304 5964478 140735984197328 140442966517752 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1091784 CPUtime=401.15 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 74804 0 0 0 40077 38 0 0 20 0 3 0 285913614 1117986816 243149 33554432000 4194304 5964478 140735984197328 140442956028320 4390224 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.25
Current children cumulated vsize (KiB) 1091784

[startup+462.3 s]
/proc/loadavg: 4.00 4.00 3.87 5/181 15535
/proc/meminfo: memFree=29511576/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1224320 CPUtime=924.19 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 273312 0 0 0 92278 141 0 0 20 0 3 0 285913613 1253703680 270580 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 306080 270580 198 433 0 305644 0
[pid=15528/tid=15530] ppid=15526 vsize=1224320 CPUtime=460.95 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 197358 0 0 0 45981 114 0 0 20 0 3 0 285913614 1253703680 270580 33554432000 4194304 5964478 140735984197328 140442966517320 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1224320 CPUtime=460.97 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 74931 0 0 0 46058 39 0 0 20 0 3 0 285913614 1253703680 270580 33554432000 4194304 5964478 140735984197328 140442956027976 4403688 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.19
Current children cumulated vsize (KiB) 1224320

[startup+522.3 s]
/proc/loadavg: 4.03 4.01 3.88 5/181 15536
/proc/meminfo: memFree=29382288/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1291520 CPUtime=1044.13 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 292753 0 0 0 104259 154 0 0 20 0 3 0 285913613 1322516480 289980 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 322880 289980 198 433 0 322444 0
[pid=15528/tid=15530] ppid=15526 vsize=1291520 CPUtime=520.75 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216631 0 0 0 51946 129 0 0 20 0 3 0 285913614 1322516480 289980 33554432000 4194304 5964478 140735984197328 140442966517664 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1291520 CPUtime=520.82 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 75099 0 0 0 52043 39 0 0 20 0 3 0 285913614 1322516480 289980 33554432000 4194304 5964478 140735984197328 140442956028320 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.13
Current children cumulated vsize (KiB) 1291520

[startup+582.3 s]
/proc/loadavg: 4.01 4.01 3.89 5/181 15536
/proc/meminfo: memFree=29347396/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1222608 CPUtime=1164.1 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 295815 0 0 0 116254 156 0 0 20 0 3 0 285913613 1251950592 281715 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 305652 281715 200 433 0 305216 0
[pid=15528/tid=15530] ppid=15526 vsize=1222608 CPUtime=580.58 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216668 0 0 0 57928 130 0 0 20 0 3 0 285913614 1251950592 281715 33554432000 4194304 5964478 140735984197328 140442966517856 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1222608 CPUtime=580.66 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 78124 0 0 0 58025 41 0 0 20 0 3 0 285913614 1251950592 281715 33554432000 4194304 5964478 140735984197328 140442956028128 4400081 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.1
Current children cumulated vsize (KiB) 1222608

[startup+642.3 s]
/proc/loadavg: 4.04 4.02 3.90 5/181 15536
/proc/meminfo: memFree=29297452/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1222608 CPUtime=1284.09 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 295818 0 0 0 128253 156 0 0 20 0 3 0 285913613 1251950592 281718 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 305652 281718 200 433 0 305216 0
[pid=15528/tid=15530] ppid=15526 vsize=1222608 CPUtime=640.43 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216671 0 0 0 63912 131 0 0 20 0 3 0 285913614 1251950592 281718 33554432000 4194304 5964478 140735984197328 140442966517856 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1222608 CPUtime=640.51 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 78124 0 0 0 64009 42 0 0 20 0 3 0 285913614 1251950592 281718 33554432000 4194304 5964478 140735984197328 140442956028128 4403661 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.09
Current children cumulated vsize (KiB) 1222608

[startup+702.3 s]
/proc/loadavg: 4.01 4.01 3.90 5/181 15576
/proc/meminfo: memFree=30128896/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1222608 CPUtime=1404.06 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 295827 0 0 0 140250 156 0 0 20 0 3 0 285913613 1251950592 280934 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 305652 280934 200 433 0 305216 0
[pid=15528/tid=15530] ppid=15526 vsize=1222608 CPUtime=700.27 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216678 0 0 0 69895 132 0 0 20 0 3 0 285913614 1251950592 280934 33554432000 4194304 5964478 140735984197328 140442966517664 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1222608 CPUtime=700.35 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 78126 0 0 0 69992 43 0 0 20 0 3 0 285913614 1251950592 280934 33554432000 4194304 5964478 140735984197328 140442956028320 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.06
Current children cumulated vsize (KiB) 1222608

[startup+762.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/182 15579
/proc/meminfo: memFree=30036616/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1222752 CPUtime=1524.06 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 295890 0 0 0 152250 156 0 0 20 0 3 0 285913613 1252098048 281073 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 305688 281073 200 433 0 305252 0
[pid=15528/tid=15530] ppid=15526 vsize=1222752 CPUtime=760.13 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216695 0 0 0 75880 133 0 0 20 0 3 0 285913614 1252098048 281073 33554432000 4194304 5964478 140735984197328 140442966517664 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1222752 CPUtime=760.21 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 78172 0 0 0 75977 44 0 0 20 0 3 0 285913614 1252098048 281073 33554432000 4194304 5964478 140735984197328 140442956028320 4400040 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.06
Current children cumulated vsize (KiB) 1222752

[startup+822.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 15580
/proc/meminfo: memFree=29867392/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1222988 CPUtime=1643.99 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 306117 0 0 0 164239 160 0 0 20 0 3 0 285913613 1252339712 291339 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 305747 291339 200 433 0 305311 0
[pid=15528/tid=15530] ppid=15526 vsize=1222988 CPUtime=819.94 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216757 0 0 0 81860 134 0 0 20 0 3 0 285913614 1252339712 291339 33554432000 4194304 5964478 140735984197328 140442966517664 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1222988 CPUtime=820.04 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 88337 0 0 0 81954 50 0 0 20 0 3 0 285913614 1252339712 291339 33554432000 4194304 5964478 140735984197328 140442956028216 4400081 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1643.99
Current children cumulated vsize (KiB) 1222988

[startup+882.307 s]
/proc/loadavg: 4.07 4.02 3.91 5/181 15580
/proc/meminfo: memFree=29737104/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1289244 CPUtime=1763.95 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 323268 0 0 0 176225 170 0 0 20 0 3 0 285913613 1320185856 308446 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 322311 308446 200 433 0 321875 0
[pid=15528/tid=15530] ppid=15526 vsize=1289244 CPUtime=879.76 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216812 0 0 0 87841 135 0 0 20 0 3 0 285913614 1320185856 308446 33554432000 4194304 5964478 140735984197328 140442966517856 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1289244 CPUtime=879.88 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 105433 0 0 0 87928 60 0 0 20 0 3 0 285913614 1320185856 308446 33554432000 4194304 5964478 140735984197328 140442956028216 4400073 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1763.95
Current children cumulated vsize (KiB) 1289244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.4 s]
/proc/loadavg: 4.05 4.01 3.91 5/181 15580
/proc/meminfo: memFree=29730392/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1289244 CPUtime=1800.14 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 323295 0 0 0 179844 170 0 0 20 0 3 0 285913613 1320185856 307606 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 322311 307606 200 433 0 321875 0
[pid=15528/tid=15530] ppid=15526 vsize=1289244 CPUtime=897.8 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216839 0 0 0 89645 135 0 0 20 0 3 0 285913614 1320185856 307606 33554432000 4194304 5964478 140735984197328 140442966517664 4390216 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1289244 CPUtime=897.94 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 105433 0 0 0 89734 60 0 0 20 0 3 0 285913614 1320185856 307606 33554432000 4194304 5964478 140735984197328 140442956028320 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 1289244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.4 s]
/proc/loadavg: 4.05 4.01 3.91 5/181 15580
/proc/meminfo: memFree=29730392/32873648 swapFree=7116/7116
[pid=15528] ppid=15526 vsize=1289244 CPUtime=1800.14 cores=1,3,5,7
/proc/15528/stat : 15528 (pwbo2.01) S 15526 15528 14514 0 -1 4202496 323295 0 0 0 179844 170 0 0 20 0 3 0 285913613 1320185856 307606 33554432000 4194304 5964478 140735984197328 140735984196848 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/15528/statm: 322311 307606 200 433 0 321875 0
[pid=15528/tid=15530] ppid=15526 vsize=1289244 CPUtime=897.8 cores=1,3,5,7
/proc/15528/task/15530/stat : 15530 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 216839 0 0 0 89645 135 0 0 20 0 3 0 285913614 1320185856 307606 33554432000 4194304 5964478 140735984197328 140442966517664 4390216 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=15528/tid=15531] ppid=15526 vsize=1289244 CPUtime=897.94 cores=1,3,5,7
/proc/15528/task/15531/stat : 15531 (pwbo2.01) R 15526 15528 14514 0 -1 4202560 105433 0 0 0 89734 60 0 0 20 0 3 0 285913614 1320185856 307606 33554432000 4194304 5964478 140735984197328 140442956028320 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.14
Current children cumulated vsize (KiB) 1289244

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15528 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=816298
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=988697
# CPU time returned by wait4() is 1795.81
# while last known CPU time is 1800.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.43
CPU time (s): 1800.14
CPU user time (s): 1798.44
CPU system time (s): 1.7
CPU usage (%): 199.92
Max. virtual memory (cumulated for all children) (KiB): 1291660

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.82
system time used= 1.9887
maximum resident set size= 1233784
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 323296
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 802
involuntary context switches= 1979

runsolver used 1.87071 second user time and 5.08523 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 11:38:01
IDJOB=3712466
IDBENCH=78982
IDSOLVER=2292
FILE ID=node123/3712466-1338197881
RUNJOBID= node123-1338195143-14531
PBS_JOBID= 14624606
Free space on /tmp= 71676 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900557362--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712466-1338197881/watcher-3712466-1338197881 -o /tmp/evaluation-result-3712466-1338197881/solver-3712466-1338197881 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712466-1338197881.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 908c51b3c7715396d94712713af78fd9
RANDOM SEED=1343780819

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31267416 kB
Buffers:          308152 kB
Cached:           276544 kB
SwapCached:          956 kB
Active:           466552 kB
Inactive:         301472 kB
Active(anon):     176576 kB
Inactive(anon):     8336 kB
Active(file):     289976 kB
Inactive(file):   293136 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102956 kB
Dirty:              5464 kB
Writeback:             0 kB
AnonPages:        219640 kB
Mapped:            11072 kB
Shmem:                 0 kB
Slab:             698952 kB
SReclaimable:     143280 kB
SUnreclaim:       555672 kB
KernelStack:        1504 kB
PageTables:         4344 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     162240 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     32768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71668 MiB
End job on node123 at 2012-05-28 11:53:04