Trace number 3712481

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.18 900.548

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900576927--soft-33-100-0.wbo
MD5SUMb0bcd9e760e7f0ffa9653d41066a148b
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark55.5366
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1785
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 88246
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 88245
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 671
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712481-1338197159.wbo.
0.00/0.00	c Instance file HOME/instance-3712481-1338197159.wbo
0.00/0.00	c File size is 92233 bytes.
0.00/0.01	c Highest Coefficient sum: 671
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2016                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    11                                                  |
0.00/0.01	c |  Number PB Constraints: 12                                                  |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    PB Constraint                                       |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.18/900.51	o 493
1800.18/900.51	o 471
1800.18/900.51	o 215
1800.18/900.51	o 180
1800.18/900.51	o 161
1800.18/900.51	o 160
1800.18/900.51	o 149
1800.18/900.51	o 132
1800.18/900.51	o 127
1800.18/900.51	o 121
1800.18/900.51	o 119
1800.18/900.51	o 117
1800.18/900.51	o 114
1800.18/900.51	o 111
1800.18/900.51	o 93
1800.18/900.51	o 83
1800.18/900.51	o 82
1800.18/900.51	o 76
1800.18/900.51	o 67
1800.18/900.51	o 62
1800.18/900.51	o 59
1800.18/900.51	o 55
1800.18/900.51	o 52
1800.18/900.51	o 30
1800.18/900.51	o 29
1800.18/900.51	o 18
1800.18/900.51	o 10
1800.18/900.51	o 9
1800.18/900.51	o 6
1800.18/900.51	o 2
1800.18/900.51	o 1
1800.18/900.51	c ===============================================================================
1800.18/900.51	c Wall Clock Time: 900.51 s
1800.18/900.51	c Best Solution: 1
1800.18/900.51	s SATISFIABLE
1800.18/900.51	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 x10 x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 -x120 -x121 -x122 x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 x161 -x162 -x163 -x164 -x165 x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 x189 -x190 -x191 -x192 -x193 -x194 x195 -x196 -x197 -x198 -x199 -x200 -x201 x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231

Verifier Data 

OK	1

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712481-1338197159/watcher-3712481-1338197159 -o /tmp/evaluation-result-3712481-1338197159/solver-3712481-1338197159 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712481-1338197159.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 3.97 3.87 4/180 23294
/proc/meminfo: memFree=30620464/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=4456 CPUtime=0 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) R 23292 23294 22874 0 -1 4202496 428 0 0 0 0 0 0 0 20 0 1 0 285841220 4562944 381 33554432000 4194304 5964478 140734673121088 140736174416504 4361359 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 1114 381 168 433 0 655 0

[startup+0.0478319 s]
/proc/loadavg: 3.99 3.97 3.87 4/180 23294
/proc/meminfo: memFree=30620464/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=163772 CPUtime=0.07 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 2136 0 0 0 7 0 0 0 20 0 3 0 285841220 167702528 1783 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 40943 1783 198 433 0 40507 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 163772

[startup+0.100192 s]
/proc/loadavg: 3.99 3.97 3.87 4/180 23294
/proc/meminfo: memFree=30620464/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=163772 CPUtime=0.17 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 2800 0 0 0 17 0 0 0 20 0 3 0 285841220 167702528 2204 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 40943 2204 198 433 0 40507 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 163772

[startup+0.300128 s]
/proc/loadavg: 3.99 3.97 3.87 4/180 23294
/proc/meminfo: memFree=30620464/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=163772 CPUtime=0.57 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 3732 0 0 0 56 1 0 0 20 0 3 0 285841220 167702528 2766 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 40943 2766 198 433 0 40507 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 163772

[startup+0.700157 s]
/proc/loadavg: 3.99 3.97 3.87 4/180 23294
/proc/meminfo: memFree=30620464/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=163772 CPUtime=1.37 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 5055 0 0 0 136 1 0 0 20 0 3 0 285841220 167702528 3708 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 40943 3708 198 433 0 40507 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 163772

[startup+1.5003 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23297
/proc/meminfo: memFree=30605544/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=163772 CPUtime=2.98 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 6265 0 0 0 296 2 0 0 20 0 3 0 285841220 167702528 4711 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 40943 4711 198 433 0 40507 0
[pid=23294/tid=23296] ppid=23292 vsize=163772 CPUtime=1.47 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 2378 0 0 0 146 1 0 0 20 0 3 0 285841221 167702528 4711 33554432000 4194304 5964478 140734673121088 139814862977016 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=163772 CPUtime=1.47 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 2867 0 0 0 147 0 0 0 20 0 3 0 285841221 167702528 4711 33554432000 4194304 5964478 140734673121088 139814852487392 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 163772

[startup+3.10035 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23297
/proc/meminfo: memFree=30596244/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=164168 CPUtime=6.17 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 9375 0 0 0 614 3 0 0 20 0 3 0 285841220 168108032 7705 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 41042 7705 198 433 0 40606 0
[pid=23294/tid=23296] ppid=23292 vsize=164168 CPUtime=3.06 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 4668 0 0 0 305 1 0 0 20 0 3 0 285841221 168108032 7705 33554432000 4194304 5964478 140734673121088 139814862977016 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=164168 CPUtime=3.06 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 3687 0 0 0 305 1 0 0 20 0 3 0 285841221 168108032 7705 33554432000 4194304 5964478 140734673121088 139814852487624 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 164168

[startup+6.30036 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23297
/proc/meminfo: memFree=30573424/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=164712 CPUtime=12.57 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 14474 0 0 0 1251 6 0 0 20 0 3 0 285841220 168665088 12804 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 41178 12804 198 433 0 40742 0
[pid=23294/tid=23296] ppid=23292 vsize=164712 CPUtime=6.25 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 8373 0 0 0 623 2 0 0 20 0 3 0 285841221 168665088 12804 33554432000 4194304 5964478 140734673121088 139814862977016 4400416 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=164712 CPUtime=6.25 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 5081 0 0 0 622 3 0 0 20 0 3 0 285841221 168665088 12804 33554432000 4194304 5964478 140734673121088 139814852487480 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 164712

[startup+12.7004 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23297
/proc/meminfo: memFree=30532900/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=165420 CPUtime=25.37 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 24566 0 0 0 2527 10 0 0 20 0 3 0 285841220 169390080 22896 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 41355 22896 198 433 0 40919 0
[pid=23294/tid=23296] ppid=23292 vsize=165420 CPUtime=12.64 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 14101 0 0 0 1260 4 0 0 20 0 3 0 285841221 169390080 22896 33554432000 4194304 5964478 140734673121088 139814862977016 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=165420 CPUtime=12.64 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 9445 0 0 0 1260 4 0 0 20 0 3 0 285841221 169390080 22896 33554432000 4194304 5964478 140734673121088 139814852487392 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 165420

[startup+25.5004 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23298
/proc/meminfo: memFree=30411724/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=298508 CPUtime=50.94 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 52593 0 0 0 5060 34 0 0 20 0 3 0 285841220 305672192 51266 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 74627 51266 198 433 0 74191 0
[pid=23294/tid=23296] ppid=23292 vsize=298508 CPUtime=25.4 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 25536 0 0 0 2531 9 0 0 20 0 3 0 285841221 305672192 51266 33554432000 4194304 5964478 140734673121088 139814862977016 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=298508 CPUtime=25.39 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 26037 0 0 0 2515 24 0 0 20 0 3 0 285841221 305672192 51266 33554432000 4194304 5964478 140734673121088 139814852487480 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 298508

[startup+51.1004 s]
/proc/loadavg: 3.99 3.97 3.87 5/183 23298
/proc/meminfo: memFree=30278764/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=431280 CPUtime=102.11 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 76350 0 0 0 10159 52 0 0 20 0 3 0 285841220 441630720 75009 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 107820 75009 198 433 0 107384 0
[pid=23294/tid=23296] ppid=23292 vsize=431280 CPUtime=50.93 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 37055 0 0 0 5079 14 0 0 20 0 3 0 285841221 441630720 75009 33554432000 4194304 5964478 140734673121088 139814862977008 4399925 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=431280 CPUtime=50.9 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 38275 0 0 0 5053 37 0 0 20 0 3 0 285841221 441630720 75009 33554432000 4194304 5964478 140734673121088 139814852487240 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 431280

[startup+102.307 s]
/proc/loadavg: 4.04 3.99 3.89 5/183 23298
/proc/meminfo: memFree=30073404/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=563780 CPUtime=204.47 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 116042 0 0 0 20365 82 0 0 20 0 3 0 285841220 577310720 114690 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 140945 114690 198 433 0 140509 0
[pid=23294/tid=23296] ppid=23292 vsize=563780 CPUtime=101.97 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 57777 0 0 0 10172 25 0 0 20 0 3 0 285841221 577310720 114690 33554432000 4194304 5964478 140734673121088 139814862977016 4400062 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=563780 CPUtime=101.96 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 57245 0 0 0 10138 58 0 0 20 0 3 0 285841221 577310720 114690 33554432000 4194304 5964478 140734673121088 139814852487480 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.47
Current children cumulated vsize (KiB) 563780

[startup+162.3 s]
/proc/loadavg: 4.01 3.99 3.89 5/183 23298
/proc/meminfo: memFree=29787456/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=828148 CPUtime=324.4 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 172288 0 0 0 32320 120 0 0 20 0 3 0 285841220 848023552 172558 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 207037 172558 198 433 0 206601 0
[pid=23294/tid=23296] ppid=23292 vsize=828148 CPUtime=161.78 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 98984 0 0 0 16127 51 0 0 20 0 3 0 285841221 848023552 172560 33554432000 4194304 5964478 140734673121088 139814862977016 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=828148 CPUtime=161.79 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 72286 0 0 0 16107 72 0 0 20 0 3 0 285841221 848023552 172560 33554432000 4194304 5964478 140734673121088 139814852487240 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.4
Current children cumulated vsize (KiB) 828148

[startup+222.3 s]
/proc/loadavg: 4.00 3.99 3.90 5/183 23298
/proc/meminfo: memFree=29675584/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=828888 CPUtime=444.37 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 186734 0 0 0 44308 129 0 0 20 0 3 0 285841220 848781312 187004 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 207222 187004 198 433 0 206786 0
[pid=23294/tid=23296] ppid=23292 vsize=828888 CPUtime=221.62 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 103831 0 0 0 22107 55 0 0 20 0 3 0 285841221 848781312 187004 33554432000 4194304 5964478 140734673121088 139814862977120 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=828888 CPUtime=221.63 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 81883 0 0 0 22084 79 0 0 20 0 3 0 285841221 848781312 187004 33554432000 4194304 5964478 140734673121088 139814852487240 4400051 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.37
Current children cumulated vsize (KiB) 828888

[startup+282.3 s]
/proc/loadavg: 4.00 3.99 3.90 5/184 23301
/proc/meminfo: memFree=29564004/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=895416 CPUtime=564.35 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 200842 0 0 0 56294 141 0 0 20 0 3 0 285841220 916905984 201112 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 223854 201112 198 433 0 223418 0
[pid=23294/tid=23296] ppid=23292 vsize=895416 CPUtime=281.47 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 113036 0 0 0 28084 63 0 0 20 0 3 0 285841221 916905984 201112 33554432000 4194304 5964478 140734673121088 139814862977016 4400075 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=895416 CPUtime=281.47 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 86786 0 0 0 28061 86 0 0 20 0 3 0 285841221 916905984 201112 33554432000 4194304 5964478 140734673121088 139814852487480 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.35
Current children cumulated vsize (KiB) 895416

[startup+342.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/183 23342
/proc/meminfo: memFree=30311144/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1093276 CPUtime=684.33 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 244170 0 0 0 68253 180 0 0 20 0 3 0 285841220 1119514624 244440 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 273319 244440 198 433 0 272883 0

################
# More data... #
################

[pid=23294/tid=23297] ppid=23292 vsize=1093276 CPUtime=341.31 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 102618 0 0 0 34025 106 0 0 20 0 3 0 285841221 1119514624 244440 33554432000 4194304 5964478 140734673121088 139814852487240 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 684.33
Current children cumulated vsize (KiB) 1093276

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/183 23342
/proc/meminfo: memFree=29818116/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1224696 CPUtime=804.28 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 274115 0 0 0 80228 200 0 0 20 0 3 0 285841220 1254088704 274549 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 306174 274549 198 433 0 305738 0
[pid=23294/tid=23296] ppid=23292 vsize=1224696 CPUtime=401.13 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 168154 0 0 0 40010 103 0 0 20 0 3 0 285841221 1254088704 274549 33554432000 4194304 5964478 140734673121088 139814862976824 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1224696 CPUtime=401.14 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 104941 0 0 0 40006 108 0 0 20 0 3 0 285841221 1254088704 274549 33554432000 4194304 5964478 140734673121088 139814852487240 4388252 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 804.28
Current children cumulated vsize (KiB) 1224696

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/183 23342
/proc/meminfo: memFree=29518808/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1292380 CPUtime=924.22 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 301758 0 0 0 92203 219 0 0 20 0 3 0 285841220 1323397120 302240 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 323095 302240 198 433 0 322659 0
[pid=23294/tid=23296] ppid=23292 vsize=1292380 CPUtime=460.93 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 195643 0 0 0 45971 122 0 0 20 0 3 0 285841221 1323397120 302240 33554432000 4194304 5964478 140734673121088 139814862976824 4400081 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1292380 CPUtime=460.98 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 105095 0 0 0 45990 108 0 0 20 0 3 0 285841221 1323397120 302240 33554432000 4194304 5964478 140734673121088 139814852487512 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 924.22
Current children cumulated vsize (KiB) 1292380

[startup+522.3 s]
/proc/loadavg: 4.06 4.00 3.91 5/183 23342
/proc/meminfo: memFree=29193336/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1425248 CPUtime=1044.14 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 334394 0 0 0 104166 248 0 0 20 0 3 0 285841220 1459453952 334881 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 356312 334881 198 433 0 355876 0
[pid=23294/tid=23296] ppid=23292 vsize=1425248 CPUtime=520.75 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214698 0 0 0 51934 141 0 0 20 0 3 0 285841221 1459453952 334881 33554432000 4194304 5964478 140734673121088 139814862977016 4399985 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1425248 CPUtime=520.8 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 118676 0 0 0 51959 121 0 0 20 0 3 0 285841221 1459453952 334881 33554432000 4194304 5964478 140734673121088 139814852487480 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1044.14
Current children cumulated vsize (KiB) 1425248

[startup+582.3 s]
/proc/loadavg: 4.02 4.00 3.91 5/183 23342
/proc/meminfo: memFree=29135704/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1491608 CPUtime=1164.08 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 341573 0 0 0 116152 256 0 0 20 0 3 0 285841220 1527406592 342015 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 372902 342015 198 433 0 372466 0
[pid=23294/tid=23296] ppid=23292 vsize=1491608 CPUtime=580.6 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214714 0 0 0 57918 142 0 0 20 0 3 0 285841221 1527406592 342015 33554432000 4194304 5964478 140734673121088 139814862977120 4400071 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1491608 CPUtime=580.6 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 125839 0 0 0 57931 129 0 0 20 0 3 0 285841221 1527406592 342015 33554432000 4194304 5964478 140734673121088 139814852487240 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.08
Current children cumulated vsize (KiB) 1491608

[startup+642.3 s]
/proc/loadavg: 4.09 4.02 3.92 5/183 23343
/proc/meminfo: memFree=29018676/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1558092 CPUtime=1284.04 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 356161 0 0 0 128134 270 0 0 20 0 3 0 285841220 1595486208 356565 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389523 356565 198 433 0 389087 0
[pid=23294/tid=23296] ppid=23292 vsize=1558092 CPUtime=640.42 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214754 0 0 0 63899 143 0 0 20 0 3 0 285841221 1595486208 356565 33554432000 4194304 5964478 140734673121088 139814862976928 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1558092 CPUtime=640.43 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 140387 0 0 0 63899 144 0 0 20 0 3 0 285841221 1595486208 356565 33554432000 4194304 5964478 140734673121088 139814852487480 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.04
Current children cumulated vsize (KiB) 1558092

[startup+702.3 s]
/proc/loadavg: 4.14 4.04 3.93 5/183 23343
/proc/meminfo: memFree=28806788/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1558448 CPUtime=1403.95 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365277 0 0 0 140114 281 0 0 20 0 3 0 285841220 1595850752 365644 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389612 365644 198 433 0 389176 0
[pid=23294/tid=23296] ppid=23292 vsize=1558448 CPUtime=700.24 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214792 0 0 0 69880 144 0 0 20 0 3 0 285841221 1595850752 365644 33554432000 4194304 5964478 140734673121088 139814862976928 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1558448 CPUtime=700.25 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149465 0 0 0 69868 157 0 0 20 0 3 0 285841221 1595850752 365644 33554432000 4194304 5964478 140734673121088 139814852487584 4379280 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1403.95
Current children cumulated vsize (KiB) 1558448

[startup+762.307 s]
/proc/loadavg: 4.13 4.05 3.94 5/183 23343
/proc/meminfo: memFree=28661364/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1558448 CPUtime=1523.91 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365358 0 0 0 152109 282 0 0 20 0 3 0 285841220 1595850752 365682 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389612 365682 198 433 0 389176 0
[pid=23294/tid=23296] ppid=23292 vsize=1558448 CPUtime=760.07 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214840 0 0 0 75862 145 0 0 20 0 3 0 285841221 1595850752 365682 33554432000 4194304 5964478 140734673121088 139814862976928 4400060 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1558448 CPUtime=760.06 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149498 0 0 0 75848 158 0 0 20 0 3 0 285841221 1595850752 365682 33554432000 4194304 5964478 140734673121088 139814852487584 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1523.91
Current children cumulated vsize (KiB) 1558448

[startup+822.3 s]
/proc/loadavg: 4.05 4.04 3.94 5/183 23343
/proc/meminfo: memFree=28501060/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1558592 CPUtime=1643.83 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365450 0 0 0 164101 282 0 0 20 0 3 0 285841220 1595998208 365731 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389648 365731 198 433 0 389212 0
[pid=23294/tid=23296] ppid=23292 vsize=1558592 CPUtime=819.9 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214876 0 0 0 81844 146 0 0 20 0 3 0 285841221 1595998208 365731 33554432000 4194304 5964478 140734673121088 139814862976928 4400062 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1558592 CPUtime=819.86 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149554 0 0 0 81827 159 0 0 20 0 3 0 285841221 1595998208 365731 33554432000 4194304 5964478 140734673121088 139814852487240 4400081 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1643.83
Current children cumulated vsize (KiB) 1558592

[startup+882.3 s]
/proc/loadavg: 4.02 4.03 3.94 5/184 23346
/proc/meminfo: memFree=28419520/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1559304 CPUtime=1763.78 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365645 0 0 0 176096 282 0 0 20 0 3 0 285841220 1596727296 365902 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389826 365902 198 433 0 389390 0
[pid=23294/tid=23296] ppid=23292 vsize=1559304 CPUtime=879.72 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214916 0 0 0 87825 147 0 0 20 0 3 0 285841221 1596727296 365902 33554432000 4194304 5964478 140734673121088 139814862976928 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1559304 CPUtime=879.7 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149709 0 0 0 87810 160 0 0 20 0 3 0 285841221 1596727296 365902 33554432000 4194304 5964478 140734673121088 139814852487240 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1763.78
Current children cumulated vsize (KiB) 1559304



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.5 s]
/proc/loadavg: 4.01 4.02 3.94 5/184 23346
/proc/meminfo: memFree=28423984/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1559516 CPUtime=1800.18 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365691 0 0 0 179736 282 0 0 20 0 3 0 285841220 1596944384 365948 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389879 365948 198 433 0 389443 0
[pid=23294/tid=23296] ppid=23292 vsize=1559516 CPUtime=897.88 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214921 0 0 0 89641 147 0 0 20 0 3 0 285841221 1596944384 365948 33554432000 4194304 5964478 140734673121088 139814862976928 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1559516 CPUtime=897.86 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149750 0 0 0 89626 160 0 0 20 0 3 0 285841221 1596944384 365948 33554432000 4194304 5964478 140734673121088 139814852487240 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 1559516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.5 s]
/proc/loadavg: 4.01 4.02 3.94 5/184 23346
/proc/meminfo: memFree=28423984/32873844 swapFree=7112/7112
[pid=23294] ppid=23292 vsize=1559516 CPUtime=1800.18 cores=1,3,5,7
/proc/23294/stat : 23294 (pwbo2.01) S 23292 23294 22874 0 -1 4202496 365691 0 0 0 179736 282 0 0 20 0 3 0 285841220 1596944384 365948 33554432000 4194304 5964478 140734673121088 140734673120608 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/23294/statm: 389879 365948 198 433 0 389443 0
[pid=23294/tid=23296] ppid=23292 vsize=1559516 CPUtime=897.88 cores=1,3,5,7
/proc/23294/task/23296/stat : 23296 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 214921 0 0 0 89641 147 0 0 20 0 3 0 285841221 1596944384 365948 33554432000 4194304 5964478 140734673121088 139814862976928 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=23294/tid=23297] ppid=23292 vsize=1559516 CPUtime=897.86 cores=1,3,5,7
/proc/23294/task/23297/stat : 23297 (pwbo2.01) R 23292 23294 22874 0 -1 4202560 149750 0 0 0 89626 160 0 0 20 0 3 0 285841221 1596944384 365948 33554432000 4194304 5964478 140734673121088 139814852487240 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 1559516

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23294 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=686470
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=130524
# CPU time returned by wait4() is 1795.82
# while last known CPU time is 1800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.548
CPU time (s): 1800.18
CPU user time (s): 1797.36
CPU system time (s): 2.82
CPU usage (%): 199.898
Max. virtual memory (cumulated for all children) (KiB): 1559516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.69
system time used= 3.13052
maximum resident set size= 1463796
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365692
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1173
involuntary context switches= 2191

runsolver used 1.92971 second user time and 5.57615 second system time

The end

Launcher Data 

Begin job on node132 at 2012-05-28 11:25:59
IDJOB=3712481
IDBENCH=78946
IDSOLVER=2292
FILE ID=node132/3712481-1338197159
RUNJOBID= node132-1338194011-22891
PBS_JOBID= 14624592
Free space on /tmp= 71632 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900576927--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712481-1338197159/watcher-3712481-1338197159 -o /tmp/evaluation-result-3712481-1338197159/solver-3712481-1338197159 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712481-1338197159.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b0bcd9e760e7f0ffa9653d41066a148b
RANDOM SEED=1249389948

node132.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30620728 kB
Buffers:          460952 kB
Cached:           202788 kB
SwapCached:         2284 kB
Active:          1196364 kB
Inactive:         165320 kB
Active(anon):     689972 kB
Inactive(anon):     8148 kB
Active(file):     506392 kB
Inactive(file):   157172 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67103740 kB
Dirty:              5444 kB
Writeback:             0 kB
AnonPages:        700896 kB
Mapped:            11800 kB
Shmem:                 8 kB
Slab:             750324 kB
SReclaimable:     191908 kB
SUnreclaim:       558416 kB
KernelStack:        1520 kB
PageTables:         5392 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     174592 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:    471040 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71628 MiB
End job on node132 at 2012-05-28 11:41:01