Trace number 3712739

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01OPTIMUM 1339.56 670.118

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900562192--soft-0-100-0.wbo
MD5SUMdb6ee27e0a2875f2e81d96fef92170ce
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark29.2146
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 135641
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 135640
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 765
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712739-1338203146.wbo.
0.00/0.00	c Instance file HOME/instance-3712739-1338203146.wbo
0.00/0.00	c File size is 96780 bytes.
0.00/0.01	c Highest Coefficient sum: 765
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2938                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 23                                                  |
0.00/0.01	c |                                                                             |
0.00/0.02	c |  Problem Type:          Optimization                                        |
0.00/0.02	c |  Objective Function:    PB Constraint                                       |
0.00/0.02	c |                                                                             |
0.00/0.02	c ===============================================================================
1339.56/670.02	o 564
1339.56/670.02	o 371
1339.56/670.02	o 355
1339.56/670.02	o 335
1339.56/670.02	o 326
1339.56/670.02	o 282
1339.56/670.02	o 280
1339.56/670.02	o 266
1339.56/670.02	o 253
1339.56/670.02	o 243
1339.56/670.02	o 231
1339.56/670.02	o 202
1339.56/670.02	o 201
1339.56/670.02	o 197
1339.56/670.02	o 192
1339.56/670.02	o 175
1339.56/670.02	o 168
1339.56/670.02	o 159
1339.56/670.02	o 153
1339.56/670.02	o 139
1339.56/670.02	o 135
1339.56/670.02	o 134
1339.56/670.02	o 124
1339.56/670.02	o 115
1339.56/670.02	o 102
1339.56/670.02	o 96
1339.56/670.02	o 94
1339.56/670.02	o 79
1339.56/670.02	o 66
1339.56/670.02	o 65
1339.56/670.02	o 51
1339.56/670.02	o 48
1339.56/670.02	o 44
1339.56/670.02	o 42
1339.56/670.02	o 41
1339.56/670.02	o 39
1339.56/670.02	o 29
1339.56/670.02	o 27
1339.56/670.02	o 23
1339.56/670.02	o 21
1339.56/670.02	o 10
1339.56/670.02	o 4
1339.56/670.02	o 2
1339.56/670.02	o 1
1339.56/670.02	c ===============================================================================
1339.56/670.02	c Wall Clock Time: 670.02 s
1339.56/670.02	c Best Solution: 1
1339.56/670.02	s OPTIMUM FOUND
1339.56/670.02	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 x20 x21 -x22 -x23 -x24 x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 x86 -x87 -x88 -x89 x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 -x152 -x153 -x154 -x155 -x156 x157 -x158 -x159 -x160 -x161 -x162 -x163 x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 x186 -x187 -x188 -x189 -x190 -x191 -x192 x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 x221 -x222 -x223 -x224 -x225 -x226 x227 -x228 -x229 -x230 -x231

Verifier Data

OK	1

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712739-1338203146/watcher-3712739-1338203146 -o /tmp/evaluation-result-3712739-1338203146/solver-3712739-1338203146 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712739-1338203146.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.04 4.03 3.99 4/178 22551
/proc/meminfo: memFree=30883076/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=4432 CPUtime=0 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) R 22549 22551 20249 0 -1 4202496 403 0 0 0 0 0 0 0 20 0 1 0 286439161 4538368 356 33554432000 4194304 5964478 140737271916352 140737271914600 4395183 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 1108 356 164 433 0 648 0

[startup+0.096623 s]
/proc/loadavg: 4.04 4.03 3.99 4/178 22551
/proc/meminfo: memFree=30883076/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=0.16 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 3515 0 0 0 16 0 0 0 20 0 3 0 286439161 168214528 2548 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 2565 198 433 0 40632 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 164272

[startup+0.100228 s]
/proc/loadavg: 4.04 4.03 3.99 4/178 22551
/proc/meminfo: memFree=30883076/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=0.17 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 3546 0 0 0 17 0 0 0 20 0 3 0 286439161 168214528 2578 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 2578 198 433 0 40632 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 164272

[startup+0.300146 s]
/proc/loadavg: 4.04 4.03 3.99 4/178 22551
/proc/meminfo: memFree=30883076/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=0.57 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 5329 0 0 0 56 1 0 0 20 0 3 0 286439161 168214528 3460 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 3460 198 433 0 40632 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 164272

[startup+0.700171 s]
/proc/loadavg: 4.04 4.03 3.99 4/178 22551
/proc/meminfo: memFree=30883076/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=1.37 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 7112 0 0 0 135 2 0 0 20 0 3 0 286439161 168214528 4638 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 4638 198 433 0 40632 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 164272

[startup+1.50037 s]
/proc/loadavg: 4.04 4.03 3.99 5/181 22554
/proc/meminfo: memFree=30853812/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=2.96 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 8843 0 0 0 293 3 0 0 20 0 3 0 286439161 168214528 5967 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 5967 198 433 0 40632 0
[pid=22551/tid=22553] ppid=22549 vsize=164272 CPUtime=1.46 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 3041 0 0 0 143 3 0 0 20 0 3 0 286439162 168214528 5967 33554432000 4194304 5964478 140737271916352 140540772513832 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=164272 CPUtime=1.47 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 4712 0 0 0 147 0 0 0 20 0 3 0 286439162 168214528 5967 33554432000 4194304 5964478 140737271916352 140540762024600 4403701 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 164272

[startup+3.10036 s]
/proc/loadavg: 4.04 4.03 3.99 5/181 22554
/proc/meminfo: memFree=30831708/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164272 CPUtime=6.15 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 13090 0 0 0 606 9 0 0 20 0 3 0 286439161 168214528 10002 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41068 10002 198 433 0 40632 0
[pid=22551/tid=22553] ppid=22549 vsize=164272 CPUtime=3.05 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 6741 0 0 0 296 9 0 0 20 0 3 0 286439162 168214528 10002 33554432000 4194304 5964478 140737271916352 140540772513784 4400099 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=164272 CPUtime=3.06 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 5259 0 0 0 306 0 0 0 20 0 3 0 286439162 168214528 10002 33554432000 4194304 5964478 140737271916352 140540762024456 4403676 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 164272

[startup+6.30037 s]
/proc/loadavg: 4.04 4.03 3.99 5/181 22554
/proc/meminfo: memFree=30755324/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=164404 CPUtime=12.55 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 18110 0 0 0 1238 17 0 0 20 0 3 0 286439161 168349696 14754 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 41101 14754 198 433 0 40665 0
[pid=22551/tid=22553] ppid=22549 vsize=164404 CPUtime=6.24 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 10476 0 0 0 608 16 0 0 20 0 3 0 286439162 168349696 14754 33554432000 4194304 5964478 140737271916352 140540772513784 4388293 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=164404 CPUtime=6.26 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 6544 0 0 0 626 0 0 0 20 0 3 0 286439162 168349696 14754 33554432000 4194304 5964478 140737271916352 140540762024232 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 164404

[startup+12.7004 s]
/proc/loadavg: 4.11 4.05 3.99 5/181 22554
/proc/meminfo: memFree=30664928/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=230608 CPUtime=25.36 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 31336 0 0 0 2503 33 0 0 20 0 3 0 286439161 236142592 27866 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 57652 27866 198 433 0 57216 0
[pid=22551/tid=22553] ppid=22549 vsize=230608 CPUtime=12.63 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 20102 0 0 0 1232 31 0 0 20 0 3 0 286439162 236142592 27866 33554432000 4194304 5964478 140737271916352 140540772513784 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=230608 CPUtime=12.64 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 10144 0 0 0 1263 1 0 0 20 0 3 0 286439162 236142592 27866 33554432000 4194304 5964478 140737271916352 140540762024248 4399990 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 230608

[startup+25.5004 s]
/proc/loadavg: 4.09 4.05 3.99 5/181 22554
/proc/meminfo: memFree=30443264/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=362912 CPUtime=50.95 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 64585 0 0 0 5043 52 0 0 20 0 3 0 286439161 371621888 61115 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 90728 61115 198 433 0 90292 0
[pid=22551/tid=22553] ppid=22549 vsize=362912 CPUtime=25.39 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 37277 0 0 0 2493 46 0 0 20 0 3 0 286439162 371621888 61115 33554432000 4194304 5964478 140737271916352 140540772513784 4400406 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=362912 CPUtime=25.4 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 26218 0 0 0 2535 5 0 0 20 0 3 0 286439162 371621888 61115 33554432000 4194304 5964478 140737271916352 140540762024248 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 362912

[startup+51.1003 s]
/proc/loadavg: 4.06 4.04 3.99 5/181 22554
/proc/meminfo: memFree=30210236/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=495436 CPUtime=102.14 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 92348 0 0 0 10146 68 0 0 20 0 3 0 286439161 507326464 88740 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 123859 88740 198 433 0 123423 0
[pid=22551/tid=22553] ppid=22549 vsize=495436 CPUtime=50.93 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 53064 0 0 0 5037 56 0 0 20 0 3 0 286439162 507326464 88740 33554432000 4194304 5964478 140737271916352 140540772513784 4220672 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=495436 CPUtime=50.94 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 38194 0 0 0 5083 11 0 0 20 0 3 0 286439162 507326464 88740 33554432000 4194304 5964478 140737271916352 140540762024008 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 495436

[startup+102.307 s]
/proc/loadavg: 4.02 4.03 3.99 5/181 22555
/proc/meminfo: memFree=29760020/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=759724 CPUtime=204.54 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 162705 0 0 0 20341 113 0 0 20 0 3 0 286439161 777957376 159059 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 189931 159059 198 433 0 189495 0
[pid=22551/tid=22553] ppid=22549 vsize=759724 CPUtime=102 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 85504 0 0 0 10131 69 0 0 20 0 3 0 286439162 777957376 159059 33554432000 4194304 5964478 140737271916352 140540772513888 4399904 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=759724 CPUtime=102.02 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 76111 0 0 0 10157 45 0 0 20 0 3 0 286439162 777957376 159059 33554432000 4194304 5964478 140737271916352 140540762024280 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 759724

[startup+162.3 s]
/proc/loadavg: 4.04 4.04 4.00 5/181 22555
/proc/meminfo: memFree=29286244/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=891980 CPUtime=324.5 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 198055 0 0 0 32325 125 0 0 20 0 3 0 286439161 913387520 194103 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 222995 194103 198 433 0 222559 0
[pid=22551/tid=22553] ppid=22549 vsize=891980 CPUtime=161.84 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 107408 0 0 0 16107 77 0 0 20 0 3 0 286439162 913387520 194103 33554432000 4194304 5964478 140737271916352 140540772513784 4400087 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=891980 CPUtime=161.85 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 89557 0 0 0 16134 51 0 0 20 0 3 0 286439162 913387520 194103 33554432000 4194304 5964478 140737271916352 140540762024280 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 891980

[startup+222.3 s]
/proc/loadavg: 4.01 4.03 4.00 5/181 22555
/proc/meminfo: memFree=28888884/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=1155212 CPUtime=444.48 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 268413 0 0 0 44291 157 0 0 20 0 3 0 286439161 1182937088 264846 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 288803 264846 198 433 0 288367 0
[pid=22551/tid=22553] ppid=22549 vsize=1155212 CPUtime=221.68 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 148817 0 0 0 22070 98 0 0 20 0 3 0 286439162 1182937088 264846 33554432000 4194304 5964478 140737271916352 140540772513784 4399904 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=1155212 CPUtime=221.7 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 118506 0 0 0 22106 64 0 0 20 0 3 0 286439162 1182937088 264846 33554432000 4194304 5964478 140737271916352 140540762024248 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.48
Current children cumulated vsize (KiB) 1155212

[startup+282.3 s]
/proc/loadavg: 4.00 4.02 4.00 5/182 22558
/proc/meminfo: memFree=28763680/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=1286664 CPUtime=564.44 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 300046 0 0 0 56269 175 0 0 20 0 3 0 286439161 1317543936 295759 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 321666 295759 198 433 0 321230 0
[pid=22551/tid=22553] ppid=22549 vsize=1286664 CPUtime=281.51 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 180347 0 0 0 28035 116 0 0 20 0 3 0 286439162 1317543936 295759 33554432000 4194304 5964478 140737271916352 140540772513784 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=1286664 CPUtime=281.54 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 118609 0 0 0 28088 66 0 0 20 0 3 0 286439162 1317543936 295759 33554432000 4194304 5964478 140737271916352 140540762024280 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.44
Current children cumulated vsize (KiB) 1286664

[startup+342.3 s]
/proc/loadavg: 4.00 4.01 4.00 5/181 22558
/proc/meminfo: memFree=28618000/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=1352532 CPUtime=684.41 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 303393 0 0 0 68265 176 0 0 20 0 3 0 286439161 1384992768 299585 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 338133 299585 198 433 0 337697 0

################
# More data... #
################

[pid=22551] ppid=22549 vsize=1814120 CPUtime=1164.23 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 424324 0 0 0 116180 243 0 0 20 0 3 0 286439161 1857658880 420164 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 453530 420164 198 433 0 453094 0
[pid=22551/tid=22553] ppid=22549 vsize=1814120 CPUtime=580.65 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 264099 0 0 0 57898 167 0 0 20 0 3 0 286439162 1857658880 420164 33554432000 4194304 5964478 140737271916352 140540772513784 4400087 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=1814120 CPUtime=580.73 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 159135 0 0 0 57982 91 0 0 20 0 3 0 286439162 1857658880 420164 33554432000 4194304 5964478 140737271916352 140540762024248 4400008 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.23
Current children cumulated vsize (KiB) 1814120

[startup+642.3 s]
/proc/loadavg: 4.03 4.01 4.00 5/181 22559
/proc/meminfo: memFree=27592908/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=1880512 CPUtime=1284.18 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 450142 0 0 0 128160 258 0 0 20 0 3 0 286439161 1925644288 445938 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 470128 445938 198 433 0 469692 0
[pid=22551/tid=22553] ppid=22549 vsize=1880512 CPUtime=640.5 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 289683 0 0 0 63866 184 0 0 20 0 3 0 286439162 1925644288 445938 33554432000 4194304 5964478 140737271916352 140540772513784 4400099 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=1880512 CPUtime=640.55 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 159369 0 0 0 63963 92 0 0 20 0 3 0 286439162 1925644288 445938 33554432000 4194304 5964478 140737271916352 140540762024008 4399880 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.18
Current children cumulated vsize (KiB) 1880512

############
# WARNING:
# current cumulated CPU time (1338.05 s) is less than in the last sample (1339.56 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (1.50989 s) to the 'lost time'.

[startup+670 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27457716/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1339.56 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 480215 0 0 0 133683 273 0 0 20 0 3 0 286439161 2059862016 476001 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 476001 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=668.12 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 304114 0 0 0 66619 193 0 0 20 0 3 0 286439162 2059862016 476001 33554432000 4194304 5964478 140737271916352 140540772513592 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=668.16 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175011 0 0 0 66716 100 0 0 20 0 3 0 286439162 2059862016 476001 33554432000 4194304 5964478 140737271916352 140540762024248 4400040 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1339.56
Current children cumulated vsize (KiB) 2011584

[startup+670.1 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27457716/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=0 CPUtime=1338.05 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) Z 22549 22551 20249 0 -1 4203532 480246 0 0 0 133514 291 0 0 20 0 2 0 286439161 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 0 0 0 0 0 0 0
[pid=22551/tid=22553] ppid=22549 vsize=0 CPUtime=668.22 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4203588 304140 0 0 0 66622 200 0 0 20 0 2 0 286439162 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1338.05
Current children cumulated vsize (KiB) 0
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+652.7 s]
/proc/loadavg: 4.03 4.01 4.00 5/181 22559
/proc/meminfo: memFree=27548996/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=1880512 CPUtime=1304.96 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 462040 0 0 0 130232 264 0 0 20 0 3 0 286439161 1925644288 457830 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 470128 457830 198 433 0 469692 0
[pid=22551/tid=22553] ppid=22549 vsize=1880512 CPUtime=650.86 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 294231 0 0 0 64899 187 0 0 20 0 3 0 286439162 1925644288 457830 33554432000 4194304 5964478 140737271916352 140540772513784 4400040 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=1880512 CPUtime=650.91 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 166719 0 0 0 64996 95 0 0 20 0 3 0 286439162 1925644288 457830 33554432000 4194304 5964478 140737271916352 140540762024248 4400040 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1304.96
Current children cumulated vsize (KiB) 1880512

[startup+659.1 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22559
/proc/meminfo: memFree=27491584/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1317.76 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 473092 0 0 0 131507 269 0 0 20 0 3 0 286439161 2059862016 468882 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 468882 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=657.24 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 296995 0 0 0 65537 187 0 0 20 0 3 0 286439162 2059862016 468882 33554432000 4194304 5964478 140737271916352 140540772513784 4220672 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=657.29 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175007 0 0 0 65630 99 0 0 20 0 3 0 286439162 2059862016 468882 33554432000 4194304 5964478 140737271916352 140540762024248 4379295 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1317.76
Current children cumulated vsize (KiB) 2011584

[startup+665.507 s]
/proc/loadavg: 4.02 4.01 4.00 5/180 22559
/proc/meminfo: memFree=27469008/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1330.57 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 477368 0 0 0 132786 271 0 0 20 0 3 0 286439161 2059862016 473154 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 473154 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=663.63 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 301267 0 0 0 66172 191 0 0 20 0 3 0 286439162 2059862016 473154 33554432000 4194304 5964478 140737271916352 140540772513784 4400000 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=663.68 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175011 0 0 0 66268 100 0 0 20 0 3 0 286439162 2059862016 473154 33554432000 4194304 5964478 140737271916352 140540762024248 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1330.57
Current children cumulated vsize (KiB) 2011584

[startup+668.7 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27460320/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1336.97 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 479470 0 0 0 133424 273 0 0 20 0 3 0 286439161 2059862016 475256 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 475259 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=666.83 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 303372 0 0 0 66491 192 0 0 20 0 3 0 286439162 2059862016 475259 33554432000 4194304 5964478 140737271916352 140540772513784 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=666.87 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175011 0 0 0 66587 100 0 0 20 0 3 0 286439162 2059862016 475259 33554432000 4194304 5964478 140737271916352 140540762024248 4388767 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1336.97
Current children cumulated vsize (KiB) 2011584

[startup+669.5 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27460320/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1338.56 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 479919 0 0 0 133583 273 0 0 20 0 3 0 286439161 2059862016 475705 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 475705 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=667.62 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 303818 0 0 0 66569 193 0 0 20 0 3 0 286439162 2059862016 475705 33554432000 4194304 5964478 140737271916352 140540772513592 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=667.66 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175011 0 0 0 66666 100 0 0 20 0 3 0 286439162 2059862016 475705 33554432000 4194304 5964478 140737271916352 140540762024248 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1338.56
Current children cumulated vsize (KiB) 2011584

[startup+669.907 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27457716/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=2011584 CPUtime=1339.37 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) S 22549 22551 20249 0 -1 4202496 480131 0 0 0 133664 273 0 0 20 0 3 0 286439161 2059862016 475917 33554432000 4194304 5964478 140737271916352 140737271915872 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 502896 475917 198 433 0 502460 0
[pid=22551/tid=22553] ppid=22549 vsize=2011584 CPUtime=668.02 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 304030 0 0 0 66609 193 0 0 20 0 3 0 286439162 2059862016 475917 33554432000 4194304 5964478 140737271916352 140540772513592 4400051 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=22551/tid=22554] ppid=22549 vsize=2011584 CPUtime=668.07 cores=1,3,5,7
/proc/22551/task/22554/stat : 22554 (pwbo2.01) R 22549 22551 20249 0 -1 4202560 175011 0 0 0 66707 100 0 0 20 0 3 0 286439162 2059862016 475917 33554432000 4194304 5964478 140737271916352 140540762024248 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1339.37
Current children cumulated vsize (KiB) 2011584

[startup+670.1 s]
/proc/loadavg: 4.02 4.01 4.00 5/181 22560
/proc/meminfo: memFree=27457716/32873844 swapFree=6080/6080
[pid=22551] ppid=22549 vsize=0 CPUtime=1338.05 cores=1,3,5,7
/proc/22551/stat : 22551 (pwbo2.01) Z 22549 22551 20249 0 -1 4203532 480246 0 0 0 133514 291 0 0 20 0 2 0 286439161 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22551/statm: 0 0 0 0 0 0 0
[pid=22551/tid=22553] ppid=22549 vsize=0 CPUtime=668.22 cores=1,3,5,7
/proc/22551/task/22553/stat : 22553 (pwbo2.01) R 22549 22551 20249 0 -1 4203588 304140 0 0 0 66622 200 0 0 20 0 2 0 286439162 0 0 33554432000 0 0 0 0 0 0 0 4096 16387 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1338.05
Current children cumulated vsize (KiB) 0

Child status: 255

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22551 and gives
#  childrusage.ru_utime.tv_sec=1333
#  childrusage.ru_utime.tv_usec=424288
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=32538
# CPU time returned by wait4() is 1336.46
# while last known CPU time is 1338.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 1.50989
#  lost CPU user time (s): 1.68994
#  lost CPU system time (s): -0.18

Real time (s): 670.118
CPU time (s): 1339.56
CPU user time (s): 1336.83
CPU system time (s): 2.73
CPU usage (%): 199.899
Max. virtual memory (cumulated for all children) (KiB): 2011584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1333.42
system time used= 3.03254
maximum resident set size= 1904128
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 480246
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 969
involuntary context switches= 1874

runsolver used 1.3028 second user time and 3.49547 second system time

The end

Launcher Data

Begin job on node139 at 2012-05-28 13:05:46
IDJOB=3712739
IDBENCH=79266
IDSOLVER=2292
FILE ID=node139/3712739-1338203146
RUNJOBID= node139-1338192730-20266
PBS_JOBID= 14624580
Free space on /tmp= 71648 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900562192--soft-0-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712739-1338203146/watcher-3712739-1338203146 -o /tmp/evaluation-result-3712739-1338203146/solver-3712739-1338203146 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712739-1338203146.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= db6ee27e0a2875f2e81d96fef92170ce
RANDOM SEED=1355618497

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30883612 kB
Buffers:          428136 kB
Cached:           452716 kB
SwapCached:          828 kB
Active:           931080 kB
Inactive:         205048 kB
Active(anon):     248480 kB
Inactive(anon):     7968 kB
Active(file):     682600 kB
Inactive(file):   197080 kB
Unevictable:        6080 kB
Mlocked:            6080 kB
SwapTotal:      67108856 kB
SwapFree:       67104692 kB
Dirty:             11296 kB
Writeback:             0 kB
AnonPages:        259256 kB
Mapped:            12656 kB
Shmem:                 8 kB
Slab:             716972 kB
SReclaimable:     159432 kB
SUnreclaim:       557540 kB
KernelStack:        1480 kB
PageTables:         4552 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     158352 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71640 MiB
End job on node139 at 2012-05-28 13:16:56