Trace number 3712744

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01OPTIMUM 1251.07 625.892

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900568186--soft-0-100-0.wbo
MD5SUM0bc882feda752f8542fa470cf04f3d53
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark46.3949
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 137245
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 137244
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 721
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712744-1338203998.wbo.
0.00/0.00	c Instance file HOME/instance-3712744-1338203998.wbo
0.00/0.00	c File size is 96755 bytes.
0.00/0.01	c Highest Coefficient sum: 721
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      2938                                                |
0.00/0.01	c |  Number Clauses:        2684                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 23                                                  |
0.00/0.01	c |                                                                             |
0.00/0.02	c |  Problem Type:          Optimization                                        |
0.00/0.02	c |  Objective Function:    PB Constraint                                       |
0.00/0.02	c |                                                                             |
0.00/0.02	c ===============================================================================
1251.07/625.81	o 376
1251.07/625.81	o 331
1251.07/625.81	o 282
1251.07/625.81	o 263
1251.07/625.81	o 248
1251.07/625.81	o 240
1251.07/625.81	o 238
1251.07/625.81	o 228
1251.07/625.81	o 222
1251.07/625.81	o 220
1251.07/625.81	o 211
1251.07/625.81	o 194
1251.07/625.81	o 179
1251.07/625.81	o 160
1251.07/625.81	o 138
1251.07/625.81	o 133
1251.07/625.81	o 122
1251.07/625.81	o 116
1251.07/625.81	o 108
1251.07/625.81	o 107
1251.07/625.81	o 106
1251.07/625.81	o 105
1251.07/625.81	o 100
1251.07/625.81	o 95
1251.07/625.81	o 89
1251.07/625.81	o 87
1251.07/625.81	o 84
1251.07/625.81	o 79
1251.07/625.81	o 77
1251.07/625.81	o 72
1251.07/625.81	o 65
1251.07/625.81	o 53
1251.07/625.81	o 51
1251.07/625.81	o 35
1251.07/625.81	o 33
1251.07/625.81	o 18
1251.07/625.81	o 16
1251.07/625.81	o 12
1251.07/625.81	o 10
1251.07/625.81	o 7
1251.07/625.81	o 6
1251.07/625.81	o 3
1251.07/625.81	c ===============================================================================
1251.07/625.81	c Wall Clock Time: 625.82 s
1251.07/625.81	c Best Solution: 3
1251.07/625.81	s OPTIMUM FOUND
1251.07/625.81	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 x13 -x14 -x15 -x16 -x17 x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 x150 -x151 -x152 x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 x186 -x187 -x188 -x189 -x190 -x191 x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231

Verifier Data 

OK	3

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712744-1338203998/watcher-3712744-1338203998 -o /tmp/evaluation-result-3712744-1338203998/solver-3712744-1338203998 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712744-1338203998.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.01 4.01 4.00 4/180 24692
/proc/meminfo: memFree=29467504/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=4432 CPUtime=0 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) R 24690 24692 22874 0 -1 4202496 411 0 0 0 0 0 0 0 20 0 1 0 286525134 4538368 365 33554432000 4194304 5964478 140737486913632 140734954481032 4395183 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 1108 365 167 433 0 648 0

[startup+0.0901179 s]
/proc/loadavg: 4.01 4.01 4.00 4/180 24692
/proc/meminfo: memFree=29467504/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=0.15 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 2966 0 0 0 15 0 0 0 20 0 3 0 286525134 168214528 2379 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 2379 198 433 0 40632 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 164272

[startup+0.100184 s]
/proc/loadavg: 4.01 4.01 4.00 4/180 24692
/proc/meminfo: memFree=29467504/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=0.17 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 3026 0 0 0 17 0 0 0 20 0 3 0 286525134 168214528 2439 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 2439 198 433 0 40632 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 164272

[startup+0.300119 s]
/proc/loadavg: 4.01 4.01 4.00 4/180 24692
/proc/meminfo: memFree=29467504/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=0.57 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 3668 0 0 0 56 1 0 0 20 0 3 0 286525134 168214528 2979 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 2979 198 433 0 40632 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 164272

[startup+0.700138 s]
/proc/loadavg: 4.01 4.01 4.00 4/180 24692
/proc/meminfo: memFree=29467504/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=1.37 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 5553 0 0 0 134 3 0 0 20 0 3 0 286525134 168214528 4154 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 4154 198 433 0 40632 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 164272

[startup+1.5003 s]
/proc/loadavg: 4.01 4.01 4.00 5/183 24695
/proc/meminfo: memFree=29447848/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=2.97 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 7839 0 0 0 292 5 0 0 20 0 3 0 286525134 168214528 6335 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 6335 198 433 0 40632 0
[pid=24692/tid=24694] ppid=24690 vsize=164272 CPUtime=1.47 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 3928 0 0 0 143 4 0 0 20 0 3 0 286525135 168214528 6335 33554432000 4194304 5964478 140737486913632 140613414975480 4379280 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=164272 CPUtime=1.46 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 2820 0 0 0 146 0 0 0 20 0 3 0 286525135 168214528 6335 33554432000 4194304 5964478 140737486913632 140613404486296 4389140 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 164272

[startup+3.10032 s]
/proc/loadavg: 4.01 4.01 4.00 5/183 24695
/proc/meminfo: memFree=29438424/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=6.16 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 10361 0 0 0 611 5 0 0 20 0 3 0 286525134 168214528 8243 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 8243 198 433 0 40632 0
[pid=24692/tid=24694] ppid=24690 vsize=164272 CPUtime=3.06 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 5699 0 0 0 301 5 0 0 20 0 3 0 286525135 168214528 8243 33554432000 4194304 5964478 140737486913632 140613414975480 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=164272 CPUtime=3.05 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 3571 0 0 0 305 0 0 0 20 0 3 0 286525135 168214528 8243 33554432000 4194304 5964478 140737486913632 140613404486152 4403648 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 164272

[startup+6.30033 s]
/proc/loadavg: 4.01 4.01 4.00 5/184 24698
/proc/meminfo: memFree=29404260/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=164272 CPUtime=12.57 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 18305 0 0 0 1249 8 0 0 20 0 3 0 286525134 168214528 15443 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 41068 15443 198 433 0 40632 0
[pid=24692/tid=24694] ppid=24690 vsize=164272 CPUtime=6.26 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 12362 0 0 0 619 7 0 0 20 0 3 0 286525135 168214528 15443 33554432000 4194304 5964478 140737486913632 140613414975288 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=164272 CPUtime=6.24 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 4852 0 0 0 624 0 0 0 20 0 3 0 286525135 168214528 15443 33554432000 4194304 5964478 140737486913632 140613404486152 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 164272

[startup+12.7003 s]
/proc/loadavg: 4.08 4.02 4.00 5/184 24698
/proc/meminfo: memFree=29340928/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=230204 CPUtime=25.36 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 31073 0 0 0 2525 11 0 0 20 0 3 0 286525134 235728896 28102 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 57551 28102 198 433 0 57115 0
[pid=24692/tid=24694] ppid=24690 vsize=230204 CPUtime=12.64 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 23134 0 0 0 1254 10 0 0 20 0 3 0 286525135 235728896 28102 33554432000 4194304 5964478 140737486913632 140613414975480 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=230204 CPUtime=12.63 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 6848 0 0 0 1262 1 0 0 20 0 3 0 286525135 235728896 28102 33554432000 4194304 5964478 140737486913632 140613404485944 4403701 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 230204

[startup+25.5004 s]
/proc/loadavg: 4.07 4.02 4.00 5/184 24698
/proc/meminfo: memFree=29231188/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=296284 CPUtime=50.96 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 48739 0 0 0 5077 19 0 0 20 0 3 0 286525134 303394816 45443 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 74071 45443 198 433 0 73635 0
[pid=24692/tid=24694] ppid=24690 vsize=296284 CPUtime=25.41 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 36573 0 0 0 2526 15 0 0 20 0 3 0 286525135 303394816 45443 33554432000 4194304 5964478 140737486913632 140613414975480 4400099 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=296284 CPUtime=25.4 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 11075 0 0 0 2537 3 0 0 20 0 3 0 286525135 303394816 45443 33554432000 4194304 5964478 140737486913632 140613404486296 4388276 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 296284

[startup+51.1004 s]
/proc/loadavg: 4.04 4.02 4.00 5/184 24698
/proc/meminfo: memFree=28980784/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=429096 CPUtime=102.14 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 82058 0 0 0 10187 27 0 0 20 0 3 0 286525134 439394304 78711 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 107274 78711 198 433 0 106838 0
[pid=24692/tid=24694] ppid=24690 vsize=429096 CPUtime=50.94 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 60141 0 0 0 5072 22 0 0 20 0 3 0 286525135 439394304 78711 33554432000 4194304 5964478 140737486913632 140613414975480 4400002 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=429096 CPUtime=50.93 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 20826 0 0 0 5088 5 0 0 20 0 3 0 286525135 439394304 78711 33554432000 4194304 5964478 140737486913632 140613404485976 4399994 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 429096

[startup+102.3 s]
/proc/loadavg: 4.02 4.01 4.00 5/183 24698
/proc/meminfo: memFree=28692792/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=562208 CPUtime=204.55 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 122475 0 0 0 20415 40 0 0 20 0 3 0 286525134 575700992 119128 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 140552 119128 198 433 0 140116 0
[pid=24692/tid=24694] ppid=24690 vsize=562208 CPUtime=102.02 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 74492 0 0 0 10175 27 0 0 20 0 3 0 286525135 575700992 119128 33554432000 4194304 5964478 140737486913632 140613414975392 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=562208 CPUtime=102.01 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 46892 0 0 0 10187 14 0 0 20 0 3 0 286525135 575700992 119128 33554432000 4194304 5964478 140737486913632 140613404486048 4389144 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.55
Current children cumulated vsize (KiB) 562208

[startup+162.3 s]
/proc/loadavg: 4.00 4.01 4.00 5/183 24739
/proc/meminfo: memFree=30285624/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=825564 CPUtime=324.5 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 191276 0 0 0 32383 67 0 0 20 0 3 0 286525134 845377536 187937 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 206391 187937 198 433 0 205955 0
[pid=24692/tid=24694] ppid=24690 vsize=825564 CPUtime=161.85 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 122565 0 0 0 16137 48 0 0 20 0 3 0 286525135 845377536 187937 33554432000 4194304 5964478 140737486913632 140613414975480 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=825564 CPUtime=161.84 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 67620 0 0 0 16162 22 0 0 20 0 3 0 286525135 845377536 187937 33554432000 4194304 5964478 140737486913632 140613404486048 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 825564

[startup+222.307 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24740
/proc/meminfo: memFree=29763116/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=956940 CPUtime=444.47 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 235207 0 0 0 44352 95 0 0 20 0 3 0 286525134 979906560 230781 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 239235 230781 200 433 0 238799 0
[pid=24692/tid=24694] ppid=24690 vsize=956940 CPUtime=221.7 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 147744 0 0 0 22105 65 0 0 20 0 3 0 286525135 979906560 230781 33554432000 4194304 5964478 140737486913632 140613414975392 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=956940 CPUtime=221.67 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 86372 0 0 0 22132 35 0 0 20 0 3 0 286525135 979906560 230781 33554432000 4194304 5964478 140737486913632 140613404485944 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.47
Current children cumulated vsize (KiB) 956940

[startup+282.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24740
/proc/meminfo: memFree=29611864/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1023312 CPUtime=564.43 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 248581 0 0 0 56344 99 0 0 20 0 3 0 286525134 1047871488 244173 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 255828 244173 200 433 0 255392 0
[pid=24692/tid=24694] ppid=24690 vsize=1023312 CPUtime=281.53 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 147822 0 0 0 28087 66 0 0 20 0 3 0 286525135 1047871488 244173 33554432000 4194304 5964478 140737486913632 140613414975392 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1023312 CPUtime=281.5 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 99668 0 0 0 28110 40 0 0 20 0 3 0 286525135 1047871488 244173 33554432000 4194304 5964478 140737486913632 140613404485704 4400081 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.43
Current children cumulated vsize (KiB) 1023312

[startup+342.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24740
/proc/meminfo: memFree=29305056/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1089588 CPUtime=684.37 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 266305 0 0 0 68331 106 0 0 20 0 3 0 286525134 1115738112 261861 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 272397 261861 200 433 0 271961 0

################
# More data... #
################

/proc/loadavg: 4.00 4.00 4.00 5/183 24740
/proc/meminfo: memFree=29104452/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1287616 CPUtime=804.31 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 299093 0 0 0 80313 118 0 0 20 0 3 0 286525134 1318518784 294601 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 321904 294601 200 433 0 321468 0
[pid=24692/tid=24694] ppid=24690 vsize=1287616 CPUtime=401.2 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 151957 0 0 0 40050 70 0 0 20 0 3 0 286525135 1318518784 294601 33554432000 4194304 5964478 140737486913632 140613414975480 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1287616 CPUtime=401.14 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 146045 0 0 0 40055 59 0 0 20 0 3 0 286525135 1318518784 294601 33554432000 4194304 5964478 140737486913632 140613404485944 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.31
Current children cumulated vsize (KiB) 1287616

[startup+462.3 s]
/proc/loadavg: 4.00 4.00 4.00 5/183 24740
/proc/meminfo: memFree=28938320/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1354776 CPUtime=924.24 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 328505 0 0 0 92293 131 0 0 20 0 3 0 286525134 1387290624 323948 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 338694 323948 200 433 0 338258 0
[pid=24692/tid=24694] ppid=24690 vsize=1354776 CPUtime=461.01 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 177477 0 0 0 46020 81 0 0 20 0 3 0 286525135 1387290624 323948 33554432000 4194304 5964478 140737486913632 140613414975480 4391752 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1354776 CPUtime=460.99 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 149937 0 0 0 46038 61 0 0 20 0 3 0 286525135 1387290624 323948 33554432000 4194304 5964478 140737486913632 140613404485976 4400053 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.24
Current children cumulated vsize (KiB) 1354776

[startup+522.3 s]
/proc/loadavg: 4.05 4.01 4.00 5/183 24741
/proc/meminfo: memFree=28843860/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1355188 CPUtime=1044.18 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 328667 0 0 0 104287 131 0 0 20 0 3 0 286525134 1387712512 324061 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 338797 324061 200 433 0 338361 0
[pid=24692/tid=24694] ppid=24690 vsize=1355188 CPUtime=520.81 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 177532 0 0 0 51999 82 0 0 20 0 3 0 286525135 1387712512 324061 33554432000 4194304 5964478 140737486913632 140613414975392 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1355188 CPUtime=520.83 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 150044 0 0 0 52020 63 0 0 20 0 3 0 286525135 1387712512 324061 33554432000 4194304 5964478 140737486913632 140613404485704 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.18
Current children cumulated vsize (KiB) 1355188

[startup+582.3 s]
/proc/loadavg: 4.02 4.01 4.00 5/183 24741
/proc/meminfo: memFree=28510080/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1552592 CPUtime=1164.12 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 372507 0 0 0 116262 150 0 0 20 0 3 0 286525134 1589854208 367854 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 388148 367854 200 433 0 387712 0
[pid=24692/tid=24694] ppid=24690 vsize=1552592 CPUtime=580.62 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 221212 0 0 0 57960 102 0 0 20 0 3 0 286525135 1589854208 367854 33554432000 4194304 5964478 140737486913632 140613414975480 4399922 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1552592 CPUtime=580.68 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 150204 0 0 0 58004 64 0 0 20 0 3 0 286525135 1589854208 367854 33554432000 4194304 5964478 140737486913632 140613404485704 4400040 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.12
Current children cumulated vsize (KiB) 1552592

Solver just ended. Dumping a history of the last processes samples

[startup+588.8 s]
/proc/loadavg: 4.01 4.01 4.00 5/183 24741
/proc/meminfo: memFree=28438780/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1618340 CPUtime=1177.12 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 383420 0 0 0 117557 155 0 0 20 0 3 0 286525134 1657180160 378767 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 404585 378767 200 433 0 404149 0
[pid=24692/tid=24694] ppid=24690 vsize=1618340 CPUtime=587.11 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 225677 0 0 0 58607 104 0 0 20 0 3 0 286525135 1657180160 378767 33554432000 4194304 5964478 140737486913632 140613414975480 4400075 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1618340 CPUtime=587.16 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 156652 0 0 0 58650 66 0 0 20 0 3 0 286525135 1657180160 378767 33554432000 4194304 5964478 140737486913632 140613404485944 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1177.12
Current children cumulated vsize (KiB) 1618340

[startup+601.6 s]
/proc/loadavg: 4.01 4.01 4.00 5/183 24741
/proc/meminfo: memFree=28303356/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1684208 CPUtime=1202.69 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 407262 0 0 0 120105 164 0 0 20 0 3 0 286525134 1724628992 402594 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 421052 402594 200 433 0 420616 0
[pid=24692/tid=24694] ppid=24690 vsize=1684208 CPUtime=599.86 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 237452 0 0 0 59876 110 0 0 20 0 3 0 286525135 1724628992 402594 33554432000 4194304 5964478 140737486913632 140613414975480 4399922 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1684208 CPUtime=599.92 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 168719 0 0 0 59921 71 0 0 20 0 3 0 286525135 1724628992 402594 33554432000 4194304 5964478 140737486913632 140613404485944 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1202.69
Current children cumulated vsize (KiB) 1684208

[startup+614.4 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28183036/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815492 CPUtime=1228.28 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 428439 0 0 0 122655 173 0 0 20 0 3 0 286525134 1859063808 423763 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453873 423766 200 433 0 453437 0
[pid=24692/tid=24694] ppid=24690 vsize=1815492 CPUtime=612.63 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 247306 0 0 0 61149 114 0 0 20 0 3 0 286525135 1859063808 423766 33554432000 4194304 5964478 140737486913632 140613414975480 5136474 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815492 CPUtime=612.68 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 180045 0 0 0 61192 76 0 0 20 0 3 0 286525135 1859063808 423766 33554432000 4194304 5964478 140737486913632 140613404485944 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1228.28
Current children cumulated vsize (KiB) 1815492

[startup+620.8 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28133188/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815708 CPUtime=1241.07 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 436545 0 0 0 123931 176 0 0 20 0 3 0 286525134 1859284992 431864 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453927 431864 200 433 0 453491 0
[pid=24692/tid=24694] ppid=24690 vsize=1815708 CPUtime=619.01 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 252922 0 0 0 61785 116 0 0 20 0 3 0 286525135 1859284992 431864 33554432000 4194304 5964478 140737486913632 140613414975480 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815708 CPUtime=619.06 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 182532 0 0 0 61829 77 0 0 20 0 3 0 286525135 1859284992 431864 33554432000 4194304 5964478 140737486913632 140613404485944 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1241.07
Current children cumulated vsize (KiB) 1815708

[startup+624 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28111292/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815708 CPUtime=1247.47 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 439206 0 0 0 124570 177 0 0 20 0 3 0 286525134 1859284992 434525 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453927 434525 200 433 0 453491 0
[pid=24692/tid=24694] ppid=24690 vsize=1815708 CPUtime=622.2 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 255583 0 0 0 62103 117 0 0 20 0 3 0 286525135 1859284992 434525 33554432000 4194304 5964478 140737486913632 140613414975480 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815708 CPUtime=622.25 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 182532 0 0 0 62148 77 0 0 20 0 3 0 286525135 1859284992 434525 33554432000 4194304 5964478 140737486913632 140613404485944 4400416 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1247.47
Current children cumulated vsize (KiB) 1815708

[startup+624.8 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28105340/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815708 CPUtime=1249.08 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 439762 0 0 0 124731 177 0 0 20 0 3 0 286525134 1859284992 435081 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453927 435081 200 433 0 453491 0
[pid=24692/tid=24694] ppid=24690 vsize=1815708 CPUtime=623 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 256139 0 0 0 62183 117 0 0 20 0 3 0 286525135 1859284992 435081 33554432000 4194304 5964478 140737486913632 140613414975480 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815708 CPUtime=623.05 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 182532 0 0 0 62228 77 0 0 20 0 3 0 286525135 1859284992 435081 33554432000 4194304 5964478 140737486913632 140613404485944 4391496 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1249.08
Current children cumulated vsize (KiB) 1815708

[startup+625.6 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28105340/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815708 CPUtime=1250.67 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 440188 0 0 0 124890 177 0 0 20 0 3 0 286525134 1859284992 435507 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453927 435507 200 433 0 453491 0
[pid=24692/tid=24694] ppid=24690 vsize=1815708 CPUtime=623.8 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 256565 0 0 0 62263 117 0 0 20 0 3 0 286525135 1859284992 435507 33554432000 4194304 5964478 140737486913632 140613414975480 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815708 CPUtime=623.85 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 182532 0 0 0 62308 77 0 0 20 0 3 0 286525135 1859284992 435507 33554432000 4194304 5964478 140737486913632 140613404485944 4403701 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1250.67
Current children cumulated vsize (KiB) 1815708

[startup+625.8 s]
/proc/loadavg: 4.01 4.00 4.00 5/184 24744
/proc/meminfo: memFree=28105340/32873844 swapFree=7112/7112
[pid=24692] ppid=24690 vsize=1815708 CPUtime=1251.07 cores=0,2,4,6
/proc/24692/stat : 24692 (pwbo2.01) S 24690 24692 22874 0 -1 4202496 440300 0 0 0 124930 177 0 0 20 0 3 0 286525134 1859284992 435619 33554432000 4194304 5964478 140737486913632 140737486913152 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/24692/statm: 453927 435619 200 433 0 453491 0
[pid=24692/tid=24694] ppid=24690 vsize=1815708 CPUtime=624 cores=0,2,4,6
/proc/24692/task/24694/stat : 24694 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 256677 0 0 0 62283 117 0 0 20 0 3 0 286525135 1859284992 435619 33554432000 4194304 5964478 140737486913632 140613414975480 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=24692/tid=24695] ppid=24690 vsize=1815708 CPUtime=624.05 cores=0,2,4,6
/proc/24692/task/24695/stat : 24695 (pwbo2.01) R 24690 24692 22874 0 -1 4202560 182532 0 0 0 62328 77 0 0 20 0 3 0 286525135 1859284992 435619 33554432000 4194304 5964478 140737486913632 140613404485944 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1251.07
Current children cumulated vsize (KiB) 1815708

Child status: 255

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24692 and gives
#  childrusage.ru_utime.tv_sec=1246
#  childrusage.ru_utime.tv_usec=150556
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=36690
# CPU time returned by wait4() is 1248.19
# while last known CPU time is 1251.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 625.892
CPU time (s): 1251.07
CPU user time (s): 1249.3
CPU system time (s): 1.77
CPU usage (%): 199.886
Max. virtual memory (cumulated for all children) (KiB): 1815708

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1246.15
system time used= 2.03669
maximum resident set size= 1742516
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 440310
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 931
involuntary context switches= 1369

runsolver used 1.23381 second user time and 2.76658 second system time

The end

Launcher Data 

Begin job on node132 at 2012-05-28 13:19:58
IDJOB=3712744
IDBENCH=79272
IDSOLVER=2292
FILE ID=node132/3712744-1338203998
RUNJOBID= node132-1338194011-22890
PBS_JOBID= 14624592
Free space on /tmp= 71632 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900568186--soft-0-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712744-1338203998/watcher-3712744-1338203998 -o /tmp/evaluation-result-3712744-1338203998/solver-3712744-1338203998 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712744-1338203998.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0bc882feda752f8542fa470cf04f3d53
RANDOM SEED=472718444

node132.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29467504 kB
Buffers:          464016 kB
Cached:           204732 kB
SwapCached:         2284 kB
Active:          2343644 kB
Inactive:         168596 kB
Active(anon):    1835796 kB
Inactive(anon):     8148 kB
Active(file):     507848 kB
Inactive(file):   160448 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67103740 kB
Dirty:              5460 kB
Writeback:             0 kB
AnonPages:       1846640 kB
Mapped:            11784 kB
Shmem:                 8 kB
Slab:             750528 kB
SReclaimable:     192188 kB
SUnreclaim:       558340 kB
KernelStack:        1488 kB
PageTables:         7628 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     171740 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:    538624 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71628 MiB
End job on node132 at 2012-05-28 13:30:24