Trace number 4437663

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
Hybrid-LSMabP+Exact 2024-07-11SAT84 3587.54 3596.04

General information on the benchmark

NamePB24/normalized-PB11/OPT-LIN/
heinz/normalized-go19.opb
MD5SUM51fa3ae0158cc49e421df545accb4e20
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark84
Best CPU time to get the best result obtained on this benchmark3558
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables441
Total number of constraints441
Number of constraints which are clauses361
Number of constraints which are cardinality constraints (but not clauses)80
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint5
Number of terms in the objective function 361
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 361
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 361
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

3587.47/3596.03	c Filename:instance-4437663-1722976246.opb, Cutoff_time:1798, memory_limit_gb:29976
3587.47/3596.03	c Use Presolve
3587.47/3596.03	c Parse finsih
3587.47/3596.03	c Start Presolve
3587.47/3596.03	c After Reduce Vars: 361 Clauses: 722 Top clause weight: 362 Hard Clauses: 361
3587.47/3596.03	c Use LS-small
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 104
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 103
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 102
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 98
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 92
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 90
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 89
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 88
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 87
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 86
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 85
3587.47/3596.03	c Use postsolve
3587.47/3596.03	o 84
3587.47/3596.03	s SATISFIABLE
3587.47/3596.03	c Use postsolve
3587.47/3596.03	v -x1 -x2 x3 -x4 -x5 x6 -x7 -x8 -x9 x10 -x11 x12 -x13 -x14 x15 -x16 -x17 x18 -x19 x20 -x21 -x22 -x23 -x24 -x25 -x26 x27 -x28 -x29 -x30 -x31 x32 -x33 -x34 -x35 -x36 x37 -x38 -x39 -x40 -x41 x42 x43 -x44 -x45 -x46 -x47 -x48 x49 -x50 -x51 -x52 -x53 x54 -x55 -x56 -x57 -x58 x59 -x60 -x61 -x62 -x63 x64 -x65 x66 -x67 -x68 -x69 -x70 x71 -x72 -x73 -x74 -x75 x76 -x77 -x78 x79 -x80 -x81 -x82 x83 -x84 -x85 -x86 -x87 x88 -x89 -x90 -x91 -x92 x93 -x94 -x95 x96 -x97 -x98 -x99 x100 -x101 -x102 -x103 -x104 x105 -x106 -x107 -x108 -x109 x110 -x111 -x112 -x113 x114 -x115 -x116 -x117 x118 -x119 -x120 -x121 x122 -x123 -x124 -x125 -x126 x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 x135 -x136 -x137 -x138 x139 -x140 -x141 -x142 -x143 x144 -x145 -x146 -x147 -x148 x149 x150 x151 -x152 -x153 -x154 -x155 x156 -x157 -x158 -x159 -x160 x161 -x162 -x163 -x164 -x165 x166 -x167 -x168 -x169 -x170 -x171 x172 -x173 -x174 -x175 -x176 -x177 x178 -x179 -x180 -x181 -x182 x183 -x184 -x185 -x186 -x187 x188 -x189 x190 -x191 -x192 x193 -x194 x195 -x196 -x197 -x198 -x199 x200 -x201 -x202 -x203 -x204 x205 -x206 -x207 -x208 -x209 -x210 -x211 x212 -x213 -x214 -x215 -x216 x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 x227 -x228 x229 -x230 -x231 -x232 -x233 x234 -x235 -x236 -x237 -x238 x239 -x240 -x241 -x242 -x243 x244 -x245 -x246 -x247 -x248 -x249 -x250 x251 -x252 -x253 -x254 -x255 x256 -x257 -x258 -x259 -x260 x261 -x262 -x263 -x264 -x265 x266 -x267 x268 -x269 -x270 -x271 -x272 x273 -x274 -x275 -x276 -x277 x278 -x279 -x280 -x281 -x282 x283 -x284 -x285 -x286 -x287 -x288 -x289 x290 -x291 -x292 -x293 -x294 x295 -x296 -x297 -x298 -x299 x300 -x301 -x302 -x303 x304 x305 -x306 x307 -x308 -x309 -x310 -x311 x312 -x313 -x314 -x315 -x316 x317 -x318 -x319 -x320 x321 -x322 -x323 -x324 -x325 -x326 x327 -x328 -x329 -x330 x331 -x332 -x333 x334 -x335 -x336 -x337 -x338 x339 -x340 -x341 x342 -x343 x344 -x345 -x346 -x347 -x348 x349 -x350 -x351 x352 -x353 -x354 -x355 -x356 x357 -x358 -x359 x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 
3587.47/3596.03	c Done 0.03s

Verifier Data 

OK	84

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (55143 MiB free)
  memory of node 1: 64473 MiB (61251 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4437663-1722976246/watcher-4437663-1722976246 -o /tmp/evaluation-result-4437663-1722976246/solver-4437663-1722976246 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC009-1722970850-344597 --watchdog 3760 --use-pty ./Hybrid-LSMabP+Exact HOME/instance-4437663-1722976246.opb 3600 HOME 31000 

running on 2 cores: 1,3

CPU governors:
  performance: 1 3

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Using a pseudo terminal to collect output from the solver
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=347860, runsolver pid=347857
Current StackSize limit: 8192 KiB


[startup+0.100097 s]*
/proc/loadavg: 4.19 4.27 4.25 5/254 347877
/proc/meminfo: memFree=119168256/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=0.1 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 8 2 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+0.214516 s]*
/proc/loadavg: 4.19 4.27 4.25 5/254 347877
/proc/meminfo: memFree=119166872/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=0.21 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 18 3 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+0.314391 s]*
/proc/loadavg: 4.19 4.27 4.25 5/254 347877
/proc/meminfo: memFree=119164116/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=0.31 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 26 5 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+0.700524 s]
/proc/loadavg: 4.19 4.27 4.25 5/254 347877
/proc/meminfo: memFree=119162968/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=0.68 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 54 14 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+1.50044 s]
/proc/loadavg: 4.19 4.27 4.25 5/254 347879
/proc/meminfo: memFree=119160496/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=1.48 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 119 29 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+3.11382 s]
/proc/loadavg: 4.17 4.27 4.25 5/252 347879
/proc/meminfo: memFree=119155948/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=3.09 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 251 58 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+6.30042 s]
/proc/loadavg: 4.17 4.27 4.25 5/252 347879
/proc/meminfo: memFree=119154624/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=6.27 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 503 124 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+12.7004 s]
/proc/loadavg: 4.14 4.26 4.25 5/252 347880
/proc/meminfo: memFree=119150848/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=12.65 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 1012 253 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+25.5005 s]
/proc/loadavg: 4.20 4.27 4.25 5/252 347882
/proc/meminfo: memFree=119145972/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=25.43 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 2016 527 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 25.43 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+51.1138 s]
/proc/loadavg: 4.19 4.26 4.25 5/252 347886
/proc/meminfo: memFree=119138776/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 673 594 264 0 134 0
[pid=347866] ppid=347860 vsize=8660 memory=984 CPUtime=0 cores=1,3
/proc/347866/stat : 347866 (timeout) S 347860 347866 344585 0 -1 4194304 103 0 0 0 0 0 0 0 20 0 1 0 64222229 8867840 246 134679101440 94139655376896 94139655411912 140733445973632 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94139657509328 94139657511460 94139669569536 140733445981219 140733445981341 140733445981341 140733445988327 0
/proc/347866/statm: 2165 246 222 9 0 87 0
[pid=347868] ppid=347866 vsize=19772 memory=7816 CPUtime=50.99 cores=1,3
/proc/347868/stat : 347868 (LS-MabP) R 347866 347866 344585 0 -1 4194304 383 0 0 0 4018 1081 0 0 20 0 1 0 64222229 20246528 1954 134679101440 4194304 15467897 140726797866160 0 0 0 0 0 17410 0 0 0 17 1 0 0 0 0 0 17807032 17896208 39321600 140726797874231 140726797874340 140726797874340 140726797881326 0
/proc/347868/statm: 4943 1954 1153 2753 0 1596 0
Current children cumulated CPU time: 50.99 s
Current children cumulated vsize: 38364 KiB
Current children cumulated memory: 11492 KiB

[startup+102.3 s]
/proc/loadavg: 4.17 4.25 4.24 5/252 347954
/proc/meminfo: memFree=119176188/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2692 CPUtime=0 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 235 101 0 0 0 0 0 0 20 0 1 0 64222228 10170368 673 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0

################
# More data... #
################

/proc/348861/statm: 21622 18700 804 745 0 20687 0
Current children cumulated CPU time: 3394.25 s
Current children cumulated vsize: 105080 KiB
Current children cumulated memory: 78576 KiB

[startup+3462.3 s]
/proc/loadavg: 4.16 4.17 4.17 5/253 349780
/proc/meminfo: memFree=117130524/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=86932 memory=76512 CPUtime=1660.11 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 13859 0 0 0 166008 3 0 0 20 0 1 0 64402030 89018368 19128 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21733 19128 804 745 0 20798 0
Current children cumulated CPU time: 3454.09 s
Current children cumulated vsize: 105524 KiB
Current children cumulated memory: 80288 KiB

[startup+3522.3 s]
/proc/loadavg: 4.24 4.18 4.18 5/253 349791
/proc/meminfo: memFree=117129960/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=86932 memory=76636 CPUtime=1719.97 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 13892 0 0 0 171994 3 0 0 20 0 1 0 64402030 89018368 19159 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21733 19159 804 745 0 20798 0
Current children cumulated CPU time: 3513.95 s
Current children cumulated vsize: 105524 KiB
Current children cumulated memory: 80412 KiB

[startup+3582.3 s]
/proc/loadavg: 4.13 4.16 4.17 5/253 349859
/proc/meminfo: memFree=117127508/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1779.82 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14078 0 0 0 177979 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3573.8 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3596.04 s]
# the end of solver process 347860 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3199.03 s, system=388.505 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.13 4.16 4.17 5/253 349859
/proc/meminfo: memFree=117127572/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1781.53 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14088 0 0 0 178150 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3575.51 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3590.4 s]
/proc/loadavg: 4.28 4.19 4.18 5/253 349859
/proc/meminfo: memFree=117127592/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1787.9 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14092 0 0 0 178787 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3581.88 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3593.6 s]
/proc/loadavg: 4.34 4.21 4.19 5/253 349861
/proc/meminfo: memFree=117127524/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1791.09 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14092 0 0 0 179106 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3585.07 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3595.2 s]
/proc/loadavg: 4.34 4.21 4.19 5/253 349861
/proc/meminfo: memFree=117127532/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1792.68 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14093 0 0 0 179265 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3586.66 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3595.6 s]
/proc/loadavg: 4.34 4.21 4.19 5/253 349861
/proc/meminfo: memFree=117127532/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1793.08 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14093 0 0 0 179305 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3587.06 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

[startup+3596 s]*
/proc/loadavg: 4.34 4.21 4.19 5/253 349861
/proc/meminfo: memFree=117127532/131655788 swapFree=131071996/131071996
[pid=347860] ppid=347857 vsize=9932 memory=2736 CPUtime=1793.98 cores=1,3
/proc/347860/stat : 347860 (Hybrid-LSMabP+E) S 347857 347860 344585 0 -1 4194304 266 601 0 0 0 0 140554 38844 20 0 1 0 64222228 10170368 684 134679101440 94420446076928 94420447156248 140736638766512 0 0 0 65536 4 65538 0 0 0 17 1 0 0 0 0 0 94420449254704 94420449301892 94420477362176 140736638768106 140736638768251 140736638768251 140736638775266 0
/proc/347860/statm: 2483 684 594 264 0 134 0
[pid=348860] ppid=347860 vsize=8660 memory=1040 CPUtime=0 cores=1,3
/proc/348860/stat : 348860 (timeout) S 347860 348860 344585 0 -1 4194304 105 0 0 0 0 0 0 0 20 0 1 0 64402030 8867840 260 134679101440 94460587036672 94460587071688 140737437837840 0 0 0 0 3145728 90119 0 0 0 17 3 0 0 0 0 0 94460589169104 94460589171236 94460611342336 140737437840372 140737437840541 140737437840541 140737437847527 0
/proc/348860/statm: 2165 260 236 9 0 87 0
[pid=348861] ppid=348860 vsize=87552 memory=77164 CPUtime=1793.49 cores=1,3
/proc/348861/stat : 348861 (Exact) R 348860 348860 344585 0 -1 4194304 14093 0 0 0 179346 3 0 0 20 0 1 0 64402030 89653248 19291 134679101440 4194304 7243121 140731649570608 0 0 0 0 0 8404994 0 0 0 17 1 0 0 0 0 0 7942632 8006904 19398656 140731649573904 140731649574054 140731649574054 140731649581040 0
/proc/348861/statm: 21888 19291 804 745 0 20953 0
Current children cumulated CPU time: 3587.47 s
Current children cumulated vsize: 106144 KiB
Current children cumulated memory: 80940 KiB

Child status: 0

Real time (s): 3596.04
CPU time (s): 3587.54
CPU user time (s): 3199.03
CPU system time (s): 388.505
CPU usage (%): 99.7637
Max. virtual memory (cumulated for all children) (KiB): 106144
Max. memory (cumulated for all children) (KiB): 80940

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3199.03
system time used= 388.505
maximum resident set size= 77164
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17922
page faults= 0
swaps= 0
block input operations= 0
block output operations= 56
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 89
involuntary context switches= 1698


# summary of solver processes directly reported to runsolver:
#   pid: 347860
#   total CPU time (s): 3587.54
#   total CPU user time (s): 3199.03
#   total CPU system time (s): 388.505

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 21.5292 second user time and 37.4761 second system time

The end

Launcher Data 

Begin job on nodeC009 at 2024-08-06 22:30:46
IDJOB=4437663
IDBENCH=155338
IDSOLVER=3071
FILE ID=nodeC009/4437663-1722976246
RUNJOBID= nodeC009-1722970850-344597
SLURM_JOB_ID= 8259056
Free space on /tmp= 723728 MiB

SOLVER NAME= Hybrid-LSMabP+Exact 2024-07-11
BENCH NAME= PB24/normalized-PB11/OPT-LIN/heinz/normalized-go19.opb
COMMAND LINE= ./Hybrid-LSMabP+Exact BENCHNAME TIMEOUT TMPDIR MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4437663-1722976246/watcher-4437663-1722976246 -o /tmp/evaluation-result-4437663-1722976246/solver-4437663-1722976246 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC009-1722970850-344597 --watchdog 3760 --use-pty ./Hybrid-LSMabP+Exact HOME/instance-4437663-1722976246.opb 3600 HOME 31000

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 51fa3ae0158cc49e421df545accb4e20
RANDOM SEED=1469603864

nodeC009.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3489.957
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3491.918
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.258
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.257
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3598.333
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3502.918
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.471
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.343
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        119190252 kB
MemAvailable:   129749700 kB
Buffers:          352972 kB
Cached:         11042300 kB
SwapCached:            0 kB
Active:           652736 kB
Inactive:       11315184 kB
Active(anon):       1508 kB
Inactive(anon):   608836 kB
Active(file):     651228 kB
Inactive(file): 10706348 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             42604 kB
Writeback:            16 kB
AnonPages:        572696 kB
Mapped:           104384 kB
Shmem:             37704 kB
KReclaimable:      84144 kB
Slab:             170780 kB
SReclaimable:      84144 kB
SUnreclaim:        86636 kB
KernelStack:        3856 kB
PageTables:        10428 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:     970544 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            24928 kB
HardwareCorrupted:     0 kB
AnonHugePages:    292864 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      314184 kB
DirectMap2M:    23707648 kB
DirectMap1G:    112197632 kB

Free space on /tmp at the end= 723664 MiB
End job on nodeC009 at 2024-08-06 23:30:42