Trace number 4452195

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Hybrid-LSMabP+Exact 2024-07-11? 3588.61 3596.55

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/
dec/miplib2003/normalized-stp3d.0.s.opb
MD5SUM3669957ef10a08034abaee305bfecedd
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables204880
Total number of constraints159489
Number of constraints which are clauses129232
Number of constraints which are cardinality constraints (but not clauses)5805
Number of constraints which are nor clauses,nor cardinality constraints24452
Minimum length of a constraint2
Maximum length of a constraint75648
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3258328
Number of bits of the biggest number in a constraint 22
Biggest sum of numbers in a constraint 503258152
Number of bits of the biggest sum of numbers29
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

3588.53/3596.54	c Filename:instance-4452195-1721441029.opb, Cutoff_time:1798, memory_limit_gb:29976
3588.53/3596.54	c Use Presolve
3588.53/3596.54	c Parse finsih
3588.53/3596.54	c Start Presolve
3588.53/3596.54	c After Reduce Vars: 178842 Clauses: 163423 Top clause weight: 1 Hard Clauses: 163423
3588.53/3596.54	c Use LS-small
3588.53/3596.54	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (62797 MiB free)
  memory of node 1: 64473 MiB (61672 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452195-1721441029/watcher-4452195-1721441029 -o /tmp/evaluation-result-4452195-1721441029/solver-4452195-1721441029 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1721433843-1033738 --watchdog 3760 ./Hybrid-LSMabP+Exact HOME/instance-4452195-1721441029.opb 3600 HOME 31000 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1038235, runsolver pid=1038232
Current StackSize limit: 8192 KiB


[startup+0.100087 s]*
/proc/loadavg: 4.12 4.12 4.11 5/266 1038239
/proc/meminfo: memFree=127432912/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=40836 memory=27848 CPUtime=0.09 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 3713 0 0 0 9 0 0 0 20 0 1 0 196266454 41816064 6962 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 10209 6962 1073 2753 0 6862 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 59428 KiB
Current children cumulated memory: 31524 KiB

[startup+0.205637 s]*
/proc/loadavg: 4.12 4.12 4.11 5/266 1038239
/proc/meminfo: memFree=127429836/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=44104 memory=31224 CPUtime=0.19 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 4778 0 0 0 19 0 0 0 20 0 1 0 196266454 45162496 7806 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 11026 7806 1073 2753 0 7679 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 62696 KiB
Current children cumulated memory: 34900 KiB

[startup+0.305103 s]*
/proc/loadavg: 4.12 4.12 4.11 5/266 1038239
/proc/meminfo: memFree=127424708/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=48132 memory=35764 CPUtime=0.3 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 5886 0 0 0 29 1 0 0 20 0 1 0 196266454 49287168 8941 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 12033 8941 1073 2753 0 8686 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 66724 KiB
Current children cumulated memory: 39440 KiB

[startup+0.700273 s]
/proc/loadavg: 4.12 4.12 4.11 5/266 1038239
/proc/meminfo: memFree=127422208/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=62400 memory=43792 CPUtime=0.68 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 7419 0 0 0 67 1 0 0 20 0 1 0 196266454 63897600 10948 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 15600 10948 1073 2753 0 12253 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 80992 KiB
Current children cumulated memory: 47468 KiB

[startup+1.50031 s]
/proc/loadavg: 4.12 4.12 4.11 5/266 1038239
/proc/meminfo: memFree=127409992/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=86836 memory=60212 CPUtime=1.48 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 9970 0 0 0 146 2 0 0 20 0 1 0 196266454 88920064 15053 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 21709 15053 1073 2753 0 18362 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 105428 KiB
Current children cumulated memory: 63888 KiB

[startup+3.10556 s]
/proc/loadavg: 4.11 4.12 4.11 5/266 1038300
/proc/meminfo: memFree=127196736/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=216344 memory=195476 CPUtime=3.09 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 18329 0 0 0 302 7 0 0 20 0 1 0 196266454 221536256 48869 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 54086 48869 1105 2753 0 50739 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 234936 KiB
Current children cumulated memory: 199152 KiB

[startup+6.3003 s]
/proc/loadavg: 4.11 4.12 4.11 5/266 1038300
/proc/meminfo: memFree=126602564/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=216344 memory=195476 CPUtime=6.28 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 18367 0 0 0 621 7 0 0 20 0 1 0 196266454 221536256 48869 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 54086 48869 1105 2753 0 50739 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 234936 KiB
Current children cumulated memory: 199152 KiB

[startup+12.7003 s]
/proc/loadavg: 4.10 4.11 4.11 5/266 1038303
/proc/meminfo: memFree=125415492/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=1708216 memory=1669972 CPUtime=12.66 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 395765 0 0 0 1212 54 0 0 20 0 1 0 196266454 1749213184 417493 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 427054 417493 1153 2753 0 423707 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 1726808 KiB
Current children cumulated memory: 1673648 KiB

[startup+25.5003 s]
/proc/loadavg: 4.08 4.11 4.10 5/264 1038304
/proc/meminfo: memFree=120019468/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=7010060 memory=6972012 CPUtime=25.43 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 1721307 0 0 0 2315 228 0 0 20 0 1 0 196266454 7178301440 1743003 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 1752515 1743003 1153 2753 0 1749168 0
Current children cumulated CPU time: 25.43 s
Current children cumulated vsize: 7028652 KiB
Current children cumulated memory: 6975688 KiB

[startup+51.1055 s]
/proc/loadavg: 4.11 4.11 4.10 5/264 1038309
/proc/meminfo: memFree=109480844/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0
[pid=1038238] ppid=1038235 vsize=8660 memory=908 CPUtime=0 cores=5,7
/proc/1038238/stat : 1038238 (timeout) S 1038235 1038238 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196266454 8867840 227 134679101440 93826817429504 93826817464520 140727245780464 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 93826819561936 93826819564068 93826846277632 140727245784097 140727245784219 140727245784219 140727245791207 0
/proc/1038238/statm: 2165 227 203 9 0 87 0
[pid=1038239] ppid=1038238 vsize=17307380 memory=17281356 CPUtime=50.97 cores=5,7
/proc/1038239/stat : 1038239 (LS-MabP) R 1038238 1038238 1033725 0 -1 4194304 4298668 0 0 0 4538 559 0 0 20 0 1 0 196266454 17722757120 4320339 134679101440 4194304 15467897 140731391049936 0 0 0 0 0 17410 0 0 0 17 5 0 0 0 0 0 17807032 17896208 38592512 140731391054901 140731391055010 140731391055010 140731391061998 0
/proc/1038239/statm: 4326845 4320339 1153 2753 0 4323498 0
Current children cumulated CPU time: 50.97 s
Current children cumulated vsize: 17325972 KiB
Current children cumulated memory: 17285032 KiB

[startup+102.3 s]
/proc/loadavg: 4.05 4.09 4.09 5/264 1038317
/proc/meminfo: memFree=109472804/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2768 CPUtime=0 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 237 104 0 0 0 0 0 0 20 0 1 0 196266453 10170368 692 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 692 615 264 0 134 0

################
# More data... #
################

/proc/1039299/statm: 178662 171145 820 745 0 177727 0
Current children cumulated CPU time: 3454.61 s
Current children cumulated vsize: 733240 KiB
Current children cumulated memory: 688316 KiB

[startup+3522.3 s]
/proc/loadavg: 4.28 4.25 4.18 5/265 1040236
/proc/meminfo: memFree=125548868/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=714648 memory=684580 CPUtime=1719.71 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 119040 0 0 0 171941 30 0 0 20 0 1 0 196446295 731799552 171145 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 178662 171145 820 745 0 177727 0
Current children cumulated CPU time: 3514.49 s
Current children cumulated vsize: 733240 KiB
Current children cumulated memory: 688316 KiB

[startup+3582.3 s]
/proc/loadavg: 4.10 4.20 4.17 6/266 1040246
/proc/meminfo: memFree=125380996/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960140 memory=851888 CPUtime=1779.58 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151037 0 0 0 177919 39 0 0 20 0 1 0 196446295 983183360 212972 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240035 212972 820 745 0 239100 0
Current children cumulated CPU time: 3574.36 s
Current children cumulated vsize: 978732 KiB
Current children cumulated memory: 855624 KiB

[startup+3596.55 s]
# the end of solver process 1038235 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3573.98 s, system=14.6271 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.09 4.20 4.16 5/265 1040246
/proc/meminfo: memFree=125378836/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960140 memory=853936 CPUtime=1781.28 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151038 0 0 0 178089 39 0 0 20 0 1 0 196446295 983183360 213484 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240035 213484 820 745 0 239100 0
Current children cumulated CPU time: 3576.06 s
Current children cumulated vsize: 978732 KiB
Current children cumulated memory: 857672 KiB

[startup+3590.4 s]
/proc/loadavg: 4.08 4.19 4.16 5/265 1040248
/proc/meminfo: memFree=125378696/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960140 memory=853936 CPUtime=1787.66 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151040 0 0 0 178727 39 0 0 20 0 1 0 196446295 983183360 213484 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240035 213484 820 745 0 239100 0
Current children cumulated CPU time: 3582.44 s
Current children cumulated vsize: 978732 KiB
Current children cumulated memory: 857672 KiB

[startup+3593.6 s]
/proc/loadavg: 4.08 4.19 4.16 5/265 1040248
/proc/meminfo: memFree=125376620/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960140 memory=855984 CPUtime=1790.86 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151045 0 0 0 179047 39 0 0 20 0 1 0 196446295 983183360 213996 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240035 213996 820 745 0 239100 0
Current children cumulated CPU time: 3585.64 s
Current children cumulated vsize: 978732 KiB
Current children cumulated memory: 859720 KiB

[startup+3595.2 s]
/proc/loadavg: 4.08 4.19 4.16 5/265 1040248
/proc/meminfo: memFree=125376592/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960140 memory=856208 CPUtime=1792.45 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151080 0 0 0 179206 39 0 0 20 0 1 0 196446295 983183360 214052 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240035 214052 820 745 0 239100 0
Current children cumulated CPU time: 3587.23 s
Current children cumulated vsize: 978732 KiB
Current children cumulated memory: 859944 KiB

[startup+3596 s]*
/proc/loadavg: 4.08 4.19 4.16 5/265 1040250
/proc/meminfo: memFree=125922788/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960284 memory=856208 CPUtime=1793.25 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151083 0 0 0 179286 39 0 0 20 0 1 0 196446295 983330816 214052 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240071 214052 820 745 0 239136 0
Current children cumulated CPU time: 3588.03 s
Current children cumulated vsize: 978876 KiB
Current children cumulated memory: 859944 KiB

[startup+3596.4 s]
/proc/loadavg: 4.08 4.19 4.16 5/265 1040250
/proc/meminfo: memFree=125922788/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3145728 90119 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=960284 memory=856208 CPUtime=1793.65 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151083 0 0 0 179326 39 0 0 20 0 1 0 196446295 983330816 214052 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 240071 214052 820 745 0 239136 0
Current children cumulated CPU time: 3588.43 s
Current children cumulated vsize: 978876 KiB
Current children cumulated memory: 859944 KiB

[startup+3596.5 s]
/proc/loadavg: 4.08 4.19 4.16 5/265 1040250
/proc/meminfo: memFree=125922788/131524600 swapFree=131071996/131071996
[pid=1038235] ppid=1038232 vsize=9932 memory=2820 CPUtime=1794.78 cores=5,7
/proc/1038235/stat : 1038235 (Hybrid-LSMabP+E) S 1038232 1038235 1033725 0 -1 4194304 267 4356028 0 0 0 0 178057 1421 20 0 1 0 196266453 10170368 705 134679101440 94083256553472 94083257632792 140723045430448 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94083259731248 94083259778436 94083280715776 140723045434344 140723045434489 140723045434489 140723045441506 0
/proc/1038235/statm: 2483 705 615 264 0 134 0
[pid=1039298] ppid=1038235 vsize=8660 memory=916 CPUtime=0 cores=5,7
/proc/1039298/stat : 1039298 (timeout) S 1038235 1039298 1033725 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196446295 8867840 229 134679101440 94649350430720 94649350465736 140726658097232 0 0 0 0 3293184 73735 0 0 0 17 7 0 0 0 0 0 94649352563152 94649352565284 94649385115648 140726658106354 140726658106523 140726658106523 140726658113511 0
/proc/1039298/statm: 2165 229 204 9 0 87 0
[pid=1039299] ppid=1039298 vsize=611980 memory=607140 CPUtime=1793.75 cores=5,7
/proc/1039299/stat : 1039299 (Exact) R 1039298 1039298 1033725 0 -1 4194304 151193 0 0 0 179336 39 0 0 20 0 1 0 196446295 626667520 151785 134679101440 4194304 7243121 140721265254384 0 0 0 0 0 8404994 0 0 0 17 5 0 0 0 0 0 7942632 8006904 30310400 140721265259534 140721265259684 140721265259684 140721265266672 0
/proc/1039299/statm: 152995 151785 820 745 0 152060 0
Current children cumulated CPU time: 3588.53 s
Current children cumulated vsize: 630572 KiB
Current children cumulated memory: 610876 KiB

Child status: 0

Real time (s): 3596.55
CPU time (s): 3588.61
CPU user time (s): 3573.98
CPU system time (s): 14.6271
CPU usage (%): 99.7791
Max. virtual memory (cumulated for all children) (KiB): 17325972
Max. memory (cumulated for all children) (KiB): 17290948

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3573.98
system time used= 14.6271
maximum resident set size= 17287272
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4509073
page faults= 0
swaps= 0
block input operations= 0
block output operations= 16
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 182
involuntary context switches= 1478


# summary of solver processes directly reported to runsolver:
#   pid: 1038235
#   total CPU time (s): 3588.61
#   total CPU user time (s): 3573.98
#   total CPU system time (s): 14.6271

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.09827 second user time and 15.7406 second system time

The end

Launcher Data 

Begin job on nodeC020 at 2024-07-20 04:04:03
IDJOB=4452195
IDBENCH=163951
IDSOLVER=3071
FILE ID=nodeC020/4452195-1721441029
RUNJOBID= nodeC020-1721433843-1033738
SLURM_JOB_ID= 7545629
Free space on /tmp= 890012 MiB

SOLVER NAME= Hybrid-LSMabP+Exact 2024-07-11
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/miplib2003/normalized-stp3d.0.s.opb
COMMAND LINE= ./Hybrid-LSMabP+Exact BENCHNAME TIMEOUT TMPDIR MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452195-1721441029/watcher-4452195-1721441029 -o /tmp/evaluation-result-4452195-1721441029/solver-4452195-1721441029 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1721433843-1033738 --watchdog 3760  ./Hybrid-LSMabP+Exact HOME/instance-4452195-1721441029.opb 3600 HOME 31000

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 3669957ef10a08034abaee305bfecedd
RANDOM SEED=688807400

nodeC020.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.695
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3676.519
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.045
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.668
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.720
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3662.915
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.328
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3679.072
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        127457492 kB
MemAvailable:   129661512 kB
Buffers:          554564 kB
Cached:          2475540 kB
SwapCached:            0 kB
Active:           960936 kB
Inactive:        2449896 kB
Active(anon):       1640 kB
Inactive(anon):   425356 kB
Active(file):     959296 kB
Inactive(file):  2024540 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             34476 kB
Writeback:             0 kB
AnonPages:        380720 kB
Mapped:           117628 kB
Shmem:             45912 kB
KReclaimable:     120016 kB
Slab:             235832 kB
SReclaimable:     120016 kB
SUnreclaim:       115816 kB
KernelStack:        4296 kB
PageTables:         9968 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     877112 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            70368 kB
HardwareCorrupted:     0 kB
AnonHugePages:    243712 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      211668 kB
DirectMap2M:    22630400 kB
DirectMap1G:    113246208 kB

Free space on /tmp at the end= 889988 MiB
End job on nodeC020 at 2024-07-20 05:03:59