Trace number 4452285

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Hybrid-LSMabP+Exact 2024-07-11? 3588.62 3596.4

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/
dec/miplib2017/normalized-neos-948346.0.s.opb
MD5SUMfa44fc9c0c30a6a8030f0b23aafff6c8
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables57855
Total number of constraints1571
Number of constraints which are clauses45
Number of constraints which are cardinality constraints (but not clauses)632
Number of constraints which are nor clauses,nor cardinality constraints894
Minimum length of a constraint5
Maximum length of a constraint57675
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 10000
Number of bits of the biggest number in a constraint 14
Biggest sum of numbers in a constraint 578713
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

3588.49/3596.39	c Filename:instance-4452285-1721441175.opb, Cutoff_time:1798, memory_limit_gb:29976
3588.49/3596.39	c Use Presolve
3588.49/3596.39	c Parse finsih
3588.49/3596.39	c Start Presolve
3588.49/3596.39	c After Reduce Vars: 57855 Clauses: 1571 Top clause weight: 1 Hard Clauses: 1571
3588.49/3596.39	c Use LS-small
3588.49/3596.39	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64059 MiB (61195 MiB free)
  memory of node 1: 64510 MiB (60080 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452285-1721441175/watcher-4452285-1721441175 -o /tmp/evaluation-result-4452285-1721441175/solver-4452285-1721441175 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC010-1721432167-1025000 --watchdog 3760 ./Hybrid-LSMabP+Exact HOME/instance-4452285-1721441175.opb 3600 HOME 31000 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1030632, runsolver pid=1030629
Current StackSize limit: 8192 KiB


[startup+0.100092 s]*
/proc/loadavg: 4.12 4.20 4.16 5/249 1030636
/proc/meminfo: memFree=124179136/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=23528 memory=10940 CPUtime=0.09 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 1347 0 0 0 9 0 0 0 20 0 1 0 196276714 24092672 2735 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 5882 2735 1073 2753 0 2535 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 42120 KiB
Current children cumulated memory: 14624 KiB

[startup+0.213566 s]*
/proc/loadavg: 4.12 4.20 4.16 5/249 1030636
/proc/meminfo: memFree=124177596/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=24964 memory=12096 CPUtime=0.2 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 1781 0 0 0 20 0 0 0 20 0 1 0 196276714 25563136 3024 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 6241 3024 1073 2753 0 2894 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 43556 KiB
Current children cumulated memory: 15780 KiB

[startup+0.313401 s]*
/proc/loadavg: 4.12 4.20 4.16 5/249 1030636
/proc/meminfo: memFree=124176448/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=25624 memory=13152 CPUtime=0.3 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 2043 0 0 0 30 0 0 0 20 0 1 0 196276714 26238976 3288 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 6406 3288 1073 2753 0 3059 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 44216 KiB
Current children cumulated memory: 16836 KiB

[startup+0.700479 s]
/proc/loadavg: 4.19 4.21 4.17 5/249 1030636
/proc/meminfo: memFree=124173900/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=30940 memory=17436 CPUtime=0.68 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 3376 0 0 0 67 1 0 0 20 0 1 0 196276714 31682560 4359 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 7735 4359 1073 2753 0 4388 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 49532 KiB
Current children cumulated memory: 21120 KiB

[startup+1.50044 s]
/proc/loadavg: 4.19 4.21 4.17 5/249 1030636
/proc/meminfo: memFree=124168528/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=43228 memory=26908 CPUtime=1.47 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 4191 0 0 0 146 1 0 0 20 0 1 0 196276714 44265472 6727 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 10807 6727 1073 2753 0 7460 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 61820 KiB
Current children cumulated memory: 30592 KiB

[startup+3.11311 s]
/proc/loadavg: 4.19 4.21 4.17 5/249 1030636
/proc/meminfo: memFree=124085284/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=128556 memory=104024 CPUtime=3.09 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 9677 0 0 0 306 3 0 0 20 0 1 0 196276714 131641344 26006 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 32139 26006 1105 2753 0 28792 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 147148 KiB
Current children cumulated memory: 107708 KiB

[startup+6.30043 s]
/proc/loadavg: 4.18 4.21 4.17 5/249 1030638
/proc/meminfo: memFree=123659012/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=673916 memory=649548 CPUtime=6.27 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 146021 0 0 0 608 19 0 0 20 0 1 0 196276714 690089984 162387 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 168479 162387 1153 2753 0 165132 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 692508 KiB
Current children cumulated memory: 653232 KiB

[startup+12.7004 s]
/proc/loadavg: 4.16 4.20 4.16 5/249 1030638
/proc/meminfo: memFree=121264740/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=3218144 memory=3193684 CPUtime=12.66 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 782101 0 0 0 1166 100 0 0 20 0 1 0 196276714 3295379456 798421 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 804536 798421 1153 2753 0 801189 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 3236736 KiB
Current children cumulated memory: 3197368 KiB

[startup+25.5005 s]
/proc/loadavg: 4.14 4.20 4.16 5/249 1030641
/proc/meminfo: memFree=116109184/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=8288128 memory=8263500 CPUtime=25.44 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 2049584 0 0 0 2280 264 0 0 20 0 1 0 196276714 8487043072 2065875 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 2072032 2065875 1153 2753 0 2068685 0
Current children cumulated CPU time: 25.44 s
Current children cumulated vsize: 8306720 KiB
Current children cumulated memory: 8267184 KiB

[startup+51.1133 s]
/proc/loadavg: 4.16 4.19 4.16 5/249 1030644
/proc/meminfo: memFree=111062244/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0
[pid=1030635] ppid=1030632 vsize=8660 memory=916 CPUtime=0 cores=4,6
/proc/1030635/stat : 1030635 (timeout) S 1030632 1030635 1024989 0 -1 4194304 106 0 0 0 0 0 0 0 20 0 1 0 196276714 8867840 229 134679101440 93970805059584 93970805094600 140721677591776 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93970807192016 93970807194148 93970833899520 140721677599777 140721677599899 140721677599899 140721677606887 0
/proc/1030635/statm: 2165 229 205 9 0 87 0
[pid=1030636] ppid=1030635 vsize=13124536 memory=13100400 CPUtime=51 cores=4,6
/proc/1030636/stat : 1030636 (LS-MabP) R 1030635 1030635 1024989 0 -1 4194304 3258788 0 0 0 4676 424 0 0 20 0 1 0 196276714 13439524864 3275100 134679101440 4194304 15467897 140732688675856 0 0 0 0 0 17410 0 0 0 17 4 0 0 0 0 0 17807032 17896208 45506560 140732688679989 140732688680098 140732688680098 140732688687086 0
/proc/1030636/statm: 3281134 3275100 1153 2753 0 3277787 0
Current children cumulated CPU time: 51 s
Current children cumulated vsize: 13143128 KiB
Current children cumulated memory: 13104084 KiB

[startup+102.3 s]
/proc/loadavg: 4.13 4.18 4.16 5/249 1030715
/proc/meminfo: memFree=111057316/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2768 CPUtime=0 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 233 102 0 0 0 0 0 0 20 0 1 0 196276713 10170368 692 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 692 613 264 0 134 0

################
# More data... #
################

/proc/1031680/statm: 2314807 1544522 804 745 0 2313872 0
Current children cumulated CPU time: 3454.86 s
Current children cumulated vsize: 9277820 KiB
Current children cumulated memory: 6181880 KiB

[startup+3522.3 s]
/proc/loadavg: 3.17 3.26 3.29 4/241 1032560
/proc/meminfo: memFree=117794424/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1719.96 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 298804 0 0 0 171629 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3514.72 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3582.3 s]
/proc/loadavg: 3.17 3.25 3.28 4/240 1032571
/proc/meminfo: memFree=117787584/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1779.77 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 299948 0 0 0 177610 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3574.53 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3596.4 s]
# the end of solver process 1030632 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3576.22 s, system=12.3993 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 3.17 3.25 3.28 3/231 1032613
/proc/meminfo: memFree=118335380/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1781.48 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 299964 0 0 0 177781 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3576.24 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3590.4 s]
/proc/loadavg: 3.08 3.22 3.27 3/231 1032615
/proc/meminfo: memFree=118335388/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1787.85 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300333 0 0 0 178418 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3582.61 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3593.6 s]
/proc/loadavg: 2.99 3.20 3.27 3/231 1032615
/proc/meminfo: memFree=118335404/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1791.04 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300463 0 0 0 178737 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3585.8 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3595.2 s]
/proc/loadavg: 2.99 3.20 3.27 3/231 1032616
/proc/meminfo: memFree=118335424/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1792.64 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300615 0 0 0 178897 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3587.4 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3596 s]*
/proc/loadavg: 2.99 3.20 3.27 3/231 1032616
/proc/meminfo: memFree=118335424/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1793.45 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300618 0 0 0 178978 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3588.21 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3596.2 s]
/proc/loadavg: 2.99 3.20 3.27 3/231 1032616
/proc/meminfo: memFree=118335424/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1793.63 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300619 0 0 0 178996 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3588.39 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

[startup+3596.3 s]
/proc/loadavg: 2.99 3.20 3.27 3/231 1032616
/proc/meminfo: memFree=118335424/131655788 swapFree=131071996/131071996
[pid=1030632] ppid=1030629 vsize=9932 memory=2812 CPUtime=1794.76 cores=4,6
/proc/1030632/stat : 1030632 (Hybrid-LSMabP+E) S 1030629 1030632 1024989 0 -1 4194304 264 3327728 0 0 0 0 178608 868 20 0 1 0 196276713 10170368 703 134679101440 93925353943040 93925355022360 140721198608880 0 0 0 65536 4 65538 0 0 0 17 4 0 0 0 0 0 93925357120816 93925357168004 93925381017600 140721198617576 140721198617721 140721198617721 140721198624738 0
/proc/1030632/statm: 2483 703 613 264 0 134 0
[pid=1031679] ppid=1030632 vsize=8660 memory=980 CPUtime=0 cores=4,6
/proc/1031679/stat : 1031679 (timeout) S 1030632 1031679 1024989 0 -1 4194304 107 0 0 0 0 0 0 0 20 0 1 0 196456545 8867840 245 134679101440 93862364880896 93862364915912 140725059897280 0 0 0 0 3145728 90119 0 0 0 17 6 0 0 0 0 0 93862367013328 93862367015460 93862389227520 140725059900402 140725059900571 140725059900571 140725059907559 0
/proc/1031679/statm: 2165 245 221 9 0 87 0
[pid=1031680] ppid=1031679 vsize=9263152 memory=6181384 CPUtime=1793.73 cores=4,6
/proc/1031680/stat : 1031680 (Exact) R 1031679 1031679 1024989 0 -1 4194304 300620 0 0 0 179006 367 0 0 20 0 1 0 196456545 9485467648 1545346 134679101440 4194304 7243121 140728282502448 0 0 0 0 0 8404994 0 0 0 17 4 0 0 0 0 0 7942632 8006904 13062144 140728282506254 140728282506404 140728282506404 140728282513392 0
/proc/1031680/statm: 2315788 1545346 804 745 0 2314853 0
Current children cumulated CPU time: 3588.49 s
Current children cumulated vsize: 9281744 KiB
Current children cumulated memory: 6185176 KiB

Child status: 0

Real time (s): 3596.4
CPU time (s): 3588.62
CPU user time (s): 3576.22
CPU system time (s): 12.3993
CPU usage (%): 99.7839
Max. virtual memory (cumulated for all children) (KiB): 13845208
Max. memory (cumulated for all children) (KiB): 13104084

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3576.22
system time used= 12.3993
maximum resident set size= 13100400
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3630472
page faults= 0
swaps= 0
block input operations= 0
block output operations= 16
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 150
involuntary context switches= 2428


# summary of solver processes directly reported to runsolver:
#   pid: 1030632
#   total CPU time (s): 3588.62
#   total CPU user time (s): 3576.22
#   total CPU system time (s): 12.3993

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 20.0001 second user time and 37.2353 second system time

The end

Launcher Data 

Begin job on nodeC010 at 2024-07-20 04:06:26
IDJOB=4452285
IDBENCH=164221
IDSOLVER=3071
FILE ID=nodeC010/4452285-1721441175
RUNJOBID= nodeC010-1721432167-1025000
SLURM_JOB_ID= 7545621
Free space on /tmp= 723716 MiB

SOLVER NAME= Hybrid-LSMabP+Exact 2024-07-11
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/miplib2017/normalized-neos-948346.0.s.opb
COMMAND LINE= ./Hybrid-LSMabP+Exact BENCHNAME TIMEOUT TMPDIR MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452285-1721441175/watcher-4452285-1721441175 -o /tmp/evaluation-result-4452285-1721441175/solver-4452285-1721441175 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC010-1721432167-1025000 --watchdog 3760  ./Hybrid-LSMabP+Exact HOME/instance-4452285-1721441175.opb 3600 HOME 31000

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= fa44fc9c0c30a6a8030f0b23aafff6c8
RANDOM SEED=1026924409

nodeC010.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3667.894
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.639
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.31
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.216
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.339
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.31
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3489.349
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.689
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.31
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.173
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.213
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.31
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        124186904 kB
MemAvailable:   129499996 kB
Buffers:          537292 kB
Cached:          5562956 kB
SwapCached:            0 kB
Active:          1053860 kB
Inactive:        5730028 kB
Active(anon):       1488 kB
Inactive(anon):   728044 kB
Active(file):    1052372 kB
Inactive(file):  5001984 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             48576 kB
Writeback:             4 kB
AnonPages:        683640 kB
Mapped:           119872 kB
Shmem:             45896 kB
KReclaimable:     197536 kB
Slab:             313304 kB
SReclaimable:     197536 kB
SUnreclaim:       115768 kB
KernelStack:        3968 kB
PageTables:        10796 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    1088500 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            61632 kB
HardwareCorrupted:     0 kB
AnonHugePages:    227328 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      295752 kB
DirectMap2M:    35260416 kB
DirectMap1G:    100663296 kB

Free space on /tmp at the end= 723736 MiB
End job on nodeC010 at 2024-07-20 05:06:23