Trace number 4431527

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
IPBHS-GUROBI 2024-07-09? (TO) 3600.07 3604.12

General information on the benchmark

NamePB24/normalized-PB07/OPT-LIN/submittedPB07/
aksoy/decomp/normalized-matrix_5x3_6.opb
MD5SUM9def910af6a1ee27abcf25feff61a445
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark20
Best CPU time to get the best result obtained on this benchmark71.6563
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6027
Total number of constraints21278
Number of constraints which are clauses21267
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints10
Minimum length of a constraint1
Maximum length of a constraint650
Number of terms in the objective function 650
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 650
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 31
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 681
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

653.96/655.13	c initialize IPBHS solver
653.96/655.13	c IPBHS 0.0.0 beta (471c63a-dirty, Jul  9 2024 15:19:29), with Glucose 3.0, with Gurobi 10.0.1, with RoundingSat 2, with SSPB2SAT 0.2.0, with BreakID 0.0.0
653.96/655.13	c optimizer = "gurobi"
653.96/655.13	c pbsolver = "roundingsat"
653.96/655.13	c load symmetries from file ""
653.96/655.13	c set time limit for symmetry computation to 100 seconds.
653.96/655.13	c set interchangeable summation variable limit to 3
653.96/655.13	c set abs symmetric core budget per WCE-iteration to 100
653.96/655.13	c set rel symmetric core budget per WCE-iteration to 0
653.96/655.13	c set lit symmetric core budget per WCE-iteration to 0
653.96/655.13	c set sym generation to 's'
653.96/655.13	c set abstraction set creation to 10 iterations without LB change
653.96/655.13	c set abstraction set inputs to 0
653.96/655.13	c set abstraction set cluster min size to 2
653.96/655.13	c set abstraction set cluster max size to 100000000
653.96/655.13	c set abstraction set cluster activation limit to 2
653.96/655.13	c enable abstraction set require equal cost
653.96/655.13	c set abstraction set assumptions to 0
653.96/655.13	c set abstraction set constraint type to 0
653.96/655.13	c set abstract core extraction strategy to b
653.96/655.13	c set core extraction strategy to 2
653.96/655.13	c set core extraction shuffles 10
653.96/655.13	c set cores per iteration to 5
653.96/655.13	c set optimizer bound usage strategy to 2
653.96/655.13	c set optimizer max non-optimal iterations to 1000
653.96/655.13	c set small core cardinality limit to 2
653.96/655.13	c set max coef in cores to 1000000000
653.96/655.13	c set SIS iterations to 5
653.96/655.13	c set SIS budget abs to 1000
653.96/655.13	c set SIS budget rel to 0.05
653.96/655.13	c limit for coefficient in constraints and objective to 9223372036854775807
653.96/655.13	c will solve HOME/instance-4431527-1721107091.opb
653.96/655.13	c [0.04] solve iteration 1, LB=0, UB=651
653.96/655.13	c [0.35] solve iteration 2, LB=5, UB=31
653.96/655.13	c [1.17] solve iteration 3, LB=11, UB=31
653.96/655.13	c [1.36] solve iteration 4, LB=11, UB=31
653.96/655.13	c [1.57] solve iteration 5, LB=11, UB=31
653.96/655.13	c [3.12] solve iteration 6, LB=12, UB=30
653.96/655.13	c [3.29] solve iteration 7, LB=12, UB=30
653.96/655.13	c [3.45] solve iteration 8, LB=12, UB=30
653.96/655.13	c [3.65] solve iteration 9, LB=12, UB=30
653.96/655.13	c [3.93] solve iteration 10, LB=12, UB=30
653.96/655.13	c [7.82] solve iteration 11, LB=12, UB=29
653.96/655.13	c [19.19] solve iteration 12, LB=12, UB=29
653.96/655.13	c [90.9] solve iteration 13, LB=12, UB=29
653.96/655.13	c [92.54] solve iteration 14, LB=12, UB=29
653.96/655.13	c [109.49] solve iteration 15, LB=12, UB=29
653.96/655.13	c [149.07] solve iteration 16, LB=12, UB=29
653.96/655.13	c [149.57] solve iteration 17, LB=12, UB=29
653.96/655.13	c [150.19] solve iteration 18, LB=12, UB=29
653.96/655.13	c [150.97] solve iteration 19, LB=12, UB=29
653.96/655.13	c [151.51] solve iteration 20, LB=12, UB=29
653.96/655.13	c [153] solve iteration 21, LB=12, UB=28
653.96/655.13	c [154.77] solve iteration 22, LB=12, UB=28
653.96/655.13	c [155.58] solve iteration 23, LB=12, UB=28
653.96/655.13	c [156.47] solve iteration 24, LB=12, UB=28
653.96/655.13	c [157.3] solve iteration 25, LB=12, UB=28
653.96/655.13	c [204.97] solve iteration 26, LB=12, UB=28
653.96/655.13	c [210.11] solve iteration 27, LB=12, UB=28
653.96/655.13	c [211.05] solve iteration 28, LB=12, UB=28
653.96/655.13	c [214.59] solve iteration 29, LB=12, UB=28
653.96/655.13	c [215.43] solve iteration 30, LB=12, UB=28
653.96/655.13	c [221.1] solve iteration 31, LB=12, UB=27
653.96/655.13	c [221.69] solve iteration 32, LB=12, UB=27
653.96/655.13	c [222.22] solve iteration 33, LB=12, UB=27
653.96/655.13	c [222.9] solve iteration 34, LB=12, UB=27
653.96/655.13	c [223.51] solve iteration 35, LB=12, UB=27
653.96/655.13	c [224.11] solve iteration 36, LB=12, UB=26
653.96/655.13	c [224.7] solve iteration 37, LB=12, UB=26
653.96/655.13	c [225.31] solve iteration 38, LB=12, UB=26
653.96/655.13	c [225.82] solve iteration 39, LB=12, UB=26
653.96/655.13	c [226.4] solve iteration 40, LB=12, UB=26
653.96/655.13	c [286.93] solve iteration 41, LB=12, UB=26
653.96/655.13	c [287.96] solve iteration 42, LB=12, UB=26
653.96/655.13	c [288.96] solve iteration 43, LB=12, UB=26
653.96/655.13	c [290.31] solve iteration 44, LB=12, UB=26
653.96/655.13	c [291.46] solve iteration 45, LB=12, UB=26
653.96/655.13	c [333.76] solve iteration 46, LB=12, UB=26
653.96/655.13	c [336.49] solve iteration 47, LB=12, UB=26
653.96/655.13	c [354.92] solve iteration 48, LB=12, UB=26
653.96/655.13	c [355.9] solve iteration 49, LB=12, UB=26
653.96/655.13	c [356.58] solve iteration 50, LB=12, UB=26
653.96/655.13	c [357.65] solve iteration 51, LB=12, UB=25
653.96/655.13	c [358.4] solve iteration 52, LB=12, UB=25
653.96/655.13	c [359.12] solve iteration 53, LB=12, UB=25
653.96/655.13	c [359.86] solve iteration 54, LB=12, UB=25
653.96/655.13	c [360.63] solve iteration 55, LB=12, UB=25
653.96/655.13	c [415.13] solve iteration 56, LB=12, UB=25
653.96/655.13	c [416.09] solve iteration 57, LB=12, UB=25
653.96/655.13	c [417.22] solve iteration 58, LB=13, UB=25
653.96/655.13	c [418.26] solve iteration 59, LB=13, UB=25
653.96/655.13	c [419.27] solve iteration 60, LB=13, UB=25
653.96/655.13	c [

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64059 MiB (61534 MiB free)
  memory of node 1: 64510 MiB (63013 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4431527-1721107091/watcher-4431527-1721107091 -o /tmp/evaluation-result-4431527-1721107091/solver-4431527-1721107091 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC009-1721106978-827953 --watchdog 3760 run-glibc-2.34.sh ./ipbhs_gurobi HOME/instance-4431527-1721107091.opb 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=828567, runsolver pid=828564

[startup+0.100086 s]*
/proc/loadavg: 4.24 4.33 4.25 5/249 828569
/proc/meminfo: memFree=127529780/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=92092 memory=14468 CPUtime=0.1 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 1874 0 0 0 8 2 0 0 20 0 1 0 162868730 94302208 3617 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 0 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 23023 3617 1716 46 0 3638 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 102020 KiB
Current children cumulated memory: 17140 KiB

[startup+0.213157 s]*
/proc/loadavg: 4.24 4.33 4.25 5/250 828570
/proc/meminfo: memFree=127516172/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=145512 memory=34468 CPUtime=0.21 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 4461 0 0 0 16 5 0 0 20 0 2 0 162868730 149004288 8617 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 36378 8617 3508 46 0 8973 0
[pid=828569/tid=828570] ppid=828567 vsize=145512 memory=3471202400344241230 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) R 828567 828567 827940 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 162868744 149004288 8617 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 155440 KiB
Current children cumulated memory: 37140 KiB

[startup+0.309638 s]*
/proc/loadavg: 4.24 4.33 4.25 5/250 828570
/proc/meminfo: memFree=127516032/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=145512 memory=34468 CPUtime=0.3 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 4461 0 0 0 24 6 0 0 20 0 2 0 162868730 149004288 8617 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 36378 8617 3508 46 0 8973 0
[pid=828569/tid=828570] ppid=828567 vsize=145512 memory=-8824737012739236709 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) R 828567 828567 827940 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 162868744 149004288 8617 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 155440 KiB
Current children cumulated memory: 37140 KiB

[startup+0.700363 s]
/proc/loadavg: 4.24 4.33 4.25 5/250 828570
/proc/meminfo: memFree=127515640/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=145972 memory=36420 CPUtime=0.68 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 5077 0 0 0 57 11 0 0 20 0 2 0 162868730 149475328 9105 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 36493 9105 3808 46 0 9088 0
[pid=828569/tid=828570] ppid=828567 vsize=145972 memory=0 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 162868744 149475328 9105 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 155900 KiB
Current children cumulated memory: 39092 KiB

[startup+1.50042 s]
/proc/loadavg: 4.24 4.33 4.25 5/250 828570
/proc/meminfo: memFree=127514584/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=149508 memory=40112 CPUtime=1.48 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 6066 0 0 0 134 14 0 0 20 0 2 0 162868730 153096192 10028 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 37377 10028 3808 46 0 9972 0
[pid=828569/tid=828570] ppid=828567 vsize=149508 memory=37208 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 162868744 153096192 10028 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 159436 KiB
Current children cumulated memory: 42784 KiB

[startup+3.11329 s]
/proc/loadavg: 4.24 4.33 4.25 5/250 828570
/proc/meminfo: memFree=127505308/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=154880 memory=45940 CPUtime=3.09 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 10597 0 0 0 280 29 0 0 20 0 2 0 162868730 158597120 11485 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 38720 11485 3824 46 0 11315 0
[pid=828569/tid=828570] ppid=828567 vsize=154880 memory=-8824737012739236709 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 3 0 0 0 0 0 0 0 20 0 2 0 162868744 158597120 11485 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 164808 KiB
Current children cumulated memory: 48612 KiB

[startup+6.30036 s]
/proc/loadavg: 4.22 4.32 4.25 5/250 828571
/proc/meminfo: memFree=127486424/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=166140 memory=57856 CPUtime=6.26 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 22293 0 0 0 577 49 0 0 20 0 2 0 162868730 170127360 14464 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 41535 14464 3855 46 0 14130 0
[pid=828569/tid=828570] ppid=828567 vsize=166140 memory=49028 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 6 0 0 0 0 0 0 0 20 0 2 0 162868744 170127360 14464 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 176068 KiB
Current children cumulated memory: 60528 KiB

[startup+12.7004 s]
/proc/loadavg: 4.20 4.32 4.25 5/250 828571
/proc/meminfo: memFree=127481648/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=176316 memory=61336 CPUtime=12.64 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 36882 0 0 0 1200 64 0 0 20 0 2 0 162868730 180547584 15334 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 44079 15334 3855 46 0 16674 0
[pid=828569/tid=828570] ppid=828567 vsize=176316 memory=11464 CPUtime=0 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 12 0 0 0 0 0 0 0 20 0 2 0 162868744 180547584 15334 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 186244 KiB
Current children cumulated memory: 64008 KiB

[startup+25.5005 s]
/proc/loadavg: 4.16 4.30 4.24 5/250 828574
/proc/meminfo: memFree=127362800/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=190056 memory=73088 CPUtime=25.42 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 54534 0 0 0 2468 74 0 0 20 0 2 0 162868730 194617344 18272 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 47514 18272 3855 46 0 20109 0
[pid=828569/tid=828570] ppid=828567 vsize=190056 memory=2672 CPUtime=0.01 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 19 0 0 0 0 1 0 0 20 0 2 0 162868744 194617344 18272 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 199984 KiB
Current children cumulated memory: 75760 KiB

[startup+51.1132 s]
/proc/loadavg: 4.24 4.31 4.25 5/250 828578
/proc/meminfo: memFree=127217084/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=190664 memory=80336 CPUtime=51 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 77996 0 0 0 5007 93 0 0 20 0 2 0 162868730 195239936 20084 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 47666 20084 3855 46 0 20261 0
[pid=828569/tid=828570] ppid=828567 vsize=190664 memory=80252 CPUtime=0.04 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 29 0 0 0 1 3 0 0 20 0 2 0 162868744 195239936 20084 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 51 s
Current children cumulated vsize: 200592 KiB
Current children cumulated memory: 83008 KiB

[startup+102.3 s]
/proc/loadavg: 4.17 4.27 4.24 5/250 828587
/proc/meminfo: memFree=127103456/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=219908 memory=99764 CPUtime=102.09 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 112128 0 0 0 10084 125 0 0 20 0 2 0 162868730 225185792 24941 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 54977 24941 3855 46 0 27572 0
[pid=828569/tid=828570] ppid=828567 vsize=219908 memory=2672 CPUtime=0.1 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 35 0 0 0 2 8 0 0 20 0 2 0 162868744 225185792 24941 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 102.09 s
Current children cumulated vsize: 229836 KiB
Current children cumulated memory: 102436 KiB

[startup+162.3 s]
/proc/loadavg: 4.06 4.22 4.22 5/252 828601
/proc/meminfo: memFree=126748788/131655788 swapFree=131071996/131071996

################
# More data... #
################

[startup+3222.3 s]
/proc/loadavg: 5.27 4.72 4.44 5/251 830424
/proc/meminfo: memFree=123548696/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=413944 CPUtime=3218.63 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 852727 0 0 0 319499 2364 0 0 20 0 2 0 162868730 635461632 103486 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 103486 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=2672 CPUtime=4.26 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 162 0 0 0 119 307 0 0 20 0 2 0 162868744 635461632 103486 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3218.63 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 416616 KiB

[startup+3282.3 s]
/proc/loadavg: 4.67 4.66 4.44 5/251 830435
/proc/meminfo: memFree=123538152/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=418300 CPUtime=3278.56 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 889505 0 0 0 325468 2388 0 0 20 0 2 0 162868730 635461632 104575 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 104575 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=2672 CPUtime=4.34 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 164 0 0 0 121 313 0 0 20 0 2 0 162868744 635461632 104575 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3278.56 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 420972 KiB

[startup+3342.3 s]
/proc/loadavg: 4.30 4.55 4.42 5/251 830445
/proc/meminfo: memFree=123457552/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=420660 CPUtime=3338.5 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 925299 0 0 0 331441 2409 0 0 20 0 2 0 162868730 635461632 105165 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 105165 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=140075594184929 CPUtime=4.42 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 166 0 0 0 123 319 0 0 20 0 2 0 162868744 635461632 105165 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3338.5 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 423332 KiB

[startup+3402.3 s]
/proc/loadavg: 4.15 4.46 4.39 5/251 830456
/proc/meminfo: memFree=123438292/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=425100 CPUtime=3398.45 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 962078 0 0 0 337411 2434 0 0 20 0 2 0 162868730 635461632 106275 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 106275 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=2672 CPUtime=4.52 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 168 0 0 0 126 326 0 0 20 0 2 0 162868744 635461632 106275 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3398.45 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 427772 KiB

[startup+3462.3 s]
/proc/loadavg: 4.11 4.39 4.37 5/249 830467
/proc/meminfo: memFree=123432492/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=427400 CPUtime=3458.38 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 998450 0 0 0 343382 2456 0 0 20 0 2 0 162868730 635461632 106850 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 106850 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=2672 CPUtime=4.6 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 170 0 0 0 128 332 0 0 20 0 2 0 162868744 635461632 106850 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3458.38 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 430072 KiB

[startup+3522.3 s]
/proc/loadavg: 4.08 4.33 4.35 5/249 830477
/proc/meminfo: memFree=123355856/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=429824 CPUtime=3518.33 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 1034364 0 0 0 349354 2479 0 0 20 0 2 0 162868730 635461632 107456 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 107456 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=1984 CPUtime=4.68 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 172 0 0 0 131 337 0 0 20 0 2 0 162868744 635461632 107456 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3518.33 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 432496 KiB

[startup+3582.3 s]
/proc/loadavg: 4.14 4.30 4.34 5/249 830487
/proc/meminfo: memFree=123272044/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=432904 CPUtime=3578.26 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 1070741 0 0 0 355322 2504 0 0 20 0 2 0 162868730 635461632 108226 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 108226 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=1832 CPUtime=4.77 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 175 0 0 0 133 344 0 0 20 0 2 0 162868744 635461632 108226 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3578.26 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 435576 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3604.11 s]
/proc/loadavg: 4.10 4.28 4.33 5/249 830539
/proc/meminfo: memFree=127065596/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=432996 CPUtime=3600.05 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 1074926 0 0 0 357493 2512 0 0 20 0 2 0 162868730 635461632 108249 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 108249 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=11464 CPUtime=4.8 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 175 0 0 0 134 346 0 0 20 0 2 0 162868744 635461632 108249 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3600.05 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 435668 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+3604.12 s]
# the end of solver process 828567 was just reported to runsolver
# Child ended because it received signal 15 (SIGTERM)

# cumulated CPU time of all completed processes:  user=0.001565 s, system=0 s

[startup+3604.12 s]
# the end of solver process 828569 was just reported to runsolver
# Child ended because it received signal 15 (SIGTERM)

# cumulated CPU time of all completed processes:  user=3574.94 s, system=25.1294 s
# this solver process was not waited by its parent and was adopted by runsolver

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3604.11 s]
/proc/loadavg: 4.10 4.28 4.33 5/249 830539
/proc/meminfo: memFree=127065596/131655788 swapFree=131071996/131071996
[pid=828567] ppid=828564 vsize=9928 memory=2672 CPUtime=0 cores=5,7
/proc/828567/stat : 828567 (run-glibc-2.34.) S 828564 828567 827940 0 -1 4194304 199 0 0 0 0 0 0 0 20 0 1 0 162868730 10166272 668 134679101440 94620423081984 94620424161304 140724795559376 0 0 0 65536 4 65538 0 0 0 17 5 0 0 0 0 0 94620426259760 94620426306948 94620439171072 140724795560907 140724795561052 140724795561052 140724795568067 0
/proc/828567/statm: 2482 668 588 264 0 133 0
[pid=828569] ppid=828567 vsize=620568 memory=432996 CPUtime=3600.05 cores=5,7
/proc/828569/stat : 828569 (ld-linux-x86-64) R 828567 828567 827940 0 -1 4194304 1074926 0 0 0 357493 2512 0 0 20 0 2 0 162868730 635461632 108249 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
/proc/828569/statm: 155142 108249 4028 46 0 127737 0
[pid=828569/tid=828570] ppid=828567 vsize=620568 memory=11464 CPUtime=4.8 cores=5,7
/proc/828569/task/828570/stat : 828570 (ld-linux-x86-64) S 828567 828567 827940 0 -1 1077936192 175 0 0 0 134 346 0 0 20 0 2 0 162868744 635461632 108249 134679101440 140556529242112 140556529429724 140734462711200 0 0 0 0 4096 0 1 0 0 -1 7 0 0 0 0 0 140556531530624 140556531540072 93824993644544 140734462714723 140734462714875 140734462714875 140734462721970 0
Current children cumulated CPU time: 3600.05 s
Current children cumulated vsize: 630496 KiB
Current children cumulated memory: 435668 KiB

Child ended because it received signal 15 (SIGTERM)

Real time (s): 3604.12
CPU time (s): 3600.07
CPU user time (s): 3574.94
CPU system time (s): 25.1294
CPU usage (%): 99.8876
Max. virtual memory (cumulated for all children) (KiB): 630496
Max. memory (cumulated for all children) (KiB): 435668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3574.94
system time used= 25.1294
maximum resident set size= 432996
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1075125
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 353443
involuntary context switches= 3643


# summary of solver processes directly reported to runsolver:
#   pid: 828567,828569
#   total CPU time (s): 3600.07
#   total CPU user time (s): 3574.94
#   total CPU system time (s): 25.1294

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 20.1454 second user time and 36.8318 second system time

The end

Launcher Data 

Begin job on nodeC009 at 2024-07-16 07:18:23
IDJOB=4431527
IDBENCH=148185
IDSOLVER=3056
FILE ID=nodeC009/4431527-1721107091
RUNJOBID= nodeC009-1721106978-827953
SLURM_JOB_ID= 7505638
Free space on /tmp= 723628 MiB

SOLVER NAME= IPBHS-GUROBI 2024-07-09
BENCH NAME= PB24/normalized-PB07/OPT-LIN/submittedPB07/aksoy/decomp/normalized-matrix_5x3_6.opb
COMMAND LINE= run-glibc-2.34.sh ./ipbhs_gurobi BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4431527-1721107091/watcher-4431527-1721107091 -o /tmp/evaluation-result-4431527-1721107091/solver-4431527-1721107091 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC009-1721106978-827953 --watchdog 3760  run-glibc-2.34.sh ./ipbhs_gurobi HOME/instance-4431527-1721107091.opb

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 9def910af6a1ee27abcf25feff61a445
RANDOM SEED=1996336058

nodeC009.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.945
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6984.34
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3666.014
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.509
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6984.34
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.342
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.960
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6984.34
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3492.185
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.507
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6984.34
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.317
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        127538204 kB
MemAvailable:   129297732 kB
Buffers:          399152 kB
Cached:          2185424 kB
SwapCached:            0 kB
Active:           722420 kB
Inactive:        2832220 kB
Active(anon):       1476 kB
Inactive(anon):  1006284 kB
Active(file):     720944 kB
Inactive(file):  1825936 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            101312 kB
Writeback:            12 kB
AnonPages:        968880 kB
Mapped:           120796 kB
Shmem:             37700 kB
KReclaimable:     105360 kB
Slab:             203504 kB
SReclaimable:     105360 kB
SUnreclaim:        98144 kB
KernelStack:        3952 kB
PageTables:        11884 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    1604900 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            52224 kB
HardwareCorrupted:     0 kB
AnonHugePages:    432128 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      187208 kB
DirectMap2M:    19640320 kB
DirectMap1G:    116391936 kB

Free space on /tmp at the end= 723600 MiB
End job on nodeC009 at 2024-07-16 08:18:28