Trace number 4458256

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
IPBHS-GUROBI-SYM 2024-07-09? (TO) 3600.04 3608.71

General information on the benchmark

NamePB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/multverif/
diagcomm_greater/normalized-mult_diagcomm_opt_greater_teq_nbits_18.opb
MD5SUM858e72f790302981bac4f28574add405
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark0.145801
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables2016
Total number of constraints2988
Number of constraints which are clauses1944
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1044
Minimum length of a constraint2
Maximum length of a constraint5
Number of terms in the objective function 72
Biggest coefficient in the objective function 34359738368
Number of bits for the biggest coefficient in the objective function 36
Sum of the numbers in the objective function 137438953470
Number of bits of the sum of numbers in the objective function 37
Biggest number in a constraint 34359738368
Number of bits of the biggest number in a constraint 36
Biggest sum of numbers in a constraint 137438953470
Number of bits of the biggest sum of numbers37
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.03	c initialize IPBHS solver
0.00/0.03	c IPBHS 0.0.0 beta (471c63a-dirty, Jul  9 2024 15:19:29), with Glucose 3.0, with Gurobi 10.0.1, with RoundingSat 2, with SSPB2SAT 0.2.0, with BreakID 0.0.0
0.00/0.03	c optimizer = "gurobi"
0.00/0.03	c pbsolver = "roundingsat"
0.00/0.03	c load symmetries from file ""
0.00/0.03	c set time limit for symmetry computation to 100 seconds.
0.00/0.03	c set interchangeable summation variable limit to 3
0.00/0.03	c find symmetric cores by applying each permutation and add them to optimizer
0.00/0.03	c set abs symmetric core budget per WCE-iteration to 100
0.00/0.03	c set rel symmetric core budget per WCE-iteration to 0
0.00/0.03	c set lit symmetric core budget per WCE-iteration to 0
0.00/0.03	c set sym generation to 's'
0.00/0.03	c set abstraction set creation to 10 iterations without LB change
0.00/0.03	c set abstraction set inputs to 0
0.00/0.03	c set abstraction set cluster min size to 2
0.00/0.03	c set abstraction set cluster max size to 100000000
0.00/0.03	c set abstraction set cluster activation limit to 2
0.00/0.03	c enable abstraction set require equal cost
0.00/0.03	c set abstraction set assumptions to 0
0.00/0.03	c set abstraction set constraint type to 0
0.00/0.03	c set abstract core extraction strategy to b
0.00/0.03	c set core extraction strategy to 2
0.00/0.03	c set core extraction shuffles 10
0.00/0.03	c set cores per iteration to 5
0.00/0.03	c set optimizer bound usage strategy to 2
0.00/0.03	c set optimizer max non-optimal iterations to 1000
0.00/0.03	c set small core cardinality limit to 2
0.00/0.03	c set max coef in cores to 1000000000
0.00/0.03	c set SIS iterations to 5
0.00/0.03	c set SIS budget abs to 1000
0.00/0.03	c set SIS budget rel to 0.05
0.00/0.03	c limit for coefficient in constraints and objective to 9223372036854775807
0.00/0.03	c will solve HOME/instance-4458256-1721868783.opb
3600.02/3608.70	HOME/run-glibc-2.34.sh: line 2: 213474 Terminated              LD_LIBRARY_PATH=/home/evaluation/evaluation/priv/lib:/home/evaluation/evaluation/tools/lib64:/home/evaluation/evaluation/tools/lib:/usr/local/lib:/home/evaluation/evaluation/tools/glibc-2.34/lib/:/lib64 /home/evaluation/evaluation/tools/glibc-2.34/lib/ld-linux-x86-64.so.2 $*

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (58467 MiB free)
  memory of node 1: 64473 MiB (60227 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458256-1721868783/watcher-4458256-1721868783 -o /tmp/evaluation-result-4458256-1721868783/solver-4458256-1721868783 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210684 --watchdog 3760 run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458256-1721868783.opb 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=213472, runsolver pid=213469

[startup+0.100085 s]*
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121528636/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=26420 CPUtime=0.09 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 2914 0 0 0 8 1 0 0 20 0 2 0 23406187 158593024 6605 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 6605 3131 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=4026561614 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) R 213472 213472 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 6605 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 29144 KiB

[startup+0.205768 s]*
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121528440/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=28804 CPUtime=0.19 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 2941 0 0 0 18 1 0 0 20 0 2 0 23406187 158593024 7201 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7201 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=3471202400344241230 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7201 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 31528 KiB

[startup+0.305739 s]*
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121528300/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=28804 CPUtime=0.3 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 2963 0 0 0 28 2 0 0 20 0 2 0 23406187 158593024 7201 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7201 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=-8898203128400275558 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7201 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 31528 KiB

[startup+0.700274 s]
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121527824/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=29068 CPUtime=0.68 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 3023 0 0 0 65 3 0 0 20 0 2 0 23406187 158593024 7267 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7267 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=5552 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7267 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 31792 KiB

[startup+1.50027 s]
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121527596/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=29068 CPUtime=1.49 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 3044 0 0 0 144 5 0 0 20 0 2 0 23406187 158593024 7267 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7267 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=11624 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7267 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 31792 KiB

[startup+3.10555 s]
/proc/loadavg: 4.31 4.20 4.10 5/262 213475
/proc/meminfo: memFree=121526796/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=29608 CPUtime=3.09 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 3860 0 0 0 300 9 0 0 20 0 2 0 23406187 158593024 7402 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7402 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=29608 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 3 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7402 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 32332 KiB

[startup+6.30026 s]
/proc/loadavg: 4.29 4.20 4.10 5/262 213476
/proc/meminfo: memFree=121524592/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=31712 CPUtime=6.27 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 4762 0 0 0 612 15 0 0 20 0 2 0 23406187 158593024 7928 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7928 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=29332 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 6 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7928 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 34436 KiB

[startup+12.7003 s]
/proc/loadavg: 4.26 4.19 4.10 5/262 213476
/proc/meminfo: memFree=121524508/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=154876 memory=31756 CPUtime=12.66 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 6654 0 0 0 1238 28 0 0 20 0 2 0 23406187 158593024 7939 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 38719 7939 3697 46 0 7683 0
[pid=213474/tid=213475] ppid=213472 vsize=154876 memory=31756 CPUtime=0 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 12 0 0 0 0 0 0 0 20 0 2 0 23406189 158593024 7939 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 164804 KiB
Current children cumulated memory: 34480 KiB

[startup+25.5003 s]
/proc/loadavg: 4.20 4.18 4.10 5/262 213479
/proc/meminfo: memFree=121513024/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=162900 memory=38444 CPUtime=25.43 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 11604 0 0 0 2499 44 0 0 20 0 2 0 23406187 166809600 9611 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 40725 9611 3697 46 0 9689 0
[pid=213474/tid=213475] ppid=213472 vsize=162900 memory=-8898203128400275558 CPUtime=0.01 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 18 0 0 0 0 1 0 0 20 0 2 0 23406189 166809600 9611 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 25.43 s
Current children cumulated vsize: 172828 KiB
Current children cumulated memory: 41168 KiB

[startup+51.1057 s]
/proc/loadavg: 4.19 4.18 4.10 5/263 213483
/proc/meminfo: memFree=121489812/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=164188 memory=39640 CPUtime=50.97 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 18686 0 0 0 5021 76 0 0 20 0 2 0 23406187 168128512 9910 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 41047 9910 3697 46 0 10011 0
[pid=213474/tid=213475] ppid=213472 vsize=164188 memory=2724 CPUtime=0.04 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 27 0 0 0 1 3 0 0 20 0 2 0 23406189 168128512 9910 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 50.97 s
Current children cumulated vsize: 174116 KiB
Current children cumulated memory: 42364 KiB

[startup+102.3 s]
/proc/loadavg: 4.13 4.17 4.10 5/262 213493
/proc/meminfo: memFree=121460352/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=164724 memory=42080 CPUtime=102.05 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 26624 0 0 0 10069 136 0 0 20 0 2 0 23406187 168677376 10520 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 41181 10520 3697 46 0 10145 0
[pid=213474/tid=213475] ppid=213472 vsize=164724 memory=42076 CPUtime=0.09 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 34 0 0 0 3 6 0 0 20 0 2 0 23406189 168677376 10520 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 102.05 s
Current children cumulated vsize: 174652 KiB
Current children cumulated memory: 44804 KiB

[startup+162.3 s]

################
# More data... #
################

/proc/213474/statm: 55637 25002 3697 46 0 24601 0
[pid=213474/tid=213475] ppid=213472 vsize=222548 memory=2724 CPUtime=2.57 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 190 0 0 0 91 166 0 0 20 0 2 0 23406189 227889152 25002 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3154.65 s
Current children cumulated vsize: 232476 KiB
Current children cumulated memory: 102732 KiB

[startup+3222.3 s]
/proc/loadavg: 4.28 4.18 4.13 5/260 215309
/proc/meminfo: memFree=121132596/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=223544 memory=100812 CPUtime=3214.51 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 99724 0 0 0 319859 1592 0 0 20 0 2 0 23406187 228909056 25203 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 55886 25203 3697 46 0 24850 0
[pid=213474/tid=213475] ppid=213472 vsize=223544 memory=11624 CPUtime=2.62 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 193 0 0 0 93 169 0 0 20 0 2 0 23406189 228909056 25203 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3214.51 s
Current children cumulated vsize: 233472 KiB
Current children cumulated memory: 103536 KiB

[startup+3282.3 s]
/proc/loadavg: 4.10 4.14 4.12 5/260 215321
/proc/meminfo: memFree=121130240/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=223544 memory=100876 CPUtime=3274.37 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 100239 0 0 0 325821 1616 0 0 20 0 2 0 23406187 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 55886 25219 3697 46 0 24850 0
[pid=213474/tid=213475] ppid=213472 vsize=223544 memory=2724 CPUtime=2.67 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 196 0 0 0 95 172 0 0 20 0 2 0 23406189 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3274.37 s
Current children cumulated vsize: 233472 KiB
Current children cumulated memory: 103600 KiB

[startup+3342.3 s]
/proc/loadavg: 4.16 4.15 4.12 5/260 215331
/proc/meminfo: memFree=121127316/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=223544 memory=100876 CPUtime=3334.23 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 100758 0 0 0 331783 1640 0 0 20 0 2 0 23406187 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 55886 25219 3697 46 0 24850 0
[pid=213474/tid=213475] ppid=213472 vsize=223544 memory=2724 CPUtime=2.72 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 199 0 0 0 96 176 0 0 20 0 2 0 23406189 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3334.23 s
Current children cumulated vsize: 233472 KiB
Current children cumulated memory: 103600 KiB

[startup+3402.3 s]
/proc/loadavg: 4.16 4.15 4.12 5/259 215341
/proc/meminfo: memFree=121123540/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=223544 memory=100876 CPUtime=3394.1 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 101202 0 0 0 337753 1657 0 0 20 0 2 0 23406187 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 55886 25219 3697 46 0 24850 0
[pid=213474/tid=213475] ppid=213472 vsize=223544 memory=2724 CPUtime=2.78 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 202 0 0 0 98 180 0 0 20 0 2 0 23406189 228909056 25219 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3394.1 s
Current children cumulated vsize: 233472 KiB
Current children cumulated memory: 103600 KiB

[startup+3462.3 s]
/proc/loadavg: 4.19 4.15 4.12 5/262 215356
/proc/meminfo: memFree=121122600/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=254364 memory=101432 CPUtime=3453.97 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 101915 0 0 0 343727 1670 0 0 20 0 2 0 23406187 260468736 25358 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 63591 25358 3697 46 0 32555 0
[pid=213474/tid=213475] ppid=213472 vsize=254364 memory=2724 CPUtime=2.84 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 205 0 0 0 100 184 0 0 20 0 2 0 23406189 260468736 25358 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3453.97 s
Current children cumulated vsize: 264292 KiB
Current children cumulated memory: 104156 KiB

[startup+3522.3 s]
/proc/loadavg: 4.49 4.26 4.16 5/262 215368
/proc/meminfo: memFree=121119372/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=256676 memory=104232 CPUtime=3513.83 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 103501 0 0 0 349694 1689 0 0 20 0 2 0 23406187 262836224 26058 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 64169 26058 3697 46 0 33133 0
[pid=213474/tid=213475] ppid=213472 vsize=256676 memory=68496 CPUtime=2.89 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 208 0 0 0 102 187 0 0 20 0 2 0 23406189 262836224 26058 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3513.83 s
Current children cumulated vsize: 266604 KiB
Current children cumulated memory: 106956 KiB

[startup+3582.3 s]
/proc/loadavg: 4.78 4.35 4.20 5/262 215520
/proc/meminfo: memFree=121227844/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=253840 memory=101524 CPUtime=3573.69 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 105058 0 0 0 355656 1713 0 0 20 0 2 0 23406187 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 63460 25381 3697 46 0 32424 0
[pid=213474/tid=213475] ppid=213472 vsize=253840 memory=7969007950289475744 CPUtime=2.93 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 211 0 0 0 103 190 0 0 20 0 2 0 23406189 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3573.69 s
Current children cumulated vsize: 263768 KiB
Current children cumulated memory: 104248 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3608.7 s]
/proc/loadavg: 4.65 4.36 4.20 5/262 215524
/proc/meminfo: memFree=121202848/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=253840 memory=101524 CPUtime=3600.02 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 105058 0 0 0 358277 1725 0 0 20 0 2 0 23406187 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 63460 25381 3697 46 0 32424 0
[pid=213474/tid=213475] ppid=213472 vsize=253840 memory=2724 CPUtime=2.95 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 211 0 0 0 104 191 0 0 20 0 2 0 23406189 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3600.02 s
Current children cumulated vsize: 263768 KiB
Current children cumulated memory: 104248 KiB

Sending SIGTERM to process tree (bottom up)

[startup+3608.71 s]
# the end of solver process 213472 was just reported to runsolver
# Child status: 143

# cumulated CPU time of all completed processes:  user=3582.78 s, system=17.2595 s

Solver just ended.
Sleeping 2 seconds
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3608.7 s]
/proc/loadavg: 4.65 4.36 4.20 5/262 215524
/proc/meminfo: memFree=121202848/131524600 swapFree=131060368/131071996
[pid=213472] ppid=213469 vsize=9928 memory=2724 CPUtime=0 cores=0,2
/proc/213472/stat : 213472 (run-glibc-2.34.) S 213469 213472 210674 0 -1 4194304 202 0 0 0 0 0 0 0 20 0 1 0 23406186 10166272 681 134679101440 94060671033344 94060672112664 140722801186928 0 0 0 65536 4 65538 0 0 0 17 2 0 0 0 0 0 94060674211120 94060674258308 94060702371840 140722801193923 140722801194080 140722801194080 140722801201091 0
/proc/213472/statm: 2482 681 601 264 0 133 0
[pid=213474] ppid=213472 vsize=253840 memory=101524 CPUtime=3600.02 cores=0,2
/proc/213474/stat : 213474 (ld-linux-x86-64) R 213472 213472 210674 0 -1 4194304 105058 0 0 0 358277 1725 0 0 20 0 2 0 23406187 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
/proc/213474/statm: 63460 25381 3697 46 0 32424 0
[pid=213474/tid=213475] ppid=213472 vsize=253840 memory=2724 CPUtime=2.95 cores=0,2
/proc/213474/task/213475/stat : 213475 (ld-linux-x86-64) S 213472 213472 210674 0 -1 1077936192 211 0 0 0 104 191 0 0 20 0 2 0 23406189 259932160 25381 134679101440 140581239046144 140581239233756 140723012296928 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 140581241334656 140581241344104 93825017577472 140723012305755 140723012305919 140723012305919 140723012313010 0
Current children cumulated CPU time: 3600.02 s
Current children cumulated vsize: 263768 KiB
Current children cumulated memory: 104248 KiB

Child status: 143

Real time (s): 3608.71
CPU time (s): 3600.04
CPU user time (s): 3582.78
CPU system time (s): 17.2595
CPU usage (%): 99.7598
Max. virtual memory (cumulated for all children) (KiB): 266604
Max. memory (cumulated for all children) (KiB): 106956

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3582.78
system time used= 17.2595
maximum resident set size= 104232
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 105273
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 357376
involuntary context switches= 25198


# summary of solver processes directly reported to runsolver:
#   pid: 213472
#   total CPU time (s): 3600.04
#   total CPU user time (s): 3582.78
#   total CPU system time (s): 17.2595

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.60381 second user time and 17.8151 second system time

The end

Launcher Data 

Begin job on nodeC014 at 2024-07-25 02:53:03
IDJOB=4458256
IDBENCH=177189
IDSOLVER=3055
FILE ID=nodeC014/4458256-1721868783
RUNJOBID= nodeC014-1721865095-210684
SLURM_JOB_ID= 8089153
Free space on /tmp= 889916 MiB

SOLVER NAME= IPBHS-GUROBI-SYM 2024-07-09
BENCH NAME= PB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/multverif/diagcomm_greater/normalized-mult_diagcomm_opt_greater_teq_nbits_18.opb
COMMAND LINE= run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458256-1721868783/watcher-4458256-1721868783 -o /tmp/evaluation-result-4458256-1721868783/solver-4458256-1721868783 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210684 --watchdog 3760  run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458256-1721868783.opb

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 858e72f790302981bac4f28574add405
RANDOM SEED=1663213653

nodeC014.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3673.572
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3679.985
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.348
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.928
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3670.519
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.024
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3606.860
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.061
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        121543932 kB
MemAvailable:   129597388 kB
Buffers:          278328 kB
Cached:          8554668 kB
SwapCached:          132 kB
Active:           632444 kB
Inactive:        8654344 kB
Active(anon):       2268 kB
Inactive(anon):   504512 kB
Active(file):     630176 kB
Inactive(file):  8149832 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131060368 kB
Dirty:             41828 kB
Writeback:             4 kB
AnonPages:        447020 kB
Mapped:           108872 kB
Shmem:             52988 kB
KReclaimable:     226544 kB
Slab:             348912 kB
SReclaimable:     226544 kB
SUnreclaim:       122368 kB
KernelStack:        4176 kB
PageTables:        10936 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     927276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            12800 kB
HardwareCorrupted:     0 kB
AnonHugePages:    260096 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      387796 kB
DirectMap2M:    43425792 kB
DirectMap1G:    92274688 kB

Free space on /tmp at the end= 889876 MiB
End job on nodeC014 at 2024-07-25 03:53:12