Trace number 4458139

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
IPBHS-GUROBI-SYM 2024-07-09? (TO) 3600.03 3606.31

General information on the benchmark

NamePB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/multverif/
diagcomm_less/normalized-mult_diagcomm_opt_less_teq_nbits_27.opb
MD5SUMf787a6cdbf9022e9105f9cdbff614d2d
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark3.95625
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables4482
Total number of constraints6669
Number of constraints which are clauses4374
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2295
Minimum length of a constraint2
Maximum length of a constraint5
Number of terms in the objective function 108
Biggest coefficient in the objective function 9007199254740992
Number of bits for the biggest coefficient in the objective function 54
Sum of the numbers in the objective function 36028797018963966
Number of bits of the sum of numbers in the objective function 55
Biggest number in a constraint 9007199254740992
Number of bits of the biggest number in a constraint 54
Biggest sum of numbers in a constraint 36028797018963966
Number of bits of the biggest sum of numbers55
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.06	c initialize IPBHS solver
0.00/0.06	c IPBHS 0.0.0 beta (471c63a-dirty, Jul  9 2024 15:19:29), with Glucose 3.0, with Gurobi 10.0.1, with RoundingSat 2, with SSPB2SAT 0.2.0, with BreakID 0.0.0
0.00/0.06	c optimizer = "gurobi"
0.00/0.06	c pbsolver = "roundingsat"
0.00/0.06	c load symmetries from file ""
0.00/0.06	c set time limit for symmetry computation to 100 seconds.
0.00/0.06	c set interchangeable summation variable limit to 3
0.00/0.06	c find symmetric cores by applying each permutation and add them to optimizer
0.00/0.06	c set abs symmetric core budget per WCE-iteration to 100
0.00/0.06	c set rel symmetric core budget per WCE-iteration to 0
0.00/0.06	c set lit symmetric core budget per WCE-iteration to 0
0.00/0.06	c set sym generation to 's'
0.00/0.06	c set abstraction set creation to 10 iterations without LB change
0.00/0.06	c set abstraction set inputs to 0
0.00/0.06	c set abstraction set cluster min size to 2
0.00/0.06	c set abstraction set cluster max size to 100000000
0.00/0.06	c set abstraction set cluster activation limit to 2
0.00/0.06	c enable abstraction set require equal cost
0.00/0.06	c set abstraction set assumptions to 0
0.00/0.06	c set abstraction set constraint type to 0
0.00/0.06	c set abstract core extraction strategy to b
0.00/0.06	c set core extraction strategy to 2
0.00/0.06	c set core extraction shuffles 10
0.00/0.06	c set cores per iteration to 5
0.00/0.06	c set optimizer bound usage strategy to 2
0.00/0.06	c set optimizer max non-optimal iterations to 1000
0.00/0.06	c set small core cardinality limit to 2
0.00/0.06	c set max coef in cores to 1000000000
0.00/0.06	c set SIS iterations to 5
0.00/0.06	c set SIS budget abs to 1000
0.00/0.06	c set SIS budget rel to 0.05
0.00/0.06	c limit for coefficient in constraints and objective to 9223372036854775807
0.00/0.06	c will solve HOME/instance-4458139-1721865365.opb
3600.02/3606.30	HOME/run-glibc-2.34.sh: line 2: 211908 Terminated              LD_LIBRARY_PATH=/home/evaluation/evaluation/priv/lib:/home/evaluation/evaluation/tools/lib64:/home/evaluation/evaluation/tools/lib:/usr/local/lib:/home/evaluation/evaluation/tools/glibc-2.34/lib/:/lib64 /home/evaluation/evaluation/tools/glibc-2.34/lib/ld-linux-x86-64.so.2 $*

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (58533 MiB free)
  memory of node 1: 64473 MiB (60079 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458139-1721865365/watcher-4458139-1721865365 -o /tmp/evaluation-result-4458139-1721865365/solver-4458139-1721865365 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210685 --watchdog 3760 run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458139-1721865365.opb 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=211906, runsolver pid=211903

[startup+0.100045 s]*
/proc/loadavg: 4.22 2.61 1.16 5/266 211909
/proc/meminfo: memFree=121436492/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=33728 CPUtime=0.1 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 5144 0 0 0 8 2 0 0 20 0 2 0 23064441 167411712 8432 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 8432 2972 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=4026561614 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) R 211906 211906 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 8432 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 36504 KiB

[startup+0.206231 s]*
/proc/loadavg: 4.22 2.61 1.16 5/266 211909
/proc/meminfo: memFree=121436324/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=36412 CPUtime=0.2 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 5152 0 0 0 17 3 0 0 20 0 2 0 23064441 167411712 9103 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 9103 3618 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=3471202400344241230 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) R 211906 211906 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 9103 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 39188 KiB

[startup+0.305493 s]*
/proc/loadavg: 4.22 2.61 1.16 5/266 211909
/proc/meminfo: memFree=121436072/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=36412 CPUtime=0.29 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 5169 0 0 0 26 3 0 0 20 0 2 0 23064441 167411712 9103 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 9103 3618 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=-8538478091101301350 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 9103 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 39188 KiB

[startup+0.700185 s]
/proc/loadavg: 4.22 2.61 1.16 5/266 211909
/proc/meminfo: memFree=121435968/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=36724 CPUtime=0.69 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 5246 0 0 0 65 4 0 0 20 0 2 0 23064441 167411712 9181 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 9181 3631 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=5552 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 9181 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 39500 KiB

[startup+1.50019 s]
/proc/loadavg: 4.22 2.61 1.16 5/266 211909
/proc/meminfo: memFree=121435632/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=36988 CPUtime=1.49 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 5321 0 0 0 144 5 0 0 20 0 2 0 23064441 167411712 9247 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 9247 3631 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=11624 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 9247 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 39764 KiB

[startup+3.1061 s]
/proc/loadavg: 4.21 2.63 1.18 5/266 211910
/proc/meminfo: memFree=121431888/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=163488 memory=39904 CPUtime=3.09 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 7106 0 0 0 302 7 0 0 20 0 2 0 23064441 167411712 9976 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 40872 9976 3631 46 0 9836 0
[pid=211908/tid=211909] ppid=211906 vsize=163488 memory=39796 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 4 0 0 0 0 0 0 0 20 0 2 0 23064445 167411712 9976 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 173416 KiB
Current children cumulated memory: 42680 KiB

[startup+6.30021 s]
/proc/loadavg: 4.21 2.63 1.18 5/266 211910
/proc/meminfo: memFree=121431228/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=166208 memory=43052 CPUtime=6.27 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 10029 0 0 0 616 11 0 0 20 0 2 0 23064441 170196992 10763 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 41552 10763 3631 46 0 10516 0
[pid=211908/tid=211909] ppid=211906 vsize=166208 memory=36988 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 8 0 0 0 0 0 0 0 20 0 2 0 23064445 170196992 10763 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 176136 KiB
Current children cumulated memory: 45828 KiB

[startup+12.7003 s]
/proc/loadavg: 4.25 2.69 1.21 5/266 211912
/proc/meminfo: memFree=121428152/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=166208 memory=43144 CPUtime=12.65 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 16458 0 0 0 1249 16 0 0 20 0 2 0 23064441 170196992 10786 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 41552 10786 3631 46 0 10516 0
[pid=211908/tid=211909] ppid=211906 vsize=166208 memory=43144 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 17 0 0 0 0 0 0 0 20 0 2 0 23064445 170196992 10786 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 176136 KiB
Current children cumulated memory: 45920 KiB

[startup+25.5003 s]
/proc/loadavg: 4.21 2.74 1.24 5/266 211913
/proc/meminfo: memFree=121405236/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=167852 memory=44460 CPUtime=25.42 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 23804 0 0 0 2518 24 0 0 20 0 2 0 23064441 171880448 11115 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 41963 11115 3631 46 0 10927 0
[pid=211908/tid=211909] ppid=211906 vsize=167852 memory=-8538478091101301350 CPUtime=0 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 26 0 0 0 0 0 0 0 20 0 2 0 23064445 171880448 11115 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 177780 KiB
Current children cumulated memory: 47236 KiB

[startup+51.1061 s]
/proc/loadavg: 4.14 2.84 1.32 5/261 211916
/proc/meminfo: memFree=121397668/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=174540 memory=47632 CPUtime=50.96 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 37146 0 0 0 5059 37 0 0 20 0 2 0 23064441 178728960 11908 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 43635 11908 3631 46 0 12599 0
[pid=211908/tid=211909] ppid=211906 vsize=174540 memory=2776 CPUtime=0.01 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 41 0 0 0 0 1 0 0 20 0 2 0 23064445 178728960 11908 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 50.96 s
Current children cumulated vsize: 184468 KiB
Current children cumulated memory: 50408 KiB

[startup+102.3 s]
/proc/loadavg: 4.16 3.07 1.49 5/261 211927
/proc/meminfo: memFree=121379184/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=177680 memory=53440 CPUtime=102.05 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 40199 0 0 0 10151 54 0 0 20 0 2 0 23064441 181944320 13360 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 44420 13360 3631 46 0 13384 0
[pid=211908/tid=211909] ppid=211906 vsize=177680 memory=53440 CPUtime=0.04 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 47 0 0 0 1 3 0 0 20 0 2 0 23064445 181944320 13360 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 102.05 s
Current children cumulated vsize: 187608 KiB
Current children cumulated memory: 56216 KiB

[startup+162.3 s]

################
# More data... #
################

/proc/211908/statm: 61563 27327 3631 46 0 30527 0
[pid=211908/tid=211909] ppid=211906 vsize=246252 memory=12368 CPUtime=2.23 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 203 0 0 0 81 142 0 0 20 0 2 0 23064445 252162048 27327 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3156.75 s
Current children cumulated vsize: 256180 KiB
Current children cumulated memory: 112084 KiB

[startup+3222.3 s]
/proc/loadavg: 4.10 4.17 4.08 5/260 213294
/proc/meminfo: memFree=120666736/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=246252 memory=109308 CPUtime=3216.66 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 212252 0 0 0 321116 550 0 0 20 0 2 0 23064441 252162048 27327 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61563 27327 3631 46 0 30527 0
[pid=211908/tid=211909] ppid=211906 vsize=246252 memory=2776 CPUtime=2.29 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 206 0 0 0 83 146 0 0 20 0 2 0 23064445 252162048 27327 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3216.66 s
Current children cumulated vsize: 256180 KiB
Current children cumulated memory: 112084 KiB

[startup+3282.3 s]
/proc/loadavg: 4.22 4.18 4.09 5/262 213309
/proc/meminfo: memFree=120646460/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247804 memory=110300 CPUtime=3276.56 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 213165 0 0 0 327101 555 0 0 20 0 2 0 23064441 253751296 27575 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61951 27575 3631 46 0 30915 0
[pid=211908/tid=211909] ppid=211906 vsize=247804 memory=2776 CPUtime=2.33 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 209 0 0 0 85 148 0 0 20 0 2 0 23064445 253751296 27575 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3276.56 s
Current children cumulated vsize: 257732 KiB
Current children cumulated memory: 113076 KiB

[startup+3342.3 s]
/proc/loadavg: 4.19 4.18 4.09 5/262 213368
/proc/meminfo: memFree=121320924/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247804 memory=110428 CPUtime=3336.47 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 213604 0 0 0 333084 563 0 0 20 0 2 0 23064441 253751296 27607 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61951 27607 3631 46 0 30915 0
[pid=211908/tid=211909] ppid=211906 vsize=247804 memory=2776 CPUtime=2.38 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 212 0 0 0 87 151 0 0 20 0 2 0 23064445 253751296 27607 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3336.47 s
Current children cumulated vsize: 257732 KiB
Current children cumulated memory: 113204 KiB

[startup+3402.3 s]
/proc/loadavg: 4.12 4.16 4.09 5/262 213425
/proc/meminfo: memFree=121450324/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247804 memory=110428 CPUtime=3396.37 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 214146 0 0 0 339070 567 0 0 20 0 2 0 23064441 253751296 27607 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61951 27607 3631 46 0 30915 0
[pid=211908/tid=211909] ppid=211906 vsize=247804 memory=2776 CPUtime=2.42 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 215 0 0 0 89 153 0 0 20 0 2 0 23064445 253751296 27607 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3396.37 s
Current children cumulated vsize: 257732 KiB
Current children cumulated memory: 113204 KiB

[startup+3462.3 s]
/proc/loadavg: 4.23 4.19 4.10 5/263 213483
/proc/meminfo: memFree=121497540/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247804 memory=110788 CPUtime=3456.28 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 214703 0 0 0 345054 574 0 0 20 0 2 0 23064441 253751296 27697 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61951 27697 3631 46 0 30915 0
[pid=211908/tid=211909] ppid=211906 vsize=247804 memory=18176 CPUtime=2.47 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 218 0 0 0 91 156 0 0 20 0 2 0 23064445 253751296 27697 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3456.28 s
Current children cumulated vsize: 257732 KiB
Current children cumulated memory: 113564 KiB

[startup+3522.3 s]
/proc/loadavg: 4.13 4.17 4.10 5/262 213494
/proc/meminfo: memFree=121459916/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247936 memory=110928 CPUtime=3516.18 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 215147 0 0 0 351038 580 0 0 20 0 2 0 23064441 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61984 27732 3631 46 0 30948 0
[pid=211908/tid=211909] ppid=211906 vsize=247936 memory=2776 CPUtime=2.51 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 221 0 0 0 93 158 0 0 20 0 2 0 23064445 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3516.18 s
Current children cumulated vsize: 257864 KiB
Current children cumulated memory: 113704 KiB

[startup+3582.3 s]
/proc/loadavg: 4.09 4.15 4.09 5/261 213887
/proc/meminfo: memFree=121430488/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247936 memory=110928 CPUtime=3576.06 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 215444 0 0 0 357019 587 0 0 20 0 2 0 23064441 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61984 27732 3631 46 0 30948 0
[pid=211908/tid=211909] ppid=211906 vsize=247936 memory=50468 CPUtime=2.55 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 224 0 0 0 94 161 0 0 20 0 2 0 23064445 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3576.06 s
Current children cumulated vsize: 257864 KiB
Current children cumulated memory: 113704 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3606.3 s]
/proc/loadavg: 4.26 4.18 4.10 5/261 213891
/proc/meminfo: memFree=121420328/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247936 memory=110928 CPUtime=3600.02 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 215450 0 0 0 359412 590 0 0 20 0 2 0 23064441 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61984 27732 3631 46 0 30948 0
[pid=211908/tid=211909] ppid=211906 vsize=247936 memory=18176 CPUtime=2.57 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 224 0 0 0 95 162 0 0 20 0 2 0 23064445 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3600.02 s
Current children cumulated vsize: 257864 KiB
Current children cumulated memory: 113704 KiB

Sending SIGTERM to process tree (bottom up)

[startup+3606.31 s]
# the end of solver process 211906 was just reported to runsolver
# Child status: 143

# cumulated CPU time of all completed processes:  user=3594.13 s, system=5.90276 s

Solver just ended.
Sleeping 2 seconds
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3606.3 s]
/proc/loadavg: 4.26 4.18 4.10 5/261 213891
/proc/meminfo: memFree=121420328/131524600 swapFree=131060368/131071996
[pid=211906] ppid=211903 vsize=9928 memory=2776 CPUtime=0 cores=4,6
/proc/211906/stat : 211906 (run-glibc-2.34.) S 211903 211906 210674 0 -1 4194304 207 0 0 0 0 0 0 0 20 0 1 0 23064441 10166272 694 134679101440 93852793401344 93852794480664 140729700544912 0 0 0 65536 4 65538 0 0 0 17 6 0 0 0 0 0 93852796579120 93852796626308 93852798947328 140729700549571 140729700549728 140729700549728 140729700556739 0
/proc/211906/statm: 2482 694 613 264 0 133 0
[pid=211908] ppid=211906 vsize=247936 memory=110928 CPUtime=3600.02 cores=4,6
/proc/211908/stat : 211908 (ld-linux-x86-64) R 211906 211906 210674 0 -1 4194304 215450 0 0 0 359412 590 0 0 20 0 2 0 23064441 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
/proc/211908/statm: 61984 27732 3631 46 0 30948 0
[pid=211908/tid=211909] ppid=211906 vsize=247936 memory=18176 CPUtime=2.57 cores=4,6
/proc/211908/task/211909/stat : 211909 (ld-linux-x86-64) S 211906 211906 210674 0 -1 1077936192 224 0 0 0 95 162 0 0 20 0 2 0 23064445 253886464 27732 134679101440 140336161050624 140336161238236 140726092069328 0 0 0 0 4096 0 1 0 0 -1 6 0 0 0 0 0 140336163339136 140336163348584 93825009242112 140726092071771 140726092071935 140726092071935 140726092079026 0
Current children cumulated CPU time: 3600.02 s
Current children cumulated vsize: 257864 KiB
Current children cumulated memory: 113704 KiB

Child status: 143

Real time (s): 3606.31
CPU time (s): 3600.03
CPU user time (s): 3594.13
CPU system time (s): 5.90276
CPU usage (%): 99.826
Max. virtual memory (cumulated for all children) (KiB): 257864
Max. memory (cumulated for all children) (KiB): 113704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3594.13
system time used= 5.90276
maximum resident set size= 110928
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 215670
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 357170
involuntary context switches= 3154


# summary of solver processes directly reported to runsolver:
#   pid: 211906
#   total CPU time (s): 3600.03
#   total CPU user time (s): 3594.13
#   total CPU system time (s): 5.90276

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.25307 second user time and 19.1054 second system time

The end

Launcher Data 

Begin job on nodeC014 at 2024-07-25 01:56:05
IDJOB=4458139
IDBENCH=177166
IDSOLVER=3055
FILE ID=nodeC014/4458139-1721865365
RUNJOBID= nodeC014-1721865095-210685
SLURM_JOB_ID= 8089153
Free space on /tmp= 889912 MiB

SOLVER NAME= IPBHS-GUROBI-SYM 2024-07-09
BENCH NAME= PB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/multverif/diagcomm_less/normalized-mult_diagcomm_opt_less_teq_nbits_27.opb
COMMAND LINE= run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458139-1721865365/watcher-4458139-1721865365 -o /tmp/evaluation-result-4458139-1721865365/solver-4458139-1721865365 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210685 --watchdog 3760  run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458139-1721865365.opb

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= f787a6cdbf9022e9105f9cdbff614d2d
RANDOM SEED=1663213653

nodeC014.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3670.949
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.844
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3610.000
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.763
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3657.576
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.846
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.498
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.974
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        121459708 kB
MemAvailable:   129497816 kB
Buffers:          274984 kB
Cached:          8542700 kB
SwapCached:          132 kB
Active:           633528 kB
Inactive:        8736444 kB
Active(anon):       2268 kB
Inactive(anon):   603004 kB
Active(file):     631260 kB
Inactive(file):  8133440 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131060368 kB
Dirty:             41784 kB
Writeback:            12 kB
AnonPages:        549188 kB
Mapped:           108600 kB
Shmem:             52988 kB
KReclaimable:     226460 kB
Slab:             348816 kB
SReclaimable:     226460 kB
SUnreclaim:       122356 kB
KernelStack:        4224 kB
PageTables:        10848 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1123556 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            12800 kB
HardwareCorrupted:     0 kB
AnonHugePages:    309248 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      387796 kB
DirectMap2M:    43425792 kB
DirectMap1G:    92274688 kB

Free space on /tmp at the end= 889876 MiB
End job on nodeC014 at 2024-07-25 02:56:12