Trace number 4458451

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
IPBHS-GUROBI-SYM 2024-07-09? (TO) 3600.02 3609.51

General information on the benchmark

NamePB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/injcomp/injcomp_opt_4layers_maxall_lastlayerdiv2/
normalized-injcomp_opt_4layers_maxall_lastlayerdiv2_size_16.opb
MD5SUM678da6339402b89815c46f6042afd950
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-32
Best CPU time to get the best result obtained on this benchmark506.649
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1056
Total number of constraints488
Number of constraints which are clauses416
Number of constraints which are cardinality constraints (but not clauses)40
Number of constraints which are nor clauses,nor cardinality constraints32
Minimum length of a constraint3
Maximum length of a constraint17
Number of terms in the objective function 640
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 640
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 16
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 640
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.01	c initialize IPBHS solver
0.00/0.01	c IPBHS 0.0.0 beta (471c63a-dirty, Jul  9 2024 15:19:29), with Glucose 3.0, with Gurobi 10.0.1, with RoundingSat 2, with SSPB2SAT 0.2.0, with BreakID 0.0.0
0.00/0.01	c optimizer = "gurobi"
0.00/0.01	c pbsolver = "roundingsat"
0.00/0.01	c load symmetries from file ""
0.00/0.01	c set time limit for symmetry computation to 100 seconds.
0.00/0.01	c set interchangeable summation variable limit to 3
0.00/0.01	c find symmetric cores by applying each permutation and add them to optimizer
0.00/0.01	c set abs symmetric core budget per WCE-iteration to 100
0.00/0.01	c set rel symmetric core budget per WCE-iteration to 0
0.00/0.01	c set lit symmetric core budget per WCE-iteration to 0
0.00/0.01	c set sym generation to 's'
0.00/0.01	c set abstraction set creation to 10 iterations without LB change
0.00/0.01	c set abstraction set inputs to 0
0.00/0.01	c set abstraction set cluster min size to 2
0.00/0.01	c set abstraction set cluster max size to 100000000
0.00/0.01	c set abstraction set cluster activation limit to 2
0.00/0.01	c enable abstraction set require equal cost
0.00/0.01	c set abstraction set assumptions to 0
0.00/0.01	c set abstraction set constraint type to 0
0.00/0.01	c set abstract core extraction strategy to b
0.00/0.01	c set core extraction strategy to 2
0.00/0.01	c set core extraction shuffles 10
0.00/0.01	c set cores per iteration to 5
0.00/0.01	c set optimizer bound usage strategy to 2
0.00/0.01	c set optimizer max non-optimal iterations to 1000
0.00/0.01	c set small core cardinality limit to 2
0.00/0.01	c set max coef in cores to 1000000000
0.00/0.01	c set SIS iterations to 5
0.00/0.01	c set SIS budget abs to 1000
0.00/0.01	c set SIS budget rel to 0.05
0.00/0.01	c limit for coefficient in constraints and objective to 9223372036854775807
0.00/0.01	c will solve HOME/instance-4458451-1721872392.opb
3600.00/3609.50	HOME/run-glibc-2.34.sh: line 2: 215571 Terminated              LD_LIBRARY_PATH=/home/evaluation/evaluation/priv/lib:/home/evaluation/evaluation/tools/lib64:/home/evaluation/evaluation/tools/lib:/usr/local/lib:/home/evaluation/evaluation/tools/glibc-2.34/lib/:/lib64 /home/evaluation/evaluation/tools/glibc-2.34/lib/ld-linux-x86-64.so.2 $*

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (58409 MiB free)
  memory of node 1: 64473 MiB (60038 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458451-1721872392/watcher-4458451-1721872392 -o /tmp/evaluation-result-4458451-1721872392/solver-4458451-1721872392 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210684 --watchdog 3760 run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458451-1721872392.opb 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=215569, runsolver pid=215566
Current StackSize limit: 8192 KiB


[startup+0.100057 s]*
/proc/loadavg: 4.65 4.36 4.20 5/262 215572
/proc/meminfo: memFree=121278376/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=153124 memory=27012 CPUtime=0.09 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 2244 0 0 0 9 0 0 0 20 0 2 0 23767098 156798976 6753 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 38281 6753 3863 46 0 7245 0
[pid=215571/tid=215572] ppid=215569 vsize=153124 memory=4026561614 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) R 215569 215569 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23767099 156798976 6753 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 163052 KiB
Current children cumulated memory: 29608 KiB

[startup+0.205686 s]*
/proc/loadavg: 4.65 4.36 4.20 5/262 215572
/proc/meminfo: memFree=121275684/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=153124 memory=29584 CPUtime=0.2 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 2351 0 0 0 19 1 0 0 20 0 2 0 23767098 156798976 7396 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 38281 7396 3863 46 0 7245 0
[pid=215571/tid=215572] ppid=215569 vsize=153124 memory=3471202400344241230 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) R 215569 215569 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23767099 156798976 7396 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 163052 KiB
Current children cumulated memory: 32180 KiB

[startup+0.305606 s]*
/proc/loadavg: 4.65 4.36 4.20 5/262 215572
/proc/meminfo: memFree=121275208/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=153124 memory=29848 CPUtime=0.3 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 2457 0 0 0 29 1 0 0 20 0 2 0 23767098 156798976 7462 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 38281 7462 3863 46 0 7245 0
[pid=215571/tid=215572] ppid=215569 vsize=153124 memory=-8825582597293762150 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23767099 156798976 7462 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 163052 KiB
Current children cumulated memory: 32444 KiB

[startup+0.700268 s]
/proc/loadavg: 4.65 4.36 4.20 5/262 215572
/proc/meminfo: memFree=121274052/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=153660 memory=30904 CPUtime=0.68 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 2689 0 0 0 67 1 0 0 20 0 2 0 23767098 157347840 7726 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 38415 7726 3863 46 0 7379 0
[pid=215571/tid=215572] ppid=215569 vsize=153660 memory=5552 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23767099 157347840 7726 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 163588 KiB
Current children cumulated memory: 33500 KiB

[startup+1.50027 s]
/proc/loadavg: 4.65 4.36 4.20 5/262 215572
/proc/meminfo: memFree=121271000/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=155624 memory=33544 CPUtime=1.48 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 3344 0 0 0 145 3 0 0 20 0 2 0 23767098 159358976 8386 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 38906 8386 3863 46 0 7870 0
[pid=215571/tid=215572] ppid=215569 vsize=155624 memory=11624 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 2 0 23767099 159358976 8386 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 165552 KiB
Current children cumulated memory: 36140 KiB

[startup+3.10556 s]
/proc/loadavg: 4.60 4.35 4.20 5/262 215572
/proc/meminfo: memFree=121260680/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=159612 memory=36036 CPUtime=3.09 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 5657 0 0 0 302 7 0 0 20 0 2 0 23767098 163442688 9009 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 39903 9009 3863 46 0 8867 0
[pid=215571/tid=215572] ppid=215569 vsize=159612 memory=36036 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 4 0 0 0 0 0 0 0 20 0 2 0 23767099 163442688 9009 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 169540 KiB
Current children cumulated memory: 38632 KiB

[startup+6.30025 s]
/proc/loadavg: 4.60 4.35 4.20 5/262 215574
/proc/meminfo: memFree=121251640/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=161032 memory=38084 CPUtime=6.27 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 9078 0 0 0 617 10 0 0 20 0 2 0 23767098 164896768 9521 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 40258 9521 3863 46 0 9222 0
[pid=215571/tid=215572] ppid=215569 vsize=161032 memory=33544 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 8 0 0 0 0 0 0 0 20 0 2 0 23767099 164896768 9521 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 170960 KiB
Current children cumulated memory: 40680 KiB

[startup+12.7003 s]
/proc/loadavg: 4.51 4.34 4.20 5/262 215574
/proc/meminfo: memFree=121240708/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=162576 memory=39932 CPUtime=12.65 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 16084 0 0 0 1245 20 0 0 20 0 2 0 23767098 166477824 9983 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 40644 9983 3863 46 0 9608 0
[pid=215571/tid=215572] ppid=215569 vsize=162576 memory=39932 CPUtime=0 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 17 0 0 0 0 0 0 0 20 0 2 0 23767099 166477824 9983 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 172504 KiB
Current children cumulated memory: 42528 KiB

[startup+25.5003 s]
/proc/loadavg: 4.43 4.33 4.19 5/262 215575
/proc/meminfo: memFree=121237200/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=168564 memory=42928 CPUtime=25.42 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 24334 0 0 0 2506 36 0 0 20 0 2 0 23767098 172609536 10732 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 42141 10732 3863 46 0 11105 0
[pid=215571/tid=215572] ppid=215569 vsize=168564 memory=-8825582597293762150 CPUtime=0.01 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 26 0 0 0 0 1 0 0 20 0 2 0 23767099 172609536 10732 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 178492 KiB
Current children cumulated memory: 45524 KiB

[startup+51.1056 s]
/proc/loadavg: 4.36 4.32 4.19 5/262 215580
/proc/meminfo: memFree=121213072/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=171096 memory=48316 CPUtime=50.95 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 37756 0 0 0 5025 70 0 0 20 0 2 0 23767098 175202304 12079 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 42774 12079 3863 46 0 11738 0
[pid=215571/tid=215572] ppid=215569 vsize=171096 memory=2596 CPUtime=0.03 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 41 0 0 0 1 2 0 0 20 0 2 0 23767099 175202304 12079 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 181024 KiB
Current children cumulated memory: 50912 KiB

[startup+102.3 s]
/proc/loadavg: 4.20 4.28 4.18 5/262 215589
/proc/meminfo: memFree=121177356/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=182284 memory=53064 CPUtime=102.01 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 50715 0 0 0 10073 128 0 0 20 0 2 0 23767098 186658816 13266 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 45571 13266 3863 46 0 14535 0
[pid=215571/tid=215572] ppid=215569 vsize=182284 memory=53032 CPUtime=0.07 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 51 0 0 0 3 4 0 0 20 0 2 0 23767099 186658816 13266 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 102.01 s
Current children cumulated vsize: 192212 KiB
Current children cumulated memory: 55660 KiB

[startup+162.3 s]

################
# More data... #
################

/proc/215571/statm: 65758 32201 3863 46 0 34722 0
[pid=215571/tid=215572] ppid=215569 vsize=263032 memory=128800 CPUtime=3.18 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 311 0 0 0 108 210 0 0 20 0 2 0 23767099 269344768 32201 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3153.87 s
Current children cumulated vsize: 272960 KiB
Current children cumulated memory: 131400 KiB

[startup+3222.3 s]
/proc/loadavg: 4.11 4.14 4.14 5/259 217387
/proc/meminfo: memFree=119653616/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263032 memory=128804 CPUtime=3213.73 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 195466 0 0 0 319600 1773 0 0 20 0 2 0 23767098 269344768 32201 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65758 32201 3863 46 0 34722 0
[pid=215571/tid=215572] ppid=215569 vsize=263032 memory=2596 CPUtime=3.26 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 316 0 0 0 111 215 0 0 20 0 2 0 23767099 269344768 32201 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3213.73 s
Current children cumulated vsize: 272960 KiB
Current children cumulated memory: 131400 KiB

[startup+3282.3 s]
/proc/loadavg: 4.14 4.14 4.14 5/259 217397
/proc/meminfo: memFree=119652416/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263392 memory=129164 CPUtime=3273.58 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 198058 0 0 0 325563 1795 0 0 20 0 2 0 23767098 269713408 32291 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65848 32291 3863 46 0 34812 0
[pid=215571/tid=215572] ppid=215569 vsize=263392 memory=2596 CPUtime=3.33 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 321 0 0 0 114 219 0 0 20 0 2 0 23767099 269713408 32291 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3273.58 s
Current children cumulated vsize: 273320 KiB
Current children cumulated memory: 131760 KiB

[startup+3342.3 s]
/proc/loadavg: 4.10 4.13 4.13 5/260 217408
/proc/meminfo: memFree=119575804/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263392 memory=129164 CPUtime=3333.43 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 200413 0 0 0 331525 1818 0 0 20 0 2 0 23767098 269713408 32291 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65848 32291 3863 46 0 34812 0
[pid=215571/tid=215572] ppid=215569 vsize=263392 memory=2596 CPUtime=3.4 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 326 0 0 0 117 223 0 0 20 0 2 0 23767099 269713408 32291 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3333.43 s
Current children cumulated vsize: 273320 KiB
Current children cumulated memory: 131760 KiB

[startup+3402.3 s]
/proc/loadavg: 4.15 4.13 4.13 5/260 217419
/proc/meminfo: memFree=119573288/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263392 memory=129168 CPUtime=3393.28 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 203416 0 0 0 337486 1842 0 0 20 0 2 0 23767098 269713408 32292 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65848 32292 3863 46 0 34812 0
[pid=215571/tid=215572] ppid=215569 vsize=263392 memory=11624 CPUtime=3.46 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 331 0 0 0 119 227 0 0 20 0 2 0 23767099 269713408 32292 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3393.28 s
Current children cumulated vsize: 273320 KiB
Current children cumulated memory: 131764 KiB

[startup+3462.3 s]
/proc/loadavg: 4.16 4.14 4.13 5/263 217434
/proc/meminfo: memFree=119557236/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263816 memory=129452 CPUtime=3453.13 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 205929 0 0 0 343450 1863 0 0 20 0 2 0 23767098 270147584 32363 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65954 32363 3863 46 0 34918 0
[pid=215571/tid=215572] ppid=215569 vsize=263816 memory=2596 CPUtime=3.53 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 336 0 0 0 121 232 0 0 20 0 2 0 23767099 270147584 32363 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3453.13 s
Current children cumulated vsize: 273744 KiB
Current children cumulated memory: 132048 KiB

[startup+3522.3 s]
/proc/loadavg: 4.10 4.13 4.12 5/263 217446
/proc/meminfo: memFree=119554276/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263816 memory=132124 CPUtime=3512.98 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 206809 0 0 0 349412 1886 0 0 20 0 2 0 23767098 270147584 33031 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65954 33031 3863 46 0 34918 0
[pid=215571/tid=215572] ppid=215569 vsize=263816 memory=2596 CPUtime=3.59 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 341 0 0 0 123 236 0 0 20 0 2 0 23767099 270147584 33031 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3512.98 s
Current children cumulated vsize: 273744 KiB
Current children cumulated memory: 134720 KiB

[startup+3582.3 s]
/proc/loadavg: 3.15 3.87 4.03 3/245 217517
/proc/meminfo: memFree=121016900/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=263816 memory=132124 CPUtime=3572.86 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 207161 0 0 0 355379 1907 0 0 20 0 2 0 23767098 270147584 33031 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 65954 33031 3863 46 0 34918 0
[pid=215571/tid=215572] ppid=215569 vsize=263816 memory=11624 CPUtime=3.67 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 346 0 0 0 126 241 0 0 20 0 2 0 23767099 270147584 33031 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3572.86 s
Current children cumulated vsize: 273744 KiB
Current children cumulated memory: 134720 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3609.5 s]
/proc/loadavg: 2.78 3.70 3.97 3/245 217522
/proc/meminfo: memFree=121016264/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=264208 memory=132464 CPUtime=3600 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 207440 0 0 0 358080 1920 0 0 20 0 2 0 23767098 270548992 33116 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 66052 33116 3863 46 0 35016 0
[pid=215571/tid=215572] ppid=215569 vsize=264208 memory=2596 CPUtime=3.7 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 346 0 0 0 127 243 0 0 20 0 2 0 23767099 270548992 33116 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3600 s
Current children cumulated vsize: 274136 KiB
Current children cumulated memory: 135060 KiB

Sending SIGTERM to process tree (bottom up)

[startup+3609.51 s]
# the end of solver process 215569 was just reported to runsolver
# Child status: 143

# cumulated CPU time of all completed processes:  user=3580.81 s, system=19.2099 s

Solver just ended.
Sleeping 2 seconds
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3609.5 s]
/proc/loadavg: 2.78 3.70 3.97 3/245 217522
/proc/meminfo: memFree=121016264/131524600 swapFree=131060368/131071996
[pid=215569] ppid=215566 vsize=9928 memory=2596 CPUtime=0 cores=0,2
/proc/215569/stat : 215569 (run-glibc-2.34.) S 215566 215569 210674 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 23767098 10166272 649 134679101440 94331518570496 94331519649816 140730377007376 0 0 0 65536 4 65538 0 0 0 17 0 0 0 0 0 0 94331521748272 94331521795460 94331552976896 140730377012163 140730377012320 140730377012320 140730377019331 0
/proc/215569/statm: 2482 649 568 264 0 133 0
[pid=215571] ppid=215569 vsize=264208 memory=132464 CPUtime=3600 cores=0,2
/proc/215571/stat : 215571 (ld-linux-x86-64) R 215569 215569 210674 0 -1 4194304 207440 0 0 0 358080 1920 0 0 20 0 2 0 23767098 270548992 33116 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
/proc/215571/statm: 66052 33116 3863 46 0 35016 0
[pid=215571/tid=215572] ppid=215569 vsize=264208 memory=2596 CPUtime=3.7 cores=0,2
/proc/215571/task/215572/stat : 215572 (ld-linux-x86-64) S 215569 215569 210674 0 -1 1077936192 346 0 0 0 127 243 0 0 20 0 2 0 23767099 270548992 33116 134679101440 139701593038848 139701593226460 140733634188960 0 0 0 0 4096 0 1 0 0 -1 2 0 0 0 0 0 139701595327360 139701595336808 93825020588032 140733634192219 140733634192383 140733634192383 140733634199474 0
Current children cumulated CPU time: 3600 s
Current children cumulated vsize: 274136 KiB
Current children cumulated memory: 135060 KiB

Child status: 143

Real time (s): 3609.51
CPU time (s): 3600.02
CPU user time (s): 3580.81
CPU system time (s): 19.2099
CPU usage (%): 99.7373
Max. virtual memory (cumulated for all children) (KiB): 274136
Max. memory (cumulated for all children) (KiB): 135060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3580.81
system time used= 19.2099
maximum resident set size= 132516
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 207658
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 357492
involuntary context switches= 25187


# summary of solver processes directly reported to runsolver:
#   pid: 215569
#   total CPU time (s): 3600.02
#   total CPU user time (s): 3580.81
#   total CPU system time (s): 19.2099

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.72269 second user time and 17.361 second system time

The end

Launcher Data 

Begin job on nodeC014 at 2024-07-25 03:53:12
IDJOB=4458451
IDBENCH=177485
IDSOLVER=3055
FILE ID=nodeC014/4458451-1721872392
RUNJOBID= nodeC014-1721865095-210684
SLURM_JOB_ID= 8089153
Free space on /tmp= 889916 MiB

SOLVER NAME= IPBHS-GUROBI-SYM 2024-07-09
BENCH NAME= PB24/normalized-PB24/OPT-LIN/nordstrom/CoreGuidedPB/injcomp/injcomp_opt_4layers_maxall_lastlayerdiv2/normalized-injcomp_opt_4layers_maxall_lastlayerdiv2_size_16.opb
COMMAND LINE= run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4458451-1721872392/watcher-4458451-1721872392 -o /tmp/evaluation-result-4458451-1721872392/solver-4458451-1721872392 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC014-1721865095-210684 --watchdog 3760  run-glibc-2.34.sh ./ipbhs_gurobi --sym-cores HOME/instance-4458451-1721872392.opb

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 678da6339402b89815c46f6042afd950
RANDOM SEED=1183974407

nodeC014.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3659.179
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3677.180
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.861
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.952
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3670.301
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3677.187
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3604.578
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.048
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        121291412 kB
MemAvailable:   129365548 kB
Buffers:          281700 kB
Cached:          8571980 kB
SwapCached:          132 kB
Active:           636120 kB
Inactive:        8903048 kB
Active(anon):       2268 kB
Inactive(anon):   736212 kB
Active(file):     633852 kB
Inactive(file):  8166836 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131060368 kB
Dirty:             41884 kB
Writeback:             4 kB
AnonPages:        678504 kB
Mapped:           109132 kB
Shmem:             52988 kB
KReclaimable:     226544 kB
Slab:             348812 kB
SReclaimable:     226544 kB
SUnreclaim:       122268 kB
KernelStack:        4176 kB
PageTables:        11388 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1163248 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            12800 kB
HardwareCorrupted:     0 kB
AnonHugePages:    368640 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      387796 kB
DirectMap2M:    43425792 kB
DirectMap1G:    92274688 kB

Free space on /tmp at the end= 889956 MiB
End job on nodeC014 at 2024-07-25 04:53:22