Trace number 4456277

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? (TO) 3600.13 3612.46

General information on the benchmark

NamePB24/WBO/SOFT-LIN/PB10/oliveras/j120/
normalized-j12015_3-unsat--soft-0-100-0.wbo
MD5SUM18c39288ed23615941737d5b505374c3
Bench CategorySOFT-LIN (WBO, only soft constraints, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark79.1951
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables21054
Total number of constraints66352
Number of soft constraints66352
Number of constraints which are clauses66008
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints344
Minimum length of a constraint1
Maximum length of a constraint93
Top cost 3337053
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 3337052
Biggest number in a constraint 46
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 599
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.50/0.56	c Default LC presolving (default).
0.50/0.56	c ** Before presolving: virtualMemUsedAtLc = 504380878, getVmSize() = 336437248, SCIPgetMemUsed() = 293870667, SCIPgetMemTotal() = 301376859, SCIPgetMemExternEstim() = 203004019
0.50/0.56	c ** set memory limit for presolving in LC to 8.79594e+12 for SCIP **
3.78/3.84	c ** Estimated virtualMemUsedAtSolver = 612018028, getVmSize() = 793960448, SCIPgetMemUsed() = 507042480, SCIPgetMemTotal() = 715023024, SCIPgetMemExternEstim() = 203004019
3.78/3.84	c ** set memory limit for solvers to 4.39803e+12 for each SCIP **
3.78/3.84	c Original Problem   :
3.78/3.84	c   Problem name     : instance-4456277-1721718971
3.78/3.84	c   Variables        : 87406 (87406 binary, 0 integer, 0 implicit integer, 0 continuous)
3.78/3.84	c   Constraints      : 132705
3.78/3.84	c   Objective sense  : minimize
3.78/3.84	c Presolved Problem  :
3.78/3.84	c   Variables        : 153733 (87406 binary, 0 integer, 66327 implicit integer, 0 continuous)
3.78/3.84	c   Constraints      : 132704
3.78/3.84	c Constraints        : Number
3.78/3.84	c   linear           : 66352 
3.78/3.84	c   indicator        : 66352 
3.78/3.84	c ** Instance transfer method used: 0
4.18/4.26	c ** ParaScipInstance copy increased the number of variables. **
4.58/4.69	c LC is working with racing ramp-up and with rebuilding tree after racing.
4.58/4.69	c                                Nodes    Active                                            
4.58/4.69	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
341.34/342.75	c *     343              0           1         1      128333.0000                -          -
341.34/342.75	c       343              0           1         1      128333.0000                -          -
831.98/834.95	c *     835              0           1         1       20953.0000                -          -
831.98/834.95	c       835              0           1         1       20953.0000                -          -
2137.71/2145.65	c *    2146              0           1         1          42.0000                -          -
2137.71/2145.65	c      2146              0           1         1          42.0000                -          -
3030.80/3041.59	c      3042              2           0         1          42.0000           3.0000          -

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (48288 MiB free)
  memory of node 1: 64510 MiB (45412 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4456277-1721718971/watcher-4456277-1721718971 -o /tmp/evaluation-result-4456277-1721718971/solver-4456277-1721718971 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC022-1721718341-88012 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4456277-1721718971.wbo -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=88824, runsolver pid=88821
Current StackSize limit: 8192 KiB


[startup+0.100092 s]*
/proc/loadavg: 4.38 3.90 2.93 5/263 88825
/proc/meminfo: memFree=95887256/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=85156 memory=72448 CPUtime=0.1 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 16086 0 0 0 8 2 0 0 20 0 1 0 8420030 87199744 18112 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 21289 18112 2318 3032 0 17689 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 85156 KiB
Current children cumulated memory: 72448 KiB

[startup+0.205707 s]*
/proc/loadavg: 4.38 3.90 2.93 5/263 88825
/proc/meminfo: memFree=95840020/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=131468 memory=119768 CPUtime=0.2 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 27912 0 0 0 16 4 0 0 20 0 1 0 8420030 134623232 29942 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 32867 29942 2318 3032 0 29267 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 131468 KiB
Current children cumulated memory: 119768 KiB

[startup+0.305591 s]*
/proc/loadavg: 4.38 3.90 2.93 6/263 88825
/proc/meminfo: memFree=95780296/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=196132 memory=184060 CPUtime=0.3 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 44675 0 0 0 23 7 0 0 20 0 1 0 8420030 200839168 46015 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 49033 46015 2558 3032 0 45433 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 196132 KiB
Current children cumulated memory: 184060 KiB

[startup+0.700232 s]
/proc/loadavg: 4.38 3.90 2.93 5/263 88825
/proc/meminfo: memFree=95660596/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=394672 memory=378964 CPUtime=0.69 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 93367 0 0 0 55 14 0 0 20 0 1 0 8420030 404144128 94741 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 98668 94741 2590 3032 0 95068 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 394672 KiB
Current children cumulated memory: 378964 KiB

[startup+1.50024 s]
/proc/loadavg: 4.38 3.90 2.93 5/263 88825
/proc/meminfo: memFree=95434468/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=590788 memory=573264 CPUtime=1.48 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 141965 0 0 0 127 21 0 0 20 0 1 0 8420030 604966912 143316 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 147697 143316 2622 3032 0 144097 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 590788 KiB
Current children cumulated memory: 573264 KiB

[startup+3.10566 s]
/proc/loadavg: 4.35 3.90 2.94 5/263 88827
/proc/meminfo: memFree=95374200/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=599584 memory=582680 CPUtime=3.09 cores=4,6
/proc/88824/stat : 88824 (fscip) R 88821 88824 88001 0 -1 4194304 144406 0 0 0 287 22 0 0 20 0 1 0 8420030 613974016 145670 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 149896 145670 2622 3032 0 146296 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 599584 KiB
Current children cumulated memory: 582680 KiB

[startup+6.3004 s]
/proc/loadavg: 4.35 3.90 2.94 5/265 88829
/proc/meminfo: memFree=94338860/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=1761856 memory=1613460 CPUtime=6.26 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 407400 0 0 0 566 60 0 0 20 0 3 0 8420030 1804140544 403365 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 440464 403365 2702 3032 0 429093 0
[pid=88824/tid=88828] ppid=88821 vsize=1761856 memory=7373346224753568623 CPUtime=2.01 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 172836 0 0 0 180 21 0 0 20 0 3 0 8420415 1804140544 403365 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=1761856 memory=-5155634604390246021 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 2 0 0 0 0 0 0 0 20 0 3 0 8420501 1804140544 403365 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 1761856 KiB
Current children cumulated memory: 1613460 KiB

[startup+12.7004 s]
/proc/loadavg: 4.30 3.90 2.95 5/265 88830
/proc/meminfo: memFree=94077168/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1874632 CPUtime=12.6 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 463535 0 0 0 1193 67 0 0 20 0 3 0 8420030 2072576000 468658 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 468658 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=-5155634604390246021 CPUtime=8.34 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 228967 0 0 0 807 27 0 0 20 0 3 0 8420415 2072576000 468658 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=1874632 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 6 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 468658 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 12.6 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1874632 KiB

[startup+25.5003 s]
/proc/loadavg: 4.25 3.91 2.96 5/265 88833
/proc/meminfo: memFree=94066748/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1874656 CPUtime=25.33 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 524393 0 0 0 2462 71 0 0 20 0 3 0 8420030 2072576000 468664 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 468664 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=1874656 CPUtime=21.07 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 289818 0 0 0 2076 31 0 0 20 0 3 0 8420415 2072576000 468664 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=1874656 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 13 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 468664 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 25.33 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1874656 KiB

[startup+51.1059 s]
/proc/loadavg: 4.24 3.93 3.00 5/263 88928
/proc/meminfo: memFree=94163252/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1876228 CPUtime=50.85 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 564900 0 0 0 5011 74 0 0 20 0 3 0 8420030 2072576000 469057 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 469057 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=1875664 CPUtime=46.6 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 330309 0 0 0 4626 34 0 0 20 0 3 0 8420415 2072576000 469057 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=12136 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 29 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 469057 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 50.85 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1876228 KiB

[startup+102.3 s]
/proc/loadavg: 4.16 3.96 3.06 5/263 88986
/proc/meminfo: memFree=93299296/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1876548 CPUtime=101.87 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 637875 0 0 0 10107 80 0 0 20 0 3 0 8420030 2072576000 469137 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 469137 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=33852 CPUtime=97.61 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 403268 0 0 0 9721 40 0 0 20 0 3 0 8420415 2072576000 469137 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=1876548 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 45 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 469137 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 101.87 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1876548 KiB

[startup+162.3 s]
/proc/loadavg: 4.17 4.00 3.13 5/266 89001
/proc/meminfo: memFree=93277376/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1876656 CPUtime=161.65 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 698729 0 0 0 16079 86 0 0 20 0 3 0 8420030 2072576000 469164 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 469164 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=1876632 CPUtime=157.41 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 464112 0 0 0 15694 47 0 0 20 0 3 0 8420415 2072576000 469164 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=12136 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 55 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 469164 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 161.65 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1876656 KiB

[startup+222.3 s]
/proc/loadavg: 4.33 4.06 3.21 5/268 89014
/proc/meminfo: memFree=91713324/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1876672 CPUtime=221.44 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 735133 0 0 0 22053 91 0 0 20 0 3 0 8420030 2072576000 469168 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 469168 2734 3032 0 496224 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=33852 CPUtime=217.18 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 500503 0 0 0 21667 51 0 0 20 0 3 0 8420415 2072576000 469168 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=1876672 CPUtime=0 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 68 0 0 0 0 0 0 0 20 0 3 0 8420501 2072576000 469168 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 221.44 s
Current children cumulated vsize: 2024000 KiB
Current children cumulated memory: 1876672 KiB

[startup+282.3 s]
/proc/loadavg: 4.62 4.22 3.33 5/267 89026
/proc/meminfo: memFree=91217544/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=2024000 memory=1890364 CPUtime=281.2 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 774492 0 0 0 28023 97 0 0 20 0 3 0 8420030 2072576000 472591 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 506000 472591 2734 3032 0 499668 0
[pid=88824/tid=88828] ppid=88821 vsize=2024000 memory=1884260 CPUtime=276.94 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 539855 0 0 0 27637 57 0 0 20 0 3 0 8420415 2072576000 472591 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=2024000 memory=1885296 CPUtime=0 cores=4,6

################
# More data... #
################

Current children cumulated memory: 3315024 KiB

[startup+3102.3 s]
/proc/loadavg: 4.15 4.12 4.09 5/262 90840
/proc/meminfo: memFree=87632128/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3091.45 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3558315 0 0 0 308726 419 0 0 20 0 3 0 8420030 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828777 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3087.06 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3263581 0 0 0 308333 373 0 0 20 0 3 0 8420415 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=12136 CPUtime=0.03 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 453 0 0 0 1 2 0 0 20 0 3 0 8420501 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3091.45 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315108 KiB

[startup+3162.3 s]
/proc/loadavg: 4.12 4.12 4.09 5/266 90856
/proc/meminfo: memFree=87484452/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3151.32 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3572891 0 0 0 314712 420 0 0 20 0 3 0 8420030 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828777 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3146.92 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3278150 0 0 0 314318 374 0 0 20 0 3 0 8420415 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=3315108 CPUtime=0.03 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 460 0 0 0 1 2 0 0 20 0 3 0 8420501 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3151.32 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315108 KiB

[startup+3222.3 s]
/proc/loadavg: 4.12 4.12 4.09 5/266 90867
/proc/meminfo: memFree=87379144/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3211.15 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3588912 0 0 0 320694 421 0 0 20 0 3 0 8420030 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828777 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315108 CPUtime=3206.76 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3294164 0 0 0 320301 375 0 0 20 0 3 0 8420415 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=3315108 CPUtime=0.03 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 467 0 0 0 1 2 0 0 20 0 3 0 8420501 3562287104 828777 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3211.15 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315108 KiB

[startup+3282.3 s]
/proc/loadavg: 4.15 4.13 4.09 5/266 90879
/proc/meminfo: memFree=87313232/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3270.97 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3604294 0 0 0 326675 422 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3266.57 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3309542 0 0 0 326281 376 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=32096 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 471 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3270.97 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

[startup+3342.3 s]
/proc/loadavg: 4.11 4.12 4.09 5/265 90892
/proc/meminfo: memFree=87270016/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3330.8 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3619745 0 0 0 332656 424 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3326.4 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3324986 0 0 0 332262 378 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=3315112 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3330.8 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

[startup+3402.3 s]
/proc/loadavg: 4.08 4.11 4.09 5/265 90904
/proc/meminfo: memFree=86805436/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3390.61 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3634864 0 0 0 338636 425 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3386.22 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3340098 0 0 0 338243 379 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=33852 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 485 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3390.61 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

[startup+3462.3 s]
/proc/loadavg: 4.13 4.12 4.09 5/263 90914
/proc/meminfo: memFree=86660600/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3450.43 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3651341 0 0 0 344617 426 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=-7089904432415073662 CPUtime=3446.04 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3356576 0 0 0 344224 380 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=3315112 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 493 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3450.43 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

[startup+3522.3 s]
/proc/loadavg: 4.09 4.11 4.09 5/263 90926
/proc/meminfo: memFree=86632816/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3510.25 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3668393 0 0 0 350598 427 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=12136 CPUtime=3505.85 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3373615 0 0 0 350204 381 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=3315112 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 497 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3510.25 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

[startup+3582.3 s]
/proc/loadavg: 4.14 4.12 4.09 5/263 90936
/proc/meminfo: memFree=86594040/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3570.05 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3684607 0 0 0 356577 428 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=-7089904432415073662 CPUtime=3565.66 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3389821 0 0 0 356184 382 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=12136 CPUtime=0.04 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 505 0 0 0 1 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3570.05 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3612.4 s]
/proc/loadavg: 4.08 4.11 4.09 5/263 90942
/proc/meminfo: memFree=86591020/131524600 swapFree=131071996/131071996
[pid=88824] ppid=88821 vsize=3478796 memory=3315112 CPUtime=3600.06 cores=4,6
/proc/88824/stat : 88824 (fscip) S 88821 88824 88001 0 -1 1077936128 3693273 0 0 0 359577 429 0 0 20 0 3 0 8420030 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
/proc/88824/statm: 869699 828778 2974 3032 0 861533 0
[pid=88824/tid=88828] ppid=88821 vsize=3478796 memory=104 CPUtime=3595.67 cores=4,6
/proc/88824/task/88828/stat : 88828 (fscip) R 88821 88824 88001 0 -1 4194368 3398479 0 0 0 359184 383 0 0 20 0 3 0 8420415 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
[pid=88824/tid=88829] ppid=88821 vsize=3478796 memory=5480 CPUtime=0.05 cores=4,6
/proc/88824/task/88829/stat : 88829 (fscip) S 88821 88824 88001 0 -1 1077936192 513 0 0 0 2 3 0 0 20 0 3 0 8420501 3562287104 828778 134679101440 4194304 16613245 140725615175280 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 44187648 140725615178772 140725615178888 140725615178888 140725615185904 0
Current children cumulated CPU time: 3600.06 s
Current children cumulated vsize: 3478796 KiB
Current children cumulated memory: 3315112 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+3612.46 s]
# the end of solver process 88824 was just reported to runsolver
# Child ended because it received signal 15 (SIGTERM)

# cumulated CPU time of all completed processes:  user=3595.78 s, system=4.34947 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

Real time (s): 3612.46
CPU time (s): 3600.13
CPU user time (s): 3595.78
CPU system time (s): 4.34947
CPU usage (%): 99.6589
Max. virtual memory (cumulated for all children) (KiB): 3609868
Max. memory (cumulated for all children) (KiB): 3371348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3595.78
system time used= 4.34947
maximum resident set size= 3371348
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3693275
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3768
involuntary context switches= 1819


# summary of solver processes directly reported to runsolver:
#   pid: 88824
#   total CPU time (s): 3600.13
#   total CPU user time (s): 3595.78
#   total CPU system time (s): 4.34947

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.63421 second user time and 17.0225 second system time

The end

Launcher Data 

Begin job on nodeC022 at 2024-07-23 09:16:11
IDJOB=4456277
IDBENCH=143327
IDSOLVER=3044
FILE ID=nodeC022/4456277-1721718971
RUNJOBID= nodeC022-1721718341-88012
SLURM_JOB_ID= 7770394
Free space on /tmp= 889996 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/WBO/SOFT-LIN/PB10/oliveras/j120/normalized-j12015_3-unsat--soft-0-100-0.wbo
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4456277-1721718971/watcher-4456277-1721718971 -o /tmp/evaluation-result-4456277-1721718971/solver-4456277-1721718971 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC022-1721718341-88012 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4456277-1721718971.wbo -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 18c39288ed23615941737d5b505374c3
RANDOM SEED=651153186

nodeC022.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3656.868
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.285
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.251
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.637
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3640.058
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.654
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3661.511
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.232
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        95949364 kB
MemAvailable:   125588168 kB
Buffers:          143748 kB
Cached:         30218668 kB
SwapCached:            0 kB
Active:           967988 kB
Inactive:       33830964 kB
Active(anon):       1548 kB
Inactive(anon):  4472708 kB
Active(file):     966440 kB
Inactive(file): 29358256 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             30204 kB
Writeback:            28 kB
AnonPages:       4433900 kB
Mapped:           135760 kB
Shmem:             37720 kB
KReclaimable:     307512 kB
Slab:             415408 kB
SReclaimable:     307512 kB
SUnreclaim:       107896 kB
KernelStack:        4236 kB
PageTables:        18344 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    2504068 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            19680 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1361920 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      285396 kB
DirectMap2M:    28848128 kB
DirectMap1G:    106954752 kB

Free space on /tmp at the end= 889960 MiB
End job on nodeC022 at 2024-07-23 10:16:24