Trace number 4426799

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? (TO) 3600.11 3614.03

General information on the benchmark

NamePB24/WBO/PARTIAL-LIN/PB06/web/uclid_pb_benchmarks/
normalized-cache-ibm-q-unbounded.Icl2arity.ucl--soft-66-100-0.wbo
MD5SUMad91ea88b68d6dd6ada6c10490616c15
Bench CategoryPARTIAL-LIN (WBO, both soft and hard constraints, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark6.01252
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables23837
Total number of constraints67568
Number of soft constraints22831
Number of constraints which are clauses64398
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints3170
Minimum length of a constraint1
Maximum length of a constraint13
Top cost 1153610
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 1153609
Biggest number in a constraint 66
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 256
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.30/0.38	c Default LC presolving (default).
0.30/0.38	c ** Before presolving: virtualMemUsedAtLc = 337243380, getVmSize() = 238915584, SCIPgetMemUsed() = 200174007, SCIPgetMemTotal() = 209393791, SCIPgetMemExternEstim() = 127849589
0.30/0.38	c ** set memory limit for presolving in LC to 8.79599e+12 for SCIP **
2.48/2.55	c ** Estimated virtualMemUsedAtSolver = 410610164, getVmSize() = 530489344, SCIPgetMemUsed() = 285606377, SCIPgetMemTotal() = 488065657, SCIPgetMemExternEstim() = 127849589
2.48/2.55	c ** set memory limit for solvers to 4.39803e+12 for each SCIP **
2.48/2.55	c Original Problem   :
2.48/2.55	c   Problem name     : instance-4426799-1720905530
2.48/2.55	c   Variables        : 46668 (46668 binary, 0 integer, 0 implicit integer, 0 continuous)
2.48/2.55	c   Constraints      : 90400
2.48/2.55	c   Objective sense  : minimize
2.48/2.55	c Presolved Problem  :
2.48/2.55	c   Variables        : 69105 (46285 binary, 0 integer, 22820 implicit integer, 0 continuous)
2.48/2.55	c   Constraints      : 77538
2.48/2.55	c Constraints        : Number
2.48/2.55	c   knapsack         : 2151 
2.48/2.55	c   setppc           : 15833 
2.48/2.55	c   and              : 6066 
2.48/2.55	c   linear           : 22820 
2.48/2.55	c   logicor          : 7842 
2.48/2.55	c   indicator        : 22826 
2.48/2.55	c ** Instance transfer method used: 0
2.68/2.79	c ** ParaScipInstance copy increased the number of variables. **
2.98/3.05	c LC is working with racing ramp-up and with rebuilding tree after racing.
2.98/3.05	c                                Nodes    Active                                            
2.98/3.05	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
13.43/13.53	c *      14              0           1         1     1150973.0000                -          -
13.43/13.53	c        14              0           1         1     1150973.0000                -          -
107.26/107.70	c *     108              0           1         1      119001.0000                -          -
107.26/107.70	c       108              0           1         1      119001.0000                -          -
1233.84/1238.78	c *    1239              0           1         1      113083.0000                -          -
1233.84/1238.78	c      1239              0           1         1      113083.0000                -          -
1238.24/1243.17	c *    1243              0           1         1      113010.0000                -          -
1428.80/1434.47	c      1434              2           1         1      113010.0000           0.0000          -
1549.53/1555.67	c      1556              3           2         1      113010.0000           0.0000          -
1694.94/1701.68	c      1702              4           3         1      113010.0000           0.0000          -
1813.82/1820.99	c      1821              5           4         1      113010.0000           0.0000          -
1937.46/1945.00	c      1945              5           6         1      113010.0000           0.0000          -
2166.06/2174.48	c      2174              6           5         1      113010.0000           0.0000          -
2250.45/2259.15	c      2259              7           6         1      113010.0000           0.0000          -
2349.19/2358.26	c      2358              8           7         1      113010.0000           0.0000          -
2423.91/2433.26	c      2433              9           8         1      113010.0000           0.0000          -
2522.94/2532.64	c      2533             10           9         1      113010.0000           0.0000          -
2601.15/2611.13	c      2611             11          10         1      113010.0000           0.0000          -
2674.46/2684.73	c      2685             12          11         1      113010.0000           0.0000          -
2763.31/2773.98	c      2774             13          12         1      113010.0000           0.0000          -
2866.39/2877.42	c      2877             14          13         1      113010.0000           0.0000          -
2935.61/2946.90	c      2947             15          14         1      113010.0000           0.0000          -
2959.91/2971.30	c      2971             16          15         1      113010.0000           0.0000          -
2979.34/2990.82	c      2991             17          16         1      113010.0000           0.0000          -
3069.75/3081.67	c      3082             18          17         1      113010.0000           0.0000          -
3093.86/3105.80	c      3106             19          18         1      113010.0000           0.0000          -
3105.70/3117.70	c      3118             21          20         1      113010.0000           0.0000          -
3113.27/3125.34	c      3125             22          21         1      113010.0000           0.0000          -
3120.34/3132.42	c      3132             23          22         1      113010.0000           0.0000          -
3131.39/3143.54	c      3144             24          23         1      113010.0000           0.0000          -
3218.50/3231.08	c      3231             25          24         1      113010.0000           0.0000          -
3225.66/3238.21	c      3238             26          25         1      113010.0000           0.0000          -
3233.53/3246.12	c      3246             28          27         1      113010.0000           0.0000          -
3238.90/3251.52	c      3252             29          28         1      113010.0000           0.0000          -
3247.56/3260.21	c      3260             31          30         1      113010.0000           0.0000          -
3259.31/3272.03	c      3272             34          33         1      113010.0000           0.0000          -
3265.49/3278.21	c      3278             36          35         1      113010.0000           0.0000          -
3271.08/3283.89	c      3284             37          36         1      113010.0000           0.0000          -
3369.31/3382.47	c      3382             38          37         1      113010.0000           0.0000          -
3384.35/3397.59	c      3398             39          38         1      113010.0000           0.0000          -
3391.62/3404.88	c      3405             40          39         1      113010.0000           0.0000          -
3403.18/3416.48	c      3416             41          40         1      113010.0000           0.0000          -
3494.04/3507.62	c      3508             42          41         1      113010.0000           0.0000          -
3516.66/3530.30	c      3530             43          42         1      113010.0000           0.0000          -
3599.86/3613.81	c      3614             43          42         0      113010.0000           0.0000          -

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (60814 MiB free)
  memory of node 1: 64510 MiB (63688 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4426799-1720905530/watcher-4426799-1720905530 -o /tmp/evaluation-result-4426799-1720905530/solver-4426799-1720905530 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1720905543-724802 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4426799-1720905530.wbo -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=724862, runsolver pid=724848
Current StackSize limit: 8192 KiB


[startup+0.1001 s]*
/proc/loadavg: 1.26 1.78 1.95 8/256 724864
/proc/meminfo: memFree=127257776/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=78344 memory=66784 CPUtime=0.09 cores=5,7
/proc/724862/stat : 724862 (fscip) R 724848 724862 722468 0 -1 4194304 14608 0 0 0 8 1 0 0 20 0 1 0 142720453 80224256 16696 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 19586 16696 2318 3032 0 15986 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 78344 KiB
Current children cumulated memory: 66784 KiB

[startup+0.20668 s]*
/proc/loadavg: 1.26 1.78 1.95 10/256 724864
/proc/meminfo: memFree=127115128/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=137828 memory=126144 CPUtime=0.21 cores=5,7
/proc/724862/stat : 724862 (fscip) R 724848 724862 722468 0 -1 4194304 29708 0 0 0 17 4 0 0 20 0 1 0 142720453 141135872 31536 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 34457 31536 2558 3032 0 30857 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 137828 KiB
Current children cumulated memory: 126144 KiB

[startup+0.306403 s]*
/proc/loadavg: 1.26 1.78 1.95 8/256 724864
/proc/meminfo: memFree=126953816/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=203596 memory=191880 CPUtime=0.3 cores=5,7
/proc/724862/stat : 724862 (fscip) R 724848 724862 722468 0 -1 4194304 46175 0 0 0 24 6 0 0 20 0 1 0 142720453 208482304 47970 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 50899 47970 2558 3032 0 47299 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 203596 KiB
Current children cumulated memory: 191880 KiB

[startup+0.700238 s]
/proc/loadavg: 1.26 1.78 1.95 8/256 724866
/proc/meminfo: memFree=126569788/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=337600 memory=318288 CPUtime=0.69 cores=5,7
/proc/724862/stat : 724862 (fscip) R 724848 724862 722468 0 -1 4194304 77704 0 0 0 58 11 0 0 20 0 1 0 142720453 345702400 79572 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 84400 79572 2622 3032 0 80800 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 337600 KiB
Current children cumulated memory: 318288 KiB

[startup+1.50024 s]
/proc/loadavg: 1.48 1.82 1.96 8/256 724866
/proc/meminfo: memFree=126072524/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=376132 memory=352104 CPUtime=1.48 cores=5,7
/proc/724862/stat : 724862 (fscip) R 724848 724862 722468 0 -1 4194304 87362 0 0 0 136 12 0 0 20 0 1 0 142720453 385159168 88026 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 94033 88026 2670 3032 0 90433 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 376132 KiB
Current children cumulated memory: 352104 KiB

[startup+3.10601 s]
/proc/loadavg: 1.48 1.82 1.96 9/257 724867
/proc/meminfo: memFree=125298448/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=862628 memory=716244 CPUtime=3.08 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 189914 0 0 0 279 29 0 0 20 0 3 0 142720453 883331072 179061 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 215657 179061 2718 3032 0 209846 0
[pid=724862/tid=724867] ppid=724848 vsize=862628 memory=446448 CPUtime=0.29 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 46683 0 0 0 23 6 0 0 20 0 3 0 142720708 883331072 179061 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 862628 KiB
Current children cumulated memory: 716244 KiB

[startup+6.30026 s]
/proc/loadavg: 1.68 1.85 1.97 8/261 724871
/proc/meminfo: memFree=123457892/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1191368 memory=1025896 CPUtime=6.26 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 305061 0 0 0 584 42 0 0 20 0 3 0 142720453 1219960832 256474 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 297842 256474 2750 3032 0 291829 0
[pid=724862/tid=724867] ppid=724848 vsize=1191368 memory=-6440825231612492644 CPUtime=3.47 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 161823 0 0 0 328 19 0 0 20 0 3 0 142720708 1219960832 256474 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1191368 memory=997180 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 7 0 0 0 0 0 0 0 20 0 3 0 142720759 1219960832 256474 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 1191368 KiB
Current children cumulated memory: 1025896 KiB

[startup+12.7003 s]
/proc/loadavg: 1.87 1.89 1.98 8/264 724875
/proc/meminfo: memFree=121438672/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1258472 memory=1063308 CPUtime=12.63 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 390719 0 0 0 1213 50 0 0 20 0 3 0 142720453 1288675328 265827 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 314618 265827 2814 3032 0 302140 0
[pid=724862/tid=724867] ppid=724848 vsize=1258472 memory=1025932 CPUtime=9.84 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 247477 0 0 0 957 27 0 0 20 0 3 0 142720708 1288675328 265827 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1258472 memory=1026724 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 11 0 0 0 0 0 0 0 20 0 3 0 142720759 1288675328 265827 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 1258472 KiB
Current children cumulated memory: 1063308 KiB

[startup+25.5003 s]
/proc/loadavg: 2.19 1.96 2.00 8/264 724877
/proc/meminfo: memFree=121297964/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1260092 memory=1070172 CPUtime=25.4 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 443395 0 0 0 2486 54 0 0 20 0 3 0 142720453 1290334208 267543 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 315023 267543 2862 3032 0 303786 0
[pid=724862/tid=724867] ppid=724848 vsize=1260092 memory=1070172 CPUtime=22.59 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 287174 0 0 0 2229 30 0 0 20 0 3 0 142720708 1290334208 267543 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1260092 memory=1070172 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 21 0 0 0 0 0 0 0 20 0 3 0 142720759 1290334208 267543 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 1260092 KiB
Current children cumulated memory: 1070172 KiB

[startup+51.1069 s]
/proc/loadavg: 3.02 2.18 2.08 8/264 724881
/proc/meminfo: memFree=121285188/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1260092 memory=1079388 CPUtime=50.9 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 492424 0 0 0 5030 60 0 0 20 0 3 0 142720453 1290334208 269847 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 315023 269847 2862 3032 0 306090 0
[pid=724862/tid=724867] ppid=724848 vsize=1260092 memory=-1189914978686163229 CPUtime=48.09 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 336191 0 0 0 4772 37 0 0 20 0 3 0 142720708 1290334208 269847 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1260092 memory=32496 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 33 0 0 0 0 0 0 0 20 0 3 0 142720759 1290334208 269847 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 50.9 s
Current children cumulated vsize: 1260092 KiB
Current children cumulated memory: 1079388 KiB

[startup+102.3 s]
/proc/loadavg: 3.58 2.47 2.18 7/266 724943
/proc/meminfo: memFree=121430984/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1325628 memory=1099488 CPUtime=101.87 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 630550 0 0 0 10110 77 0 0 20 0 3 0 142720453 1357443072 274872 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 331407 274872 2878 3032 0 311465 0
[pid=724862/tid=724867] ppid=724848 vsize=1325628 memory=1097888 CPUtime=99.05 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 474301 0 0 0 9852 53 0 0 20 0 3 0 142720708 1357443072 274872 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1325628 memory=1097888 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 49 0 0 0 0 0 0 0 20 0 3 0 142720759 1357443072 274872 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 101.87 s
Current children cumulated vsize: 1325628 KiB
Current children cumulated memory: 1099488 KiB

[startup+162.3 s]
/proc/loadavg: 3.95 2.78 2.31 7/266 724953
/proc/meminfo: memFree=121315148/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1326436 memory=1148424 CPUtime=161.64 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 836411 0 0 0 16072 92 0 0 20 0 3 0 142720453 1358270464 287106 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 331609 287106 2894 3032 0 326565 0
[pid=724862/tid=724867] ppid=724848 vsize=1326436 memory=32496 CPUtime=158.8 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 667176 0 0 0 15813 67 0 0 20 0 3 0 142720708 1358270464 287106 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1326436 memory=1148408 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 62 0 0 0 0 0 0 0 20 0 3 0 142720759 1358270464 287106 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 161.64 s
Current children cumulated vsize: 1326436 KiB
Current children cumulated memory: 1148424 KiB

[startup+222.3 s]
/proc/loadavg: 4.03 3.02 2.42 7/266 724963
/proc/meminfo: memFree=121230948/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1396288 memory=1201672 CPUtime=221.4 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 943131 0 0 0 22040 100 0 0 20 0 3 0 142720453 1429798912 300418 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 349072 300418 2894 3032 0 344077 0
[pid=724862/tid=724867] ppid=724848 vsize=1396288 memory=1171712 CPUtime=218.56 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 773889 0 0 0 21781 75 0 0 20 0 3 0 142720708 1429798912 300418 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=1396288 memory=1171712 CPUtime=0 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 69 0 0 0 0 0 0 0 20 0 3 0 142720759 1429798912 300418 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 221.4 s
Current children cumulated vsize: 1396288 KiB
Current children cumulated memory: 1201672 KiB

[startup+282.3 s]
/proc/loadavg: 4.05 3.21 2.53 7/266 724974
/proc/meminfo: memFree=121157500/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=1450052 memory=1247124 CPUtime=281.16 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 1039691 0 0 0 28003 113 0 0 20 0 3 0 142720453 1484853248 311781 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 362513 311781 2894 3032 0 357615 0
[pid=724862/tid=724867] ppid=724848 vsize=1450052 memory=1228096 CPUtime=278.32 cores=5,7

################
# More data... #
################

Current children cumulated memory: 1915828 KiB

[startup+3102.3 s]
/proc/loadavg: 4.21 4.15 4.08 7/268 727554
/proc/meminfo: memFree=116877968/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3090.36 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2033901 0 0 0 308676 360 0 0 20 0 3 0 142720453 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478957 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3087.45 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1863789 0 0 0 308414 331 0 0 20 0 3 0 142720708 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=1915828 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 325 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3090.36 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915828 KiB

[startup+3162.3 s]
/proc/loadavg: 4.19 4.15 4.09 7/269 727565
/proc/meminfo: memFree=116860852/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3150.1 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2039353 0 0 0 314649 361 0 0 20 0 3 0 142720453 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478957 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3147.19 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1869221 0 0 0 314387 332 0 0 20 0 3 0 142720708 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=1915828 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 330 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3150.1 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915828 KiB

[startup+3222.3 s]
/proc/loadavg: 4.13 4.14 4.09 7/269 727575
/proc/meminfo: memFree=116839752/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3209.84 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2042076 0 0 0 320622 362 0 0 20 0 3 0 142720453 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478957 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3206.92 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1871939 0 0 0 320360 332 0 0 20 0 3 0 142720708 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=5536 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 335 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3209.84 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915828 KiB

[startup+3282.3 s]
/proc/loadavg: 4.10 4.13 4.09 7/266 727586
/proc/meminfo: memFree=116777148/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3269.58 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2049726 0 0 0 326595 363 0 0 20 0 3 0 142720453 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478957 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=11588 CPUtime=3266.67 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1879553 0 0 0 326333 334 0 0 20 0 3 0 142720708 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=1915828 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 340 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3269.58 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915828 KiB

[startup+3342.3 s]
/proc/loadavg: 4.07 4.12 4.09 7/266 727597
/proc/meminfo: memFree=116766004/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915828 CPUtime=3329.35 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2053707 0 0 0 332572 363 0 0 20 0 3 0 142720453 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478957 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=11588 CPUtime=3326.44 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1883531 0 0 0 332310 334 0 0 20 0 3 0 142720708 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=1915828 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 343 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478957 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3329.35 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915828 KiB

[startup+3402.3 s]
/proc/loadavg: 4.08 4.11 4.09 7/263 727607
/proc/meminfo: memFree=116746684/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2177964 memory=1915832 CPUtime=3389.13 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2057730 0 0 0 338550 363 0 0 20 0 3 0 142720453 2230235136 478958 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 544491 478958 2990 3032 0 537643 0
[pid=724862/tid=724867] ppid=724848 vsize=2177964 memory=11588 CPUtime=3386.22 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1887529 0 0 0 338288 334 0 0 20 0 3 0 142720708 2230235136 478958 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2177964 memory=11588 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 349 0 0 0 1 4 0 0 20 0 3 0 142720759 2230235136 478958 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3389.13 s
Current children cumulated vsize: 2177964 KiB
Current children cumulated memory: 1915832 KiB

[startup+3462.3 s]
/proc/loadavg: 4.07 4.10 4.09 7/262 727617
/proc/meminfo: memFree=116727236/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2112428 memory=1910708 CPUtime=3448.91 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2063933 0 0 0 344527 364 0 0 20 0 3 0 142720453 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 528107 477677 2990 3032 0 522074 0
[pid=724862/tid=724867] ppid=724848 vsize=2112428 memory=1915828 CPUtime=3446 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1893710 0 0 0 344265 335 0 0 20 0 3 0 142720708 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2112428 memory=1910708 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 354 0 0 0 1 4 0 0 20 0 3 0 142720759 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3448.91 s
Current children cumulated vsize: 2112428 KiB
Current children cumulated memory: 1910708 KiB

[startup+3522.3 s]
/proc/loadavg: 4.12 4.11 4.09 7/262 727628
/proc/meminfo: memFree=116705960/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2112428 memory=1910708 CPUtime=3508.68 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2067333 0 0 0 350504 364 0 0 20 0 3 0 142720453 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 528107 477677 2990 3032 0 522074 0
[pid=724862/tid=724867] ppid=724848 vsize=2112428 memory=1910708 CPUtime=3505.77 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1897089 0 0 0 350242 335 0 0 20 0 3 0 142720708 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2112428 memory=1910708 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 359 0 0 0 1 4 0 0 20 0 3 0 142720759 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3508.68 s
Current children cumulated vsize: 2112428 KiB
Current children cumulated memory: 1910708 KiB

[startup+3582.3 s]
/proc/loadavg: 4.20 4.15 4.10 7/263 727639
/proc/meminfo: memFree=116613112/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2112428 memory=1910708 CPUtime=3568.46 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2071606 0 0 0 356481 365 0 0 20 0 3 0 142720453 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 528107 477677 2990 3032 0 522074 0
[pid=724862/tid=724867] ppid=724848 vsize=2112428 memory=36636 CPUtime=3565.55 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1901348 0 0 0 356219 336 0 0 20 0 3 0 142720708 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2112428 memory=12508 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 361 0 0 0 1 4 0 0 20 0 3 0 142720759 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3568.46 s
Current children cumulated vsize: 2112428 KiB
Current children cumulated memory: 1910708 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3614 s]*
/proc/loadavg: 4.64 4.26 4.14 6/256 727717
/proc/meminfo: memFree=122048080/131524600 swapFree=131071996/131071996
[pid=724862] ppid=724848 vsize=2112428 memory=1910708 CPUtime=3600.07 cores=5,7
/proc/724862/stat : 724862 (fscip) S 724848 724862 722468 0 -1 1077936128 2076975 0 0 0 359641 366 0 0 20 0 3 0 142720453 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
/proc/724862/statm: 528107 477677 2990 3032 0 522074 0
[pid=724862/tid=724867] ppid=724848 vsize=2112428 memory=-8670947044343849660 CPUtime=3597.15 cores=5,7
/proc/724862/task/724867/stat : 724867 (fscip) R 724848 724862 722468 0 -1 4194368 1906702 0 0 0 359379 336 0 0 20 0 3 0 142720708 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
[pid=724862/tid=724868] ppid=724848 vsize=2112428 memory=11260 CPUtime=0.05 cores=5,7
/proc/724862/task/724868/stat : 724868 (fscip) S 724848 724862 722468 0 -1 1077936192 362 0 0 0 1 4 0 0 20 0 3 0 142720759 2163126272 477677 134679101440 4194304 16613245 140732644495440 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 33419264 140732644504545 140732644504661 140732644504661 140732644511728 0
Current children cumulated CPU time: 3600.07 s
Current children cumulated vsize: 2112428 KiB
Current children cumulated memory: 1910708 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+3614.03 s]
# the end of solver process 724862 was just reported to runsolver
# Child ended because it received signal 15 (SIGTERM)

# cumulated CPU time of all completed processes:  user=3596.42 s, system=3.68675 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

Real time (s): 3614.03
CPU time (s): 3600.11
CPU user time (s): 3596.42
CPU system time (s): 3.68675
CPU usage (%): 99.6146
Max. virtual memory (cumulated for all children) (KiB): 2177964
Max. memory (cumulated for all children) (KiB): 1964696

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3596.42
system time used= 3.68675
maximum resident set size= 1964696
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2076975
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3739
involuntary context switches= 3386


# summary of solver processes directly reported to runsolver:
#   pid: 724862
#   total CPU time (s): 3600.11
#   total CPU user time (s): 3596.42
#   total CPU system time (s): 3.68675

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.23455 second user time and 20.4816 second system time

The end

Launcher Data 

Begin job on nodeC029 at 2024-07-13 23:19:03
IDJOB=4426799
IDBENCH=143356
IDSOLVER=3044
FILE ID=nodeC029/4426799-1720905530
RUNJOBID= nodeC029-1720905543-724802
SLURM_JOB_ID= 7486088
Free space on /tmp= 890064 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/WBO/PARTIAL-LIN/PB06/web/uclid_pb_benchmarks/normalized-cache-ibm-q-unbounded.Icl2arity.ucl--soft-66-100-0.wbo
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4426799-1720905530/watcher-4426799-1720905530 -o /tmp/evaluation-result-4426799-1720905530/solver-4426799-1720905530 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1720905543-724802 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4426799-1720905530.wbo -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= ad91ea88b68d6dd6ada6c10490616c15
RANDOM SEED=969488785

nodeC029.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3717.245
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3774.919
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3751.380
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3632.565
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3619.051
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3790.959
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3753.401
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3663.039
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        127492384 kB
MemAvailable:   129749372 kB
Buffers:          329248 kB
Cached:          2744400 kB
SwapCached:            0 kB
Active:           528328 kB
Inactive:        2881204 kB
Active(anon):       1360 kB
Inactive(anon):   372272 kB
Active(file):     526968 kB
Inactive(file):  2508932 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            120448 kB
Writeback:             0 kB
AnonPages:        335936 kB
Mapped:           101440 kB
Shmem:             37720 kB
KReclaimable:     121472 kB
Slab:             225652 kB
SReclaimable:     121472 kB
SUnreclaim:       104180 kB
KernelStack:        3828 kB
PageTables:         9364 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     689608 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            54528 kB
HardwareCorrupted:     0 kB
AnonHugePages:    219136 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      213716 kB
DirectMap2M:    21579776 kB
DirectMap1G:    114294784 kB

Free space on /tmp at the end= 889972 MiB
End job on nodeC029 at 2024-07-14 00:19:18