Trace number 4446560

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3591.44 3600.26

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K197.opb
MD5SUMcd0a69270cffb0a3df5915a64d0aa68c
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark34.2303
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables23443
Total number of constraints23839
Number of constraints which are clauses23642
Number of constraints which are cardinality constraints (but not clauses)197
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint197
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 198
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.15	c Default LC presolving (default).
0.09/0.15	c ** Before presolving: virtualMemUsedAtLc = 136246154, getVmSize() = 115105792, SCIPgetMemUsed() = 83365758, SCIPgetMemTotal() = 90685470, SCIPgetMemExternEstim() = 45560684
0.09/0.15	c ** set memory limit for presolving in LC to 8.79605e+12 for SCIP **
45.35/45.52	c ** Estimated virtualMemUsedAtSolver = 284966128, getVmSize() = 416366592, SCIPgetMemUsed() = 289282212, SCIPgetMemTotal() = 381888508, SCIPgetMemExternEstim() = 45560684
45.35/45.52	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
45.35/45.52	c Original Problem   :
45.35/45.52	c   Problem name     : instance-4446560-1721337870
45.35/45.52	c   Variables        : 23443 (23443 binary, 0 integer, 0 implicit integer, 0 continuous)
45.35/45.52	c   Constraints      : 23839
45.35/45.52	c   Objective sense  : minimize
45.35/45.52	c Presolved Problem  :
45.35/45.52	c   Variables        : 21892 (21892 binary, 0 integer, 0 implicit integer, 0 continuous)
45.35/45.52	c   Constraints      : 22203
45.35/45.52	c Constraints        : Number
45.35/45.52	c   setppc           : 2691 
45.35/45.52	c   orbitope         : 1 
45.35/45.52	c   logicor          : 19511 
45.35/45.52	c ** Instance transfer method used: 0
45.35/45.57	c ** ParaScipInstance copy increased the number of variables. **
45.46/45.63	c LC is working with racing ramp-up and with rebuilding tree after racing.
45.46/45.63	c                                Nodes    Active                                            
45.46/45.63	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3591.17/3600.04	c      3600              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3591.27/3600.17	c SCIP Status        : c solving was interrupted [hard time limit reached]
3591.27/3600.17	c Total Time         : 3600.1700
3591.27/3600.17	c   solving          : 3600.1700
3591.27/3600.17	c   presolving       : 45.3690 (included in solving)
3591.27/3600.17	c B&B Tree           :
3591.27/3600.17	c   nodes (total)    : 1
3591.27/3600.17	c Solution           :
3591.27/3600.17	c   Solutions found  : 0
3591.27/3600.17	c   Primal Bound     :          -
3591.27/3600.17	c   Dual Bound       :          -
3591.27/3600.17	c Gap                :          -
3591.37/3600.25	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61271 MiB free)
  memory of node 1: 64510 MiB (62043 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446560-1721337870/watcher-4446560-1721337870 -o /tmp/evaluation-result-4446560-1721337870/solver-4446560-1721337870 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000264 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446560-1721337870.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1004383, runsolver pid=1004380

[startup+0.100461 s]*
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126209296/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=85416 memory=75224 CPUtime=0.09 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 16563 0 0 0 7 2 0 0 20 0 1 0 185948844 87465984 18806 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 21354 18806 2542 3032 0 17754 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 85416 KiB
Current children cumulated memory: 75224 KiB

[startup+0.205754 s]*
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126176360/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=121416 memory=107348 CPUtime=0.19 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 24587 0 0 0 17 2 0 0 20 0 1 0 185948844 124329984 26837 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 30354 26837 2590 3032 0 26754 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 121416 KiB
Current children cumulated memory: 107348 KiB

[startup+0.30578 s]*
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126144428/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=153168 memory=139116 CPUtime=0.3 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 33906 0 0 0 26 4 0 0 20 0 1 0 185948844 156844032 34779 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 38292 34779 2638 3032 0 34692 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 153168 KiB
Current children cumulated memory: 139116 KiB

[startup+0.700236 s]
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126144272/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=158124 memory=144504 CPUtime=0.68 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 37825 0 0 0 64 4 0 0 20 0 1 0 185948844 161918976 36126 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 39531 36126 2686 3032 0 35931 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 158124 KiB
Current children cumulated memory: 144504 KiB

[startup+1.50025 s]
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126129340/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=201824 memory=185236 CPUtime=1.48 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 45745 0 0 0 142 6 0 0 20 0 1 0 185948844 206667776 46309 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 50456 46309 2734 3032 0 46856 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 201824 KiB
Current children cumulated memory: 185236 KiB

[startup+3.10573 s]
/proc/loadavg: 4.16 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126079420/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=215552 memory=198696 CPUtime=3.09 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 49104 0 0 0 302 7 0 0 20 0 1 0 185948844 220725248 49674 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 53888 49674 2734 3032 0 50288 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 215552 KiB
Current children cumulated memory: 198696 KiB

[startup+6.30023 s]
/proc/loadavg: 4.14 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126078876/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=215552 memory=198696 CPUtime=6.27 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 49126 0 0 0 620 7 0 0 20 0 1 0 185948844 220725248 49674 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 53888 49674 2734 3032 0 50288 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 215552 KiB
Current children cumulated memory: 198696 KiB

[startup+12.7002 s]
/proc/loadavg: 4.21 4.12 4.10 5/260 1004385
/proc/meminfo: memFree=126069400/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=224764 memory=207900 CPUtime=12.64 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 51482 0 0 0 1257 7 0 0 20 0 1 0 185948844 230158336 51975 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 56191 51975 2734 3032 0 52591 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 224764 KiB
Current children cumulated memory: 207900 KiB

[startup+25.5003 s]
/proc/loadavg: 4.24 4.13 4.10 5/262 1004771
/proc/meminfo: memFree=126061496/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=226388 memory=209472 CPUtime=25.41 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 51916 0 0 0 2533 8 0 0 20 0 1 0 185948844 231821312 52368 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 56597 52368 2734 3032 0 52997 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 226388 KiB
Current children cumulated memory: 209472 KiB

[startup+51.1058 s]
/proc/loadavg: 4.16 4.12 4.10 5/265 1004782
/proc/meminfo: memFree=125221336/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=655452 memory=506916 CPUtime=50.94 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 143032 0 0 0 5073 21 0 0 20 0 3 0 185948844 671182848 126729 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 163863 126729 2782 3032 0 148958 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=655452 memory=502672 CPUtime=5.5 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 54480 0 0 0 543 7 0 0 20 0 3 0 185953396 671182848 126729 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=655452 memory=2 CPUtime=0 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 11 0 0 0 0 0 0 0 20 0 3 0 185953407 671182848 126729 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 655452 KiB
Current children cumulated memory: 506916 KiB

[startup+102.3 s]
/proc/loadavg: 4.20 4.13 4.10 5/265 1004790
/proc/meminfo: memFree=125047088/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=721744 memory=579660 CPUtime=101.99 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 234888 0 0 0 10171 28 0 0 20 0 3 0 185948844 739065856 144915 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 180436 144915 2926 3032 0 167949 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=721744 memory=0 CPUtime=56.55 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 146294 0 0 0 5641 14 0 0 20 0 3 0 185953396 739065856 144915 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=721744 memory=579660 CPUtime=0 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 53 0 0 0 0 0 0 0 20 0 3 0 185953407 739065856 144915 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 101.99 s
Current children cumulated vsize: 721744 KiB
Current children cumulated memory: 579660 KiB

[startup+162.3 s]
/proc/loadavg: 4.13 4.12 4.09 5/265 1004800
/proc/meminfo: memFree=125030488/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=721744 memory=583844 CPUtime=161.82 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 255885 0 0 0 16153 29 0 0 20 0 3 0 185948844 739065856 145961 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 180436 145961 2926 3032 0 169009 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=721744 memory=45552 CPUtime=116.38 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 167273 0 0 0 11623 15 0 0 20 0 3 0 185953396 739065856 145961 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=721744 memory=583604 CPUtime=0 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 71 0 0 0 0 0 0 0 20 0 3 0 185953407 739065856 145961 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 161.82 s
Current children cumulated vsize: 721744 KiB
Current children cumulated memory: 583844 KiB

[startup+222.3 s]
/proc/loadavg: 4.10 4.11 4.09 5/266 1004981
/proc/meminfo: memFree=124963420/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=721744 memory=583848 CPUtime=221.66 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 263175 0 0 0 22136 30 0 0 20 0 3 0 185948844 739065856 145962 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 180436 145962 2926 3032 0 169009 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=721744 memory=583848 CPUtime=176.21 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 174553 0 0 0 17606 15 0 0 20 0 3 0 185953396 739065856 145962 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=721744 memory=583848 CPUtime=0 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 81 0 0 0 0 0 0 0 20 0 3 0 185953407 739065856 145962 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 221.66 s
Current children cumulated vsize: 721744 KiB
Current children cumulated memory: 583848 KiB

[startup+282.3 s]
/proc/loadavg: 4.07 4.10 4.09 5/267 1004993
/proc/meminfo: memFree=124940616/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=721744 memory=583856 CPUtime=281.48 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 270751 0 0 0 28118 30 0 0 20 0 3 0 185948844 739065856 145964 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 180436 145964 2926 3032 0 169009 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=721744 memory=583856 CPUtime=236.04 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 182122 0 0 0 23588 16 0 0 20 0 3 0 185953396 739065856 145964 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=721744 memory=583856 CPUtime=0 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 88 0 0 0 0 0 0 0 20 0 3 0 185953407 739065856 145964 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 281.48 s
Current children cumulated vsize: 721744 KiB
Current children cumulated memory: 583856 KiB

[startup+342.3 s]
/proc/loadavg: 4.08 4.10 4.09 5/269 1005064
/proc/meminfo: memFree=124743620/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=791984 memory=678176 CPUtime=341.33 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 301631 0 0 0 34099 34 0 0 20 0 3 0 185948844 810991616 169544 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 197996 169544 2942 3032 0 193213 0

################
# More data... #
################

[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3393.92 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 767236 0 0 0 339322 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=13196 CPUtime=3348.45 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 678165 0 0 0 334791 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=903408 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 530 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3393.92 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3462.3 s]
/proc/loadavg: 4.14 4.12 4.10 5/265 1006783
/proc/meminfo: memFree=124117012/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3453.78 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 767585 0 0 0 345308 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=13196 CPUtime=3408.31 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 678504 0 0 0 340777 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=903408 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 540 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3453.78 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3522.3 s]
/proc/loadavg: 4.11 4.12 4.09 5/265 1006794
/proc/meminfo: memFree=124116724/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3513.65 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768251 0 0 0 351295 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=903408 CPUtime=3468.17 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679162 0 0 0 346763 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=903408 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 548 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3513.65 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3582.3 s]
/proc/loadavg: 4.04 4.09 4.09 5/265 1006807
/proc/meminfo: memFree=124116348/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3573.51 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768597 0 0 0 357281 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=45552 CPUtime=3528.03 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679498 0 0 0 352749 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=45552 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 558 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3573.51 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3600.26 s]
# the end of solver process 1004383 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3590.72 s, system=0.715961 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.04 4.09 4.09 5/265 1006807
/proc/meminfo: memFree=124116364/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3575.21 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768597 0 0 0 357451 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=-7312297431587394663 CPUtime=3529.74 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679498 0 0 0 352920 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=1401069873814724666 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 558 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3575.21 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3590.4 s]
/proc/loadavg: 4.11 4.10 4.09 5/265 1006808
/proc/meminfo: memFree=124116304/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3581.59 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768605 0 0 0 358089 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=903408 CPUtime=3536.12 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679503 0 0 0 353558 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=11544 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 561 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3581.59 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3596.8 s]
/proc/loadavg: 3.94 4.07 4.08 3/247 1006870
/proc/meminfo: memFree=125675636/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3587.97 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768606 0 0 0 358727 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=903408 CPUtime=3542.5 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679504 0 0 0 354196 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=11544 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 561 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3587.97 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3598.4 s]
/proc/loadavg: 3.94 4.07 4.08 3/247 1006870
/proc/meminfo: memFree=125675636/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3589.57 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768606 0 0 0 358887 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=4916 CPUtime=3544.1 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679504 0 0 0 354356 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=-7952647673543353212 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 561 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3589.57 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3599.2 s]
/proc/loadavg: 3.94 4.07 4.08 3/247 1006870
/proc/meminfo: memFree=125675644/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3590.37 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 768606 0 0 0 358967 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=13196 CPUtime=3544.9 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 679504 0 0 0 354436 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=903408 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 561 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3590.37 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3600 s]*
/proc/loadavg: 3.78 4.04 4.07 3/247 1006872
/proc/meminfo: memFree=125675528/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=995940 memory=903408 CPUtime=3591.17 cores=5,7
/proc/1004383/stat : 1004383 (fscip) S 1004380 1004383 1000251 0 -1 1077936128 769124 0 0 0 359047 70 0 0 20 0 3 0 185948844 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 248985 225852 3262 3032 0 234969 0
[pid=1004383/tid=1004777] ppid=1004380 vsize=995940 memory=-7312297431587394663 CPUtime=3545.7 cores=5,7
/proc/1004383/task/1004777/stat : 1004777 (fscip) R 1004380 1004383 1000251 0 -1 4194368 680021 0 0 0 354516 54 0 0 20 0 3 0 185953396 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=995940 memory=1401069873814724666 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 562 0 0 0 1 2 0 0 20 0 3 0 185953407 1019842560 225852 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3591.17 s
Current children cumulated vsize: 995940 KiB
Current children cumulated memory: 903408 KiB

[startup+3600.2 s]
/proc/loadavg: 3.78 4.04 4.07 3/247 1006872
/proc/meminfo: memFree=125675528/131524600 swapFree=131071996/131071996
[pid=1004383] ppid=1004380 vsize=919852 memory=827752 CPUtime=3591.37 cores=5,7
/proc/1004383/stat : 1004383 (fscip) R 1004380 1004383 1000251 0 -1 4194304 772799 0 0 0 359067 70 0 0 20 0 2 0 185948844 941928448 206938 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
/proc/1004383/statm: 229963 206938 3310 3032 0 215947 0
[pid=1004383/tid=1004778] ppid=1004380 vsize=919852 memory=45552 CPUtime=0.03 cores=5,7
/proc/1004383/task/1004778/stat : 1004778 (fscip) S 1004380 1004383 1000251 0 -1 1077936192 562 0 0 0 1 2 0 0 20 0 2 0 185953407 941928448 206938 134679101440 4194304 16613245 140734544590400 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 26279936 140734544598035 140734544598151 140734544598151 140734544605168 0
Current children cumulated CPU time: 3591.37 s
Current children cumulated vsize: 919852 KiB
Current children cumulated memory: 827752 KiB

Child status: 0

Real time (s): 3600.26
CPU time (s): 3591.44
CPU user time (s): 3590.72
CPU system time (s): 0.715961
CPU usage (%): 99.755
Max. virtual memory (cumulated for all children) (KiB): 995940
Max. memory (cumulated for all children) (KiB): 903408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3590.72
system time used= 0.715961
maximum resident set size= 903824
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 775610
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3578
involuntary context switches= 1600


# summary of solver processes directly reported to runsolver:
#   pid: 1004383
#   total CPU time (s): 3591.44
#   total CPU user time (s): 3590.72
#   total CPU system time (s): 0.715961

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.11622 second user time and 16.4363 second system time

The end

Launcher Data

Begin job on nodeC017 at 2024-07-18 23:24:42
IDJOB=4446560
IDBENCH=158277
IDSOLVER=3064
FILE ID=nodeC017/4446560-1721337870
RUNJOBID= nodeC017-1721330666-1000264
SLURM_JOB_ID= 7542711
Free space on /tmp= 889992 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K197.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446560-1721337870/watcher-4446560-1721337870 -o /tmp/evaluation-result-4446560-1721337870/solver-4446560-1721337870 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000264 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446560-1721337870.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= cd0a69270cffb0a3df5915a64d0aa68c
RANDOM SEED=567774999

nodeC017.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.521
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3673.919
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.875
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3604.037
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.540
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3676.499
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.103
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.240
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        126274436 kB
MemAvailable:   128828936 kB
Buffers:          541776 kB
Cached:          2830292 kB
SwapCached:            0 kB
Active:          1227080 kB
Inactive:        3369624 kB
Active(anon):       1568 kB
Inactive(anon):  1260792 kB
Active(file):    1225512 kB
Inactive(file):  2108832 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             88932 kB
Writeback:             0 kB
AnonPages:       1224628 kB
Mapped:           141432 kB
Shmem:             37720 kB
KReclaimable:     119604 kB
Slab:             233432 kB
SReclaimable:     119604 kB
SUnreclaim:       113828 kB
KernelStack:        4220 kB
PageTables:        11740 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1334708 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68288 kB
HardwareCorrupted:     0 kB
AnonHugePages:    362496 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      287444 kB
DirectMap2M:    40380416 kB
DirectMap1G:    95420416 kB

Free space on /tmp at the end= 890024 MiB
End job on nodeC017 at 2024-07-19 00:24:43