Trace number 4452790

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3591.09 3600.32

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP135.shuf-3.opb
MD5SUMbaac7260ecc6f9812e76d8cbcf4d3b9b
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark9.93598
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables46580
Total number of constraints9317
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)4
Number of constraints which are nor clauses,nor cardinality constraints9313
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 10
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 30
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.17	c Default LC presolving (default).
0.09/0.17	c ** Before presolving: virtualMemUsedAtLc = 173776463, getVmSize() = 147496960, SCIPgetMemUsed() = 118222929, SCIPgetMemTotal() = 123273137, SCIPgetMemExternEstim() = 50503326
0.09/0.17	c ** set memory limit for presolving in LC to 8.79604e+12 for SCIP **
1.49/1.54	c ** Estimated virtualMemUsedAtSolver = 262793764, getVmSize() = 602476544, SCIPgetMemUsed() = 211639825, SCIPgetMemTotal() = 343687321, SCIPgetMemExternEstim() = 50503326
1.49/1.54	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
1.49/1.54	c Original Problem   :
1.49/1.54	c   Problem name     : instance-4452790-1721447876
1.49/1.54	c   Variables        : 46580 (46580 binary, 0 integer, 0 implicit integer, 0 continuous)
1.49/1.54	c   Constraints      : 9317
1.49/1.54	c   Objective sense  : minimize
1.49/1.54	c Presolved Problem  :
1.49/1.54	c   Variables        : 46580 (46580 binary, 0 integer, 0 implicit integer, 0 continuous)
1.49/1.54	c   Constraints      : 10166
1.49/1.54	c Constraints        : Number
1.49/1.54	c   knapsack         : 9317 
1.49/1.54	c   setppc           : 849 
1.49/1.54	c ** Instance transfer method used: 0
1.59/1.62	c ** ParaScipInstance copy does not increase the number of variables. **
1.69/1.70	c LC is working with racing ramp-up and with rebuilding tree after racing.
1.69/1.70	c                                Nodes    Active                                            
1.69/1.70	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
978.54/981.25	c       981              2           1         1                -           0.0000          -
2114.29/2119.82	c      2120              3           2         1                -           0.0000          -
3527.12/3536.21	c      3536              4           3         1                -           0.0000          -
3590.77/3600.00	c      3600              4           3         0                -           0.0000          -
3590.87/3600.17	c SCIP Status        : c solving was interrupted [hard time limit reached]
3590.87/3600.17	c Total Time         : 3600.1600
3590.87/3600.17	c   solving          : 3600.1600
3590.87/3600.17	c   presolving       : 1.3675 (included in solving)
3590.87/3600.17	c B&B Tree           :
3590.87/3600.17	c   nodes (total)    : 1
3590.87/3600.17	c Solution           :
3590.87/3600.17	c   Solutions found  : 0
3590.87/3600.17	c   Primal Bound     :          -
3590.87/3600.17	c   Dual Bound       : +0.00000000000000e+00
3590.87/3600.17	c Gap                :          -
3591.07/3600.31	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61036 MiB free)
  memory of node 1: 64510 MiB (61735 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452790-1721447876/watcher-4452790-1721447876 -o /tmp/evaluation-result-4452790-1721447876/solver-4452790-1721447876 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059845 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4452790-1721447876.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1060871, runsolver pid=1060868
Current StackSize limit: 8192 KiB


[startup+0.100092 s]*
/proc/loadavg: 4.13 4.14 4.11 5/262 1060872
/proc/meminfo: memFree=125643896/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=100516 memory=89704 CPUtime=0.09 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 20227 0 0 0 7 2 0 0 20 0 1 0 196955014 102928384 22426 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 25129 22426 2542 3032 0 21529 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 100516 KiB
Current children cumulated memory: 89704 KiB

[startup+0.205602 s]*
/proc/loadavg: 4.13 4.14 4.11 5/262 1060872
/proc/meminfo: memFree=125586632/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=158192 memory=140512 CPUtime=0.2 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 32909 0 0 0 15 5 0 0 20 0 1 0 196955014 161988608 35128 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 39548 35128 2574 3032 0 35948 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 158192 KiB
Current children cumulated memory: 140512 KiB

[startup+0.305511 s]*
/proc/loadavg: 4.13 4.14 4.11 5/262 1060872
/proc/meminfo: memFree=125553496/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=191792 memory=174024 CPUtime=0.3 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 42917 0 0 0 24 6 0 0 20 0 1 0 196955014 196395008 43506 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 47948 43506 2654 3032 0 44348 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 191792 KiB
Current children cumulated memory: 174024 KiB

[startup+0.700228 s]
/proc/loadavg: 4.13 4.14 4.11 5/262 1060872
/proc/meminfo: memFree=125513688/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=236048 memory=216992 CPUtime=0.68 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 59453 0 0 0 60 8 0 0 20 0 1 0 196955014 241713152 54248 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 59012 54248 2734 3032 0 55412 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 236048 KiB
Current children cumulated memory: 216992 KiB

[startup+1.50022 s]
/proc/loadavg: 4.13 4.14 4.11 5/262 1060872
/proc/meminfo: memFree=125509712/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=587744 memory=499308 CPUtime=1.49 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 129531 0 0 0 131 18 0 0 20 0 1 0 196955014 601849856 124827 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 146936 124827 2766 3032 0 143336 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 587744 KiB
Current children cumulated memory: 499308 KiB

[startup+3.10641 s]
/proc/loadavg: 4.13 4.14 4.11 5/264 1060874
/proc/meminfo: memFree=124961756/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=782436 CPUtime=3.07 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 206090 0 0 0 278 29 0 0 20 0 3 0 196955014 954806272 195609 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 195609 2878 3032 0 221731 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=198340509722 CPUtime=1.45 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 76550 0 0 0 134 11 0 0 20 0 3 0 196955169 954806272 195609 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=0 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 4 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 195609 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 782436 KiB

[startup+6.3002 s]
/proc/loadavg: 4.12 4.14 4.11 5/265 1060877
/proc/meminfo: memFree=124936068/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=790292 CPUtime=6.25 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 212675 0 0 0 595 30 0 0 20 0 3 0 196955014 954806272 197573 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 197573 2894 3032 0 223720 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=0 CPUtime=4.64 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 83132 0 0 0 452 12 0 0 20 0 3 0 196955169 954806272 197573 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=0 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 7 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 197573 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 6.25 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 790292 KiB

[startup+12.7002 s]
/proc/loadavg: 4.11 4.13 4.11 5/265 1060877
/proc/meminfo: memFree=124935600/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=790760 CPUtime=12.64 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 217410 0 0 0 1233 31 0 0 20 0 3 0 196955014 954806272 197690 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 197690 2894 3032 0 223791 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=0 CPUtime=11.01 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 87856 0 0 0 1089 12 0 0 20 0 3 0 196955169 954806272 197690 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=790760 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 18 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 197690 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 790760 KiB

[startup+25.5002 s]
/proc/loadavg: 4.09 4.13 4.10 5/265 1060880
/proc/meminfo: memFree=124935432/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=791084 CPUtime=25.4 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 231388 0 0 0 2509 31 0 0 20 0 3 0 196955014 954806272 197771 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 197771 2894 3032 0 223891 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=11588 CPUtime=23.78 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 101817 0 0 0 2365 13 0 0 20 0 3 0 196955169 954806272 197771 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=11588 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 35 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 197771 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 791084 KiB

[startup+51.1051 s]
/proc/loadavg: 4.13 4.13 4.10 5/265 1060883
/proc/meminfo: memFree=124934884/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=792612 CPUtime=50.94 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 241699 0 0 0 5061 33 0 0 20 0 3 0 196955014 954806272 198153 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 198153 3214 3032 0 223958 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=11588 CPUtime=49.32 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 112110 0 0 0 4918 14 0 0 20 0 3 0 196955169 954806272 198153 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=792612 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 53 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 198153 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 792612 KiB

[startup+102.3 s]
/proc/loadavg: 4.12 4.13 4.10 5/265 1060891
/proc/meminfo: memFree=124934576/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=792628 CPUtime=101.99 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 255940 0 0 0 10166 33 0 0 20 0 3 0 196955014 954806272 198157 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 198157 3214 3032 0 223958 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=792628 CPUtime=100.38 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 126334 0 0 0 10023 15 0 0 20 0 3 0 196955169 954806272 198157 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=792628 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 70 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 198157 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 101.99 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 792628 KiB

[startup+162.3 s]
/proc/loadavg: 4.10 4.12 4.09 5/265 1060903
/proc/meminfo: memFree=124934008/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=792736 CPUtime=161.84 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 261473 0 0 0 16150 34 0 0 20 0 3 0 196955014 954806272 198184 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 198184 3214 3032 0 223984 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=-7520302109181697664 CPUtime=160.21 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 131856 0 0 0 16006 15 0 0 20 0 3 0 196955169 954806272 198184 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=792632 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 81 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 198184 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 161.84 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 792736 KiB

[startup+222.3 s]
/proc/loadavg: 4.15 4.12 4.09 5/263 1060925
/proc/meminfo: memFree=124933448/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=792740 CPUtime=221.67 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 271221 0 0 0 22133 34 0 0 20 0 3 0 196955014 954806272 198185 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 198185 3214 3032 0 223984 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=792740 CPUtime=220.05 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 141594 0 0 0 21989 16 0 0 20 0 3 0 196955169 954806272 198185 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=47212 CPUtime=0 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 91 0 0 0 0 0 0 0 20 0 3 0 196955185 954806272 198185 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 221.67 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 792740 KiB

[startup+282.3 s]
/proc/loadavg: 4.11 4.11 4.09 5/263 1060935
/proc/meminfo: memFree=124927908/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=794496 CPUtime=281.51 cores=4,6

################
# More data... #
################

/proc/loadavg: 4.20 4.12 4.10 5/260 1063899
/proc/meminfo: memFree=124990324/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3453.41 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419007 0 0 0 345295 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=11588 CPUtime=3451.75 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 288911 0 0 0 345150 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=-6809295051269573996 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 544 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3453.41 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3522.3 s]
/proc/loadavg: 4.12 4.11 4.09 5/262 1064297
/proc/meminfo: memFree=125091124/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3513.26 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419398 0 0 0 351280 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=822936 CPUtime=3511.6 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289297 0 0 0 351135 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=11588 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 549 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3513.26 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3582.3 s]
/proc/loadavg: 4.15 4.12 4.09 5/262 1064309
/proc/meminfo: memFree=125090836/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3573.11 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419908 0 0 0 357265 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=822936 CPUtime=3571.45 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289793 0 0 0 357120 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=11588 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 556 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3573.11 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3600.32 s]
# the end of solver process 1060871 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3590.61 s, system=0.478733 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.15 4.12 4.09 5/262 1064309
/proc/meminfo: memFree=125090836/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3574.81 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419908 0 0 0 357435 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=-7168738596529148521 CPUtime=3573.15 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289793 0 0 0 357290 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=-9187040381884464064 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 556 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3574.81 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3590.4 s]
/proc/loadavg: 4.13 4.12 4.09 5/262 1064310
/proc/meminfo: memFree=125090788/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3581.19 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419909 0 0 0 358073 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=12508 CPUtime=3579.53 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289794 0 0 0 357928 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=5536 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 556 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3581.19 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3596.8 s]
/proc/loadavg: 4.28 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089872/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3587.57 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419917 0 0 0 358711 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=0 CPUtime=3585.91 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289802 0 0 0 358566 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=0 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 556 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3587.57 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3598.4 s]
/proc/loadavg: 4.28 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089900/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3589.17 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419920 0 0 0 358871 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=822936 CPUtime=3587.51 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289802 0 0 0 358726 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=5536 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 559 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3589.17 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3599.2 s]
/proc/loadavg: 4.28 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089920/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3589.97 cores=4,6
/proc/1060871/stat : 1060871 (fscip) S 1060868 1060871 1059834 0 -1 1077936128 419921 0 0 0 358951 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=47212 CPUtime=3588.31 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289803 0 0 0 358806 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=12508 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 559 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3589.97 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3600 s]*
/proc/loadavg: 4.25 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089920/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=822936 CPUtime=3590.77 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 1077936128 419995 0 0 0 359031 46 0 0 20 0 3 0 196955014 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205734 3214 3032 0 224899 0
[pid=1060871/tid=1060873] ppid=1060868 vsize=932428 memory=-7168738596529148521 CPUtime=3589.11 cores=4,6
/proc/1060871/task/1060873/stat : 1060873 (fscip) R 1060868 1060871 1059834 0 -1 4194368 289877 0 0 0 358886 25 0 0 20 0 3 0 196955169 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=-9187040377606142912 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 559 0 0 0 1 2 0 0 20 0 3 0 196955185 954806272 205734 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3590.77 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 822936 KiB

[startup+3600.2 s]
/proc/loadavg: 4.25 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089920/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=932428 memory=823136 CPUtime=3590.96 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 423130 0 0 0 359050 46 0 0 20 0 2 0 196955014 954806272 205784 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 233107 205784 3262 3032 0 224899 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=932428 memory=2824 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 559 0 0 0 1 2 0 0 20 0 2 0 196955185 954806272 205784 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3590.96 s
Current children cumulated vsize: 932428 KiB
Current children cumulated memory: 823136 KiB

[startup+3600.3 s]
/proc/loadavg: 4.25 4.15 4.10 5/263 1064481
/proc/meminfo: memFree=125089920/131524600 swapFree=131071996/131071996
[pid=1060871] ppid=1060868 vsize=874840 memory=765612 CPUtime=3591.07 cores=4,6
/proc/1060871/stat : 1060871 (fscip) R 1060868 1060871 1059834 0 -1 4194304 424654 0 0 0 359060 47 0 0 20 0 2 0 196955014 895836160 191403 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
/proc/1060871/statm: 218710 191403 3262 3032 0 210502 0
[pid=1060871/tid=1060874] ppid=1060868 vsize=874840 memory=822936 CPUtime=0.03 cores=4,6
/proc/1060871/task/1060874/stat : 1060874 (fscip) S 1060868 1060871 1059834 0 -1 1077936192 559 0 0 0 1 2 0 0 20 0 2 0 196955185 895836160 191403 134679101440 4194304 16613245 140733170958992 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 24985600 140733170967571 140733170967687 140733170967687 140733170974704 0
Current children cumulated CPU time: 3591.07 s
Current children cumulated vsize: 874840 KiB
Current children cumulated memory: 765612 KiB

Child status: 0

Real time (s): 3600.32
CPU time (s): 3591.09
CPU user time (s): 3590.61
CPU system time (s): 0.478733
CPU usage (%): 99.7437
Max. virtual memory (cumulated for all children) (KiB): 932428
Max. memory (cumulated for all children) (KiB): 823136

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3590.61
system time used= 0.478733
maximum resident set size= 823136
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 426211
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3634
involuntary context switches= 1169


# summary of solver processes directly reported to runsolver:
#   pid: 1060871
#   total CPU time (s): 3591.09
#   total CPU user time (s): 3590.61
#   total CPU system time (s): 0.478733

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.16367 second user time and 17.0208 second system time

The end

Launcher Data

Begin job on nodeC029 at 2024-07-20 05:58:09
IDJOB=4452790
IDBENCH=165317
IDSOLVER=3064
FILE ID=nodeC029/4452790-1721447876
RUNJOBID= nodeC029-1721446720-1059845
SLURM_JOB_ID= 7545672
Free space on /tmp= 889984 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP135.shuf-3.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452790-1721447876/watcher-4452790-1721447876 -o /tmp/evaluation-result-4452790-1721447876/solver-4452790-1721447876 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059845 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4452790-1721447876.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= baac7260ecc6f9812e76d8cbcf4d3b9b
RANDOM SEED=1995829751

nodeC029.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.338
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.415
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3602.339
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.406
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3654.317
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.473
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.781
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.083
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125717976 kB
MemAvailable:   128674344 kB
Buffers:          536192 kB
Cached:          3234860 kB
SwapCached:            0 kB
Active:          1049256 kB
Inactive:        4070124 kB
Active(anon):       1464 kB
Inactive(anon):  1392760 kB
Active(file):    1047792 kB
Inactive(file):  2677364 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29640 kB
Writeback:             0 kB
AnonPages:       1348320 kB
Mapped:           143356 kB
Shmem:             45912 kB
KReclaimable:     141716 kB
Slab:             260232 kB
SReclaimable:     141716 kB
SUnreclaim:       118516 kB
KernelStack:        4176 kB
PageTables:        12040 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1445452 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            71872 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1185792 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      281300 kB
DirectMap2M:    36192256 kB
DirectMap1G:    99614720 kB

Free space on /tmp at the end= 889952 MiB
End job on nodeC029 at 2024-07-20 06:58:10