Trace number 4452880

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3587.59 3600.36

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP145.shuf-2.opb
MD5SUM94622b8283878cd58e113c83df8c4b53
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark12.6419
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables53655
Total number of constraints10732
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)8
Number of constraints which are nor clauses,nor cardinality constraints10724
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 9
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 29
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.20/0.21	c Default LC presolving (default).
0.20/0.21	c ** Before presolving: virtualMemUsedAtLc = 199480194, getVmSize() = 165732352, SCIPgetMemUsed() = 135640274, SCIPgetMemTotal() = 141302210, SCIPgetMemExternEstim() = 58177984
0.20/0.21	c ** set memory limit for presolving in LC to 8.79603e+12 for SCIP **
1.79/1.81	c ** Estimated virtualMemUsedAtSolver = 307278591, getVmSize() = 650330112, SCIPgetMemUsed() = 234368671, SCIPgetMemTotal() = 402739903, SCIPgetMemExternEstim() = 58177984
1.79/1.81	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
1.79/1.81	c Original Problem   :
1.79/1.81	c   Problem name     : instance-4452880-1721448932
1.79/1.81	c   Variables        : 53655 (53655 binary, 0 integer, 0 implicit integer, 0 continuous)
1.79/1.81	c   Constraints      : 10732
1.79/1.81	c   Objective sense  : minimize
1.79/1.81	c Presolved Problem  :
1.79/1.81	c   Variables        : 53655 (53655 binary, 0 integer, 0 implicit integer, 0 continuous)
1.79/1.81	c   Constraints      : 11532
1.79/1.81	c Constraints        : Number
1.79/1.81	c   knapsack         : 10732 
1.79/1.81	c   setppc           : 800 
1.79/1.81	c ** Instance transfer method used: 0
1.89/1.90	c ** ParaScipInstance copy does not increase the number of variables. **
1.89/1.99	c LC is working with racing ramp-up and with rebuilding tree after racing.
1.89/1.99	c                                Nodes    Active                                            
1.89/1.99	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1393.27/1398.56	c      1399              2           1         1                -           0.0000          -
3379.24/3391.34	c      3391              3           2         1                -           0.0000          -
3587.13/3600.00	c      3600              3           2         0                -           0.0000          -
3587.33/3600.20	c SCIP Status        : c solving was interrupted [hard time limit reached]
3587.33/3600.20	c Total Time         : 3600.1900
3587.33/3600.20	c   solving          : 3600.1900
3587.33/3600.20	c   presolving       : 1.6010 (included in solving)
3587.33/3600.20	c B&B Tree           :
3587.33/3600.20	c   nodes (total)    : 1
3587.33/3600.20	c Solution           :
3587.33/3600.20	c   Solutions found  : 0
3587.33/3600.20	c   Primal Bound     :          -
3587.33/3600.20	c   Dual Bound       : +0.00000000000000e+00
3587.33/3600.20	c Gap                :          -
3587.53/3600.35	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (60816 MiB free)
  memory of node 1: 64510 MiB (61727 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452880-1721448932/watcher-4452880-1721448932 -o /tmp/evaluation-result-4452880-1721448932/solver-4452880-1721448932 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059844 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4452880-1721448932.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1061219, runsolver pid=1061216
Current StackSize limit: 8192 KiB


[startup+0.100061 s]*
/proc/loadavg: 4.13 4.13 4.09 5/262 1061220
/proc/meminfo: memFree=125421380/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=90708 memory=79656 CPUtime=0.09 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 17729 0 0 0 8 1 0 0 20 0 1 0 197060634 92884992 19914 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 22677 19914 2542 3032 0 19077 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 90708 KiB
Current children cumulated memory: 79656 KiB

[startup+0.205658 s]*
/proc/loadavg: 4.13 4.13 4.09 5/262 1061220
/proc/meminfo: memFree=125345920/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=160564 memory=148824 CPUtime=0.2 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 35003 0 0 0 17 3 0 0 20 0 1 0 197060634 164417536 37206 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 40141 37206 2542 3032 0 36541 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 160564 KiB
Current children cumulated memory: 148824 KiB

[startup+0.305592 s]*
/proc/loadavg: 4.13 4.13 4.09 5/262 1061220
/proc/meminfo: memFree=125324612/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=192184 memory=170892 CPUtime=0.3 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 40466 0 0 0 26 4 0 0 20 0 1 0 197060634 196796416 42723 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 48046 42723 2622 3032 0 44446 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 192184 KiB
Current children cumulated memory: 170892 KiB

[startup+0.700215 s]
/proc/loadavg: 4.13 4.13 4.09 5/262 1061220
/proc/meminfo: memFree=125264152/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=264952 memory=244712 CPUtime=0.68 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 67357 0 0 0 60 8 0 0 20 0 1 0 197060634 271310848 61178 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 66238 61178 2718 3032 0 62638 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 264952 KiB
Current children cumulated memory: 244712 KiB

[startup+1.5002 s]
/proc/loadavg: 4.13 4.13 4.09 5/259 1061220
/proc/meminfo: memFree=125247940/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=570636 memory=463456 CPUtime=1.49 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 121041 0 0 0 133 16 0 0 20 0 1 0 197060634 584331264 115864 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 142659 115864 2766 3032 0 139059 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 570636 KiB
Current children cumulated memory: 463456 KiB

[startup+3.1058 s]
/proc/loadavg: 4.12 4.13 4.09 5/261 1061222
/proc/meminfo: memFree=124716500/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=913624 memory=776924 CPUtime=3.07 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 198492 0 0 0 281 26 0 0 20 0 3 0 197060634 935550976 194231 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 228406 194231 2782 3032 0 222840 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=913624 memory=198340509722 CPUtime=1.17 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 59741 0 0 0 109 8 0 0 20 0 3 0 197060816 935550976 194231 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=913624 memory=0 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 5 0 0 0 0 0 0 0 20 0 3 0 197060834 935550976 194231 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 913624 KiB
Current children cumulated memory: 776924 KiB

[startup+6.30082 s]
/proc/loadavg: 4.12 4.13 4.09 5/261 1061222
/proc/meminfo: memFree=124627960/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=865696 CPUtime=6.24 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 225282 0 0 0 594 30 0 0 20 0 3 0 197060634 1069768704 216424 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 216424 2894 3032 0 245110 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=0 CPUtime=4.34 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 86528 0 0 0 422 12 0 0 20 0 3 0 197060816 1069768704 216424 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=0 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 8 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 216424 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 6.24 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 865696 KiB

[startup+12.7008 s]
/proc/loadavg: 4.11 4.12 4.09 5/261 1061223
/proc/meminfo: memFree=124626288/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=866940 CPUtime=12.58 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 231303 0 0 0 1228 30 0 0 20 0 3 0 197060634 1069768704 216735 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 216735 2894 3032 0 245799 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=0 CPUtime=10.68 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 92538 0 0 0 1056 12 0 0 20 0 3 0 197060816 1069768704 216735 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=866932 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 19 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 216735 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 12.58 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 866940 KiB

[startup+25.5008 s]
/proc/loadavg: 4.16 4.13 4.09 5/261 1061225
/proc/meminfo: memFree=124624252/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=866980 CPUtime=25.25 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 246595 0 0 0 2494 31 0 0 20 0 3 0 197060634 1069768704 216745 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 216745 2894 3032 0 245799 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=11588 CPUtime=23.35 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 107813 0 0 0 2322 13 0 0 20 0 3 0 197060816 1069768704 216745 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=11588 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 36 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 216745 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 25.25 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 866980 KiB

[startup+51.1058 s]
/proc/loadavg: 4.17 4.14 4.10 5/261 1061229
/proc/meminfo: memFree=124623760/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=868272 CPUtime=50.6 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 258746 0 0 0 5028 32 0 0 20 0 3 0 197060634 1069768704 217068 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 217068 3214 3032 0 245799 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=11588 CPUtime=48.7 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 119946 0 0 0 4856 14 0 0 20 0 3 0 197060816 1069768704 217068 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=868272 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 54 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 217068 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 50.6 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 868272 KiB

[startup+102.3 s]
/proc/loadavg: 4.12 4.13 4.09 5/261 1061238
/proc/meminfo: memFree=124617552/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=868540 CPUtime=101.61 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 274731 0 0 0 10128 33 0 0 20 0 3 0 197060634 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 217135 3214 3032 0 245889 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=868540 CPUtime=99.71 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 135916 0 0 0 9956 15 0 0 20 0 3 0 197060816 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=868540 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 69 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 101.61 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 868540 KiB

[startup+162.3 s]
/proc/loadavg: 4.15 4.14 4.09 5/260 1062831
/proc/meminfo: memFree=124782932/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=868540 CPUtime=161.39 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 285843 0 0 0 16104 35 0 0 20 0 3 0 197060634 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 217135 3214 3032 0 245889 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=868540 CPUtime=159.49 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 147015 0 0 0 15932 17 0 0 20 0 3 0 197060816 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=868540 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 82 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 161.39 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 868540 KiB

[startup+222.3 s]
/proc/loadavg: 4.11 4.12 4.09 5/259 1062841
/proc/meminfo: memFree=124780628/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=868540 CPUtime=221.17 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 292119 0 0 0 22081 36 0 0 20 0 3 0 197060634 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 217135 3214 3032 0 245889 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=868540 CPUtime=219.26 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 153277 0 0 0 21909 17 0 0 20 0 3 0 197060816 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=-7520302109215581311 CPUtime=0 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 96 0 0 0 0 0 0 0 20 0 3 0 197060834 1069768704 217135 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 221.17 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 868540 KiB

[startup+282.3 s]
/proc/loadavg: 4.20 4.15 4.10 5/261 1062855
/proc/meminfo: memFree=124772880/131524600 swapFree=131071996/131071996

################
# More data... #
################

/proc/loadavg: 4.12 4.13 4.09 5/262 1064758
/proc/meminfo: memFree=125674972/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3450 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365355 0 0 0 344955 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3448.06 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226025 0 0 0 344782 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=47212 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 547 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3450 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3522.3 s]
/proc/loadavg: 4.14 4.14 4.09 5/262 1064769
/proc/meminfo: memFree=125674176/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3509.79 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365646 0 0 0 350934 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3507.85 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226309 0 0 0 350761 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=11588 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 554 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3509.79 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3582.3 s]
/proc/loadavg: 4.36 4.19 4.11 5/260 1064779
/proc/meminfo: memFree=125673724/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3569.59 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365946 0 0 0 356914 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=11588 CPUtime=3567.65 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226601 0 0 0 356741 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=16112 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 562 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3569.59 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3600.36 s]
# the end of solver process 1061219 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3587.13 s, system=0.468199 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.33 4.19 4.11 5/260 1064779
/proc/meminfo: memFree=125673740/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3571.28 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365946 0 0 0 357083 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=2824 CPUtime=3569.35 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226601 0 0 0 356911 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=-9044459746194447340 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 562 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3571.28 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3590.4 s]
/proc/loadavg: 4.31 4.18 4.11 5/260 1064781
/proc/meminfo: memFree=125673632/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3577.66 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365946 0 0 0 357721 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3575.72 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226601 0 0 0 357548 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=900012 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 562 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3577.66 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3596.8 s]
/proc/loadavg: 4.36 4.20 4.12 5/260 1064781
/proc/meminfo: memFree=125673636/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3584.04 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365950 0 0 0 358359 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3582.1 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226603 0 0 0 358186 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=11588 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3584.04 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3598.4 s]
/proc/loadavg: 4.36 4.20 4.12 5/260 1064781
/proc/meminfo: memFree=125673636/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3585.63 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365950 0 0 0 358518 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=12508 CPUtime=3583.69 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226603 0 0 0 358345 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=5536 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3585.63 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3599.2 s]
/proc/loadavg: 4.33 4.19 4.11 5/260 1064782
/proc/meminfo: memFree=125673660/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3586.43 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 365950 0 0 0 358598 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=16112 CPUtime=3584.49 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 226603 0 0 0 358425 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=2340 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3586.43 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3600 s]*
/proc/loadavg: 4.33 4.19 4.11 5/260 1064782
/proc/meminfo: memFree=125673580/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900012 CPUtime=3587.23 cores=0,2
/proc/1061219/stat : 1061219 (fscip) S 1061216 1061219 1059834 0 -1 1077936128 366323 0 0 0 358678 45 0 0 20 0 3 0 197060634 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225003 3214 3032 0 246746 0
[pid=1061219/tid=1061221] ppid=1061216 vsize=1044696 memory=-7024341933426184296 CPUtime=3585.29 cores=0,2
/proc/1061219/task/1061221/stat : 1061221 (fscip) R 1061216 1061219 1059834 0 -1 4194368 227073 0 0 0 358505 24 0 0 20 0 3 0 197060816 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=-9044459746194447340 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 3 0 197060834 1069768704 225003 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3587.23 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900012 KiB

[startup+3600.21 s]
/proc/loadavg: 4.33 4.19 4.11 5/260 1064782
/proc/meminfo: memFree=125673580/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1044696 memory=900212 CPUtime=3587.45 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 369152 0 0 0 358699 46 0 0 20 0 2 0 197060634 1069768704 225053 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 261174 225053 3262 3032 0 246746 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1044696 memory=900012 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 2 0 197060834 1069768704 225053 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3587.45 s
Current children cumulated vsize: 1044696 KiB
Current children cumulated memory: 900212 KiB

[startup+3600.3 s]
/proc/loadavg: 4.33 4.19 4.11 5/260 1064782
/proc/meminfo: memFree=125673580/131524600 swapFree=131071996/131071996
[pid=1061219] ppid=1061216 vsize=1012360 memory=867876 CPUtime=3587.53 cores=0,2
/proc/1061219/stat : 1061219 (fscip) R 1061216 1061219 1059834 0 -1 4194304 369216 0 0 0 358707 46 0 0 20 0 2 0 197060634 1036656640 216969 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
/proc/1061219/statm: 253090 216969 3262 3032 0 238662 0
[pid=1061219/tid=1061222] ppid=1061216 vsize=1012360 memory=900012 CPUtime=0.03 cores=0,2
/proc/1061219/task/1061222/stat : 1061222 (fscip) S 1061216 1061219 1059834 0 -1 1077936192 564 0 0 0 1 2 0 0 20 0 2 0 197060834 1036656640 216969 134679101440 4194304 16613245 140729599975488 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 38637568 140729599980563 140729599980679 140729599980679 140729599987696 0
Current children cumulated CPU time: 3587.53 s
Current children cumulated vsize: 1012360 KiB
Current children cumulated memory: 867876 KiB

Child status: 0

Real time (s): 3600.36
CPU time (s): 3587.59
CPU user time (s): 3587.13
CPU system time (s): 0.468199
CPU usage (%): 99.6455
Max. virtual memory (cumulated for all children) (KiB): 1044696
Max. memory (cumulated for all children) (KiB): 900212

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3587.13
system time used= 0.468199
maximum resident set size= 900212
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 371665
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3640
involuntary context switches= 25392


# summary of solver processes directly reported to runsolver:
#   pid: 1061219
#   total CPU time (s): 3587.59
#   total CPU user time (s): 3587.13
#   total CPU system time (s): 0.468199

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.89684 second user time and 16.1916 second system time

The end

Launcher Data 

Begin job on nodeC029 at 2024-07-20 06:15:45
IDJOB=4452880
IDBENCH=165345
IDSOLVER=3064
FILE ID=nodeC029/4452880-1721448932
RUNJOBID= nodeC029-1721446720-1059844
SLURM_JOB_ID= 7545672
Free space on /tmp= 889980 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP145.shuf-2.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452880-1721448932/watcher-4452880-1721448932 -o /tmp/evaluation-result-4452880-1721448932/solver-4452880-1721448932 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059844 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4452880-1721448932.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 94622b8283878cd58e113c83df8c4b53
RANDOM SEED=1995829751

nodeC029.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3659.555
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3682.288
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.564
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.384
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3666.167
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3682.326
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3602.890
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.300
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125484796 kB
MemAvailable:   128448932 kB
Buffers:          537212 kB
Cached:          3241540 kB
SwapCached:            0 kB
Active:          1051248 kB
Inactive:        4300980 kB
Active(anon):       1472 kB
Inactive(anon):  1617920 kB
Active(file):    1049776 kB
Inactive(file):  2683060 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             30104 kB
Writeback:             8 kB
AnonPages:       1573512 kB
Mapped:           143452 kB
Shmem:             45912 kB
KReclaimable:     141892 kB
Slab:             260612 kB
SReclaimable:     141892 kB
SUnreclaim:       118720 kB
KernelStack:        4204 kB
PageTables:        12492 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1691372 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            71872 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1003520 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      281300 kB
DirectMap2M:    36192256 kB
DirectMap1G:    99614720 kB

Free space on /tmp at the end= 889952 MiB
End job on nodeC029 at 2024-07-20 07:15:46