Trace number 4464631

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3589.3 3598.45

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP145.shuf-2.opb
MD5SUM94622b8283878cd58e113c83df8c4b53
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark12.6419
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables53655
Total number of constraints10732
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)8
Number of constraints which are nor clauses,nor cardinality constraints10724
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 9
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 29
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.31/0.41	c Default LC presolving (default).
0.31/0.42	c ** Before presolving: virtualMemUsedAtLc = 199480194, getVmSize() = 165748736, SCIPgetMemUsed() = 135640354, SCIPgetMemTotal() = 141302210, SCIPgetMemExternEstim() = 58177984
0.31/0.42	c ** set memory limit for presolving in LC to 8.79603e+12 for SCIP **
2.28/2.35	c ** Estimated virtualMemUsedAtSolver = 307278591, getVmSize() = 650268672, SCIPgetMemUsed() = 234368751, SCIPgetMemTotal() = 402739903, SCIPgetMemExternEstim() = 58177984
2.28/2.35	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
2.28/2.35	c Original Problem   :
2.28/2.35	c   Problem name     : instance-4464631-1722388242
2.28/2.35	c   Variables        : 53655 (53655 binary, 0 integer, 0 implicit integer, 0 continuous)
2.28/2.35	c   Constraints      : 10732
2.28/2.35	c   Objective sense  : minimize
2.28/2.35	c Presolved Problem  :
2.28/2.35	c   Variables        : 53655 (53655 binary, 0 integer, 0 implicit integer, 0 continuous)
2.28/2.35	c   Constraints      : 11532
2.28/2.35	c Constraints        : Number
2.28/2.35	c   knapsack         : 10732 
2.28/2.35	c   setppc           : 800 
2.28/2.35	c ** Instance transfer method used: 0
2.38/2.44	c ** ParaScipInstance copy does not increase the number of variables. **
2.58/2.62	c LC is working with racing ramp-up and with rebuilding tree after racing.
2.58/2.62	c                                Nodes    Active                                            
2.58/2.62	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1372.28/1376.03	c      1376              2           1         1                -           0.0000          -
3271.02/3279.47	c      3279              3           2         1                -           0.0000          -
3588.85/3598.01	c      3598              3           2         0                -           0.0000          -
3588.95/3598.19	c SCIP Status        : c solving was interrupted [hard time limit reached]
3588.95/3598.19	c Total Time         : 3598.1900
3588.95/3598.19	c   solving          : 3598.1900
3588.95/3598.19	c   presolving       : 1.9403 (included in solving)
3588.95/3598.19	c B&B Tree           :
3588.95/3598.19	c   nodes (total)    : 1
3588.95/3598.19	c Solution           :
3588.95/3598.19	c   Solutions found  : 0
3588.95/3598.19	c   Primal Bound     :          -
3588.95/3598.19	c   Dual Bound       : +0.00000000000000e+00
3588.95/3598.19	c Gap                :          -
3589.24/3598.45	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (51041 MiB free)
  memory of node 1: 64473 MiB (61185 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464631-1722388242/watcher-4464631-1722388242 -o /tmp/evaluation-result-4464631-1722388242/solver-4464631-1722388242 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC003-1722378594-29039 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464631-1722388242.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=35156, runsolver pid=35153
Current StackSize limit: 8192 KiB


[startup+0.100105 s]*
/proc/loadavg: 4.06 4.14 4.15 5/252 35157
/proc/meminfo: memFree=114880948/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=63884 memory=52136 CPUtime=0.11 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 10892 0 0 0 8 3 0 0 20 0 1 0 5195586 65417216 13034 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 15971 13034 2347 3035 0 12367 0
Current children cumulated CPU time: 0.11 s
Current children cumulated vsize: 63884 KiB
Current children cumulated memory: 52136 KiB

[startup+0.213068 s]*
/proc/loadavg: 4.06 4.14 4.15 5/252 35157
/proc/meminfo: memFree=114858436/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=84912 memory=72072 CPUtime=0.21 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 16006 0 0 0 17 4 0 0 20 0 1 0 5195586 86949888 18018 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 21228 18018 2347 3035 0 17624 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 84912 KiB
Current children cumulated memory: 72072 KiB

[startup+0.31294 s]*
/proc/loadavg: 4.06 4.14 4.15 5/252 35157
/proc/meminfo: memFree=114805024/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=142656 memory=130868 CPUtime=0.31 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 30515 0 0 0 24 7 0 0 20 0 1 0 5195586 146079744 32717 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 35664 32717 2539 3035 0 32060 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 142656 KiB
Current children cumulated memory: 130868 KiB

[startup+0.700351 s]
/proc/loadavg: 4.06 4.14 4.15 5/252 35157
/proc/meminfo: memFree=114771760/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=209940 memory=190532 CPUtime=0.69 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 46554 0 0 0 57 12 0 0 20 0 1 0 5195586 214978560 47633 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 52485 47633 2678 3035 0 48881 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 209940 KiB
Current children cumulated memory: 190532 KiB

[startup+1.50032 s]
/proc/loadavg: 4.06 4.14 4.15 5/252 35157
/proc/meminfo: memFree=114689696/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=266328 memory=246440 CPUtime=1.49 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 67250 0 0 0 133 16 0 0 20 0 1 0 5195586 272719872 61610 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 66582 61610 2758 3035 0 62978 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 266328 KiB
Current children cumulated memory: 246440 KiB

[startup+3.11297 s]
/proc/loadavg: 4.06 4.14 4.15 5/254 35160
/proc/meminfo: memFree=114237584/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=913564 memory=725312 CPUtime=3.09 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 184687 0 0 0 269 40 0 0 20 0 3 0 5195586 935489536 181328 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 228391 181328 2790 3035 0 208505 0
[pid=35156/tid=35158] ppid=35153 vsize=913564 memory=598536 CPUtime=0.65 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 46496 0 0 0 53 12 0 0 20 0 3 0 5195821 935489536 181328 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=913564 memory=0 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 3 0 5195848 935489536 181328 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 913564 KiB
Current children cumulated memory: 725312 KiB

[startup+6.30036 s]
/proc/loadavg: 4.05 4.14 4.15 5/254 35160
/proc/meminfo: memFree=114056616/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=867412 CPUtime=6.26 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 251653 0 0 0 578 48 0 0 20 0 3 0 5195586 1069707264 216853 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 216853 2934 3035 0 244980 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=72959 CPUtime=3.83 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 113460 0 0 0 362 21 0 0 20 0 3 0 5195821 1069707264 216853 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=246440 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 2 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 216853 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 867412 KiB

[startup+12.7004 s]
/proc/loadavg: 4.05 4.13 4.15 5/254 35160
/proc/meminfo: memFree=114050872/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=869984 CPUtime=12.65 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 260908 0 0 0 1216 49 0 0 20 0 3 0 5195586 1069707264 217496 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217496 2934 3035 0 245688 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=72959 CPUtime=10.2 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 122701 0 0 0 999 21 0 0 20 0 3 0 5195821 1069707264 217496 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12132 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 16 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217496 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 869984 KiB

[startup+25.5004 s]
/proc/loadavg: 4.04 4.13 4.14 5/254 35163
/proc/meminfo: memFree=114042420/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=869988 CPUtime=25.41 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 273874 0 0 0 2492 49 0 0 20 0 3 0 5195586 1069707264 217497 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217497 2934 3035 0 245688 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=12132 CPUtime=22.97 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 135653 0 0 0 2275 22 0 0 20 0 3 0 5195821 1069707264 217497 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=869988 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 30 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217497 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 869988 KiB

[startup+51.113 s]
/proc/loadavg: 4.02 4.11 4.14 5/254 35166
/proc/meminfo: memFree=114025436/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=871204 CPUtime=50.95 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 286311 0 0 0 5045 50 0 0 20 0 3 0 5195586 1069707264 217801 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217801 3238 3035 0 245688 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=869988 CPUtime=48.51 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 148072 0 0 0 4828 23 0 0 20 0 3 0 5195821 1069707264 217801 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=869988 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 48 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217801 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 871204 KiB

[startup+102.3 s]
/proc/loadavg: 4.12 4.13 4.14 5/254 35175
/proc/meminfo: memFree=113987520/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=871224 CPUtime=101.99 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 302650 0 0 0 10148 51 0 0 20 0 3 0 5195586 1069707264 217806 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217806 3238 3035 0 245688 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=-5155632392599726981 CPUtime=99.56 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 164394 0 0 0 9932 24 0 0 20 0 3 0 5195821 1069707264 217806 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12132 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 65 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217806 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 101.99 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 871224 KiB

[startup+162.3 s]
/proc/loadavg: 4.08 4.11 4.13 5/254 35186
/proc/meminfo: memFree=113946780/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=871504 CPUtime=161.83 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 314517 0 0 0 16131 52 0 0 20 0 3 0 5195586 1069707264 217876 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217876 3238 3035 0 245778 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=871504 CPUtime=159.39 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 176247 0 0 0 15915 24 0 0 20 0 3 0 5195821 1069707264 217876 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12576 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 79 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217876 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 161.83 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 871504 KiB

[startup+222.3 s]
/proc/loadavg: 4.13 4.12 4.13 5/253 35197
/proc/meminfo: memFree=113902340/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=871852 CPUtime=221.67 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 320306 0 0 0 22115 52 0 0 20 0 3 0 5195586 1069707264 217963 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 217963 3238 3035 0 245868 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=871848 CPUtime=219.23 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 182025 0 0 0 21898 25 0 0 20 0 3 0 5195821 1069707264 217963 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=-5155632392599726981 CPUtime=0 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 90 0 0 0 0 0 0 0 20 0 3 0 5195848 1069707264 217963 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 221.67 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 871852 KiB

[startup+282.3 s]
/proc/loadavg: 4.57 4.23 4.17 5/250 35210
/proc/meminfo: memFree=113863076/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=871884 CPUtime=281.5 cores=5,7

################
# More data... #
################

[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3393.66 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487124 0 0 0 339291 75 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3391.16 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 348396 0 0 0 339073 43 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 521 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3393.66 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3462.3 s]
/proc/loadavg: 2.09 2.10 2.32 3/231 37067
/proc/meminfo: memFree=117567016/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3453.51 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487363 0 0 0 345276 75 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3451.02 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 348629 0 0 0 345058 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12132 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 527 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3453.51 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3522.3 s]
/proc/loadavg: 2.07 2.09 2.30 3/231 37078
/proc/meminfo: memFree=117566360/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3513.34 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487499 0 0 0 351258 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3510.84 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 348759 0 0 0 351040 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 533 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3513.34 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3582.3 s]
/proc/loadavg: 1.93 2.06 2.28 2/225 37124
/proc/meminfo: memFree=118408516/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3573.18 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487748 0 0 0 357242 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3570.68 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349000 0 0 0 357024 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12576 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 541 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3573.18 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3598.45 s]
# the end of solver process 35156 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3588.52 s, system=0.780646 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 1.93 2.06 2.28 2/225 37125
/proc/meminfo: memFree=118408500/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3574.88 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487748 0 0 0 357412 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=-7595157513168839547 CPUtime=3572.39 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349000 0 0 0 357195 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=4713751055816093346 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 541 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3574.88 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3590.4 s]
/proc/loadavg: 1.85 2.04 2.27 2/225 37125
/proc/meminfo: memFree=118408536/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3581.26 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487748 0 0 0 358050 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3578.76 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349000 0 0 0 357832 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 541 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3581.26 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3593.6 s]
/proc/loadavg: 1.79 2.02 2.26 2/225 37127
/proc/meminfo: memFree=118408540/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3584.45 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487857 0 0 0 358369 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3581.95 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349109 0 0 0 358151 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 541 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3584.45 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3596.8 s]
/proc/loadavg: 1.72 2.01 2.25 2/225 37127
/proc/meminfo: memFree=118408468/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3587.64 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487860 0 0 0 358688 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=900932 CPUtime=3585.15 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349110 0 0 0 358471 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 543 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3587.64 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3597.6 s]
/proc/loadavg: 1.72 2.01 2.25 2/225 37127
/proc/meminfo: memFree=118408476/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3588.44 cores=5,7
/proc/35156/stat : 35156 (fscip) S 35153 35156 29026 0 -1 1077936128 487860 0 0 0 358768 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=12576 CPUtime=3585.94 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349110 0 0 0 358550 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=12132 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 543 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3588.44 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3598 s]*
/proc/loadavg: 1.72 2.01 2.25 2/225 37127
/proc/meminfo: memFree=118408476/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1044636 memory=900932 CPUtime=3588.85 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 1077936128 487942 0 0 0 358809 76 0 0 20 0 3 0 5195586 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 261159 225233 3238 3035 0 246593 0
[pid=35156/tid=35158] ppid=35153 vsize=1044636 memory=-6370736859373474148 CPUtime=3586.35 cores=5,7
/proc/35156/task/35158/stat : 35158 (fscip) R 35153 35156 29026 0 -1 4194368 349193 0 0 0 358591 44 0 0 20 0 3 0 5195821 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
[pid=35156/tid=35160] ppid=35153 vsize=1044636 memory=4713751055816093346 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 543 0 0 0 1 4 0 0 20 0 3 0 5195848 1069707264 225233 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3588.85 s
Current children cumulated vsize: 1044636 KiB
Current children cumulated memory: 900932 KiB

[startup+3598.4 s]
/proc/loadavg: 1.72 2.01 2.25 2/225 37127
/proc/meminfo: memFree=118408476/131655788 swapFree=131071216/131071996
[pid=35156] ppid=35153 vsize=1002484 memory=840840 CPUtime=3589.24 cores=5,7
/proc/35156/stat : 35156 (fscip) R 35153 35156 29026 0 -1 4194304 492071 0 0 0 358847 77 0 0 20 0 2 0 5195586 1026543616 210210 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
/proc/35156/statm: 250621 210210 3286 3035 0 236055 0
[pid=35156/tid=35160] ppid=35153 vsize=1002484 memory=900932 CPUtime=0.05 cores=5,7
/proc/35156/task/35160/stat : 35160 (fscip) S 35153 35156 29026 0 -1 1077936192 543 0 0 0 1 4 0 0 20 0 2 0 5195848 1026543616 210210 134679101440 4194304 16623229 140726807548032 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 25079808 140726807553046 140726807553162 140726807553162 140726807560176 0
Current children cumulated CPU time: 3589.24 s
Current children cumulated vsize: 1002484 KiB
Current children cumulated memory: 840840 KiB

Child status: 0

Real time (s): 3598.45
CPU time (s): 3589.3
CPU user time (s): 3588.52
CPU system time (s): 0.780646
CPU usage (%): 99.7457
Max. virtual memory (cumulated for all children) (KiB): 1044636
Max. memory (cumulated for all children) (KiB): 900932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3588.52
system time used= 0.780646
maximum resident set size= 900932
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 494892
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3634
involuntary context switches= 4758


# summary of solver processes directly reported to runsolver:
#   pid: 35156
#   total CPU time (s): 3589.3
#   total CPU user time (s): 3588.52
#   total CPU system time (s): 0.780646

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 16.2492 second user time and 34.8868 second system time

The end

Launcher Data 

Begin job on nodeC003 at 2024-07-31 03:10:42
IDJOB=4464631
IDBENCH=165345
IDSOLVER=3092
FILE ID=nodeC003/4464631-1722388242
RUNJOBID= nodeC003-1722378594-29039
SLURM_JOB_ID= 8249833
Free space on /tmp= 723688 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP145.shuf-2.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464631-1722388242/watcher-4464631-1722388242 -o /tmp/evaluation-result-4464631-1722388242/solver-4464631-1722388242 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC003-1722378594-29039 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464631-1722388242.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 94622b8283878cd58e113c83df8c4b53
RANDOM SEED=624940052

nodeC003.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3654.608
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.597
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.348
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.192
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3666.194
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1258.173
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.224
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.177
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        114921332 kB
MemAvailable:   125779276 kB
Buffers:          102660 kB
Cached:         11574048 kB
SwapCached:           16 kB
Active:           286928 kB
Inactive:       15972576 kB
Active(anon):       1452 kB
Inactive(anon):  4602500 kB
Active(file):     285476 kB
Inactive(file): 11370076 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071216 kB
Dirty:             59588 kB
Writeback:             0 kB
AnonPages:       4582848 kB
Mapped:           125160 kB
Shmem:             21156 kB
KReclaimable:      85184 kB
Slab:             163808 kB
SReclaimable:      85184 kB
SUnreclaim:        78624 kB
KernelStack:        4048 kB
PageTables:        18352 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    3224836 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             7008 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2183168 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      295752 kB
DirectMap2M:    11143168 kB
DirectMap1G:    124780544 kB

Free space on /tmp at the end= 723752 MiB
End job on nodeC003 at 2024-07-31 04:10:40