Trace number 4464692

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3583.13 3599.1

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/
dec/miplib2003/normalized-stp3d.0.s.opb
MD5SUM3669957ef10a08034abaee305bfecedd
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables204880
Total number of constraints159489
Number of constraints which are clauses129232
Number of constraints which are cardinality constraints (but not clauses)5805
Number of constraints which are nor clauses,nor cardinality constraints24452
Minimum length of a constraint2
Maximum length of a constraint75648
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3258328
Number of bits of the biggest number in a constraint 22
Biggest sum of numbers in a constraint 503258152
Number of bits of the biggest sum of numbers29
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
1.09/1.18	c Default LC presolving (default).
1.09/1.18	c ** Before presolving: virtualMemUsedAtLc = 969836496, getVmSize() = 678969344, SCIPgetMemUsed() = 630135842, SCIPgetMemTotal() = 637336602, SCIPgetMemExternEstim() = 332499894
1.09/1.18	c ** set memory limit for presolving in LC to 8.7958e+12 for SCIP **
5.87/5.96	c ** Estimated virtualMemUsedAtSolver = 886943778, getVmSize() = 1165000704, SCIPgetMemUsed() = 784447158, SCIPgetMemTotal() = 997915774, SCIPgetMemExternEstim() = 332499894
5.87/5.96	c ** set memory limit for solvers to 4.39802e+12 for each SCIP **
5.87/5.96	c Original Problem   :
5.87/5.96	c   Problem name     : instance-4464692-1722387193
5.87/5.96	c   Variables        : 204880 (204880 binary, 0 integer, 0 implicit integer, 0 continuous)
5.87/5.96	c   Constraints      : 159489
5.87/5.96	c   Objective sense  : minimize
5.87/5.96	c Presolved Problem  :
5.87/5.96	c   Variables        : 136907 (136907 binary, 0 integer, 0 implicit integer, 0 continuous)
5.87/5.96	c   Constraints      : 97473
5.87/5.96	c Constraints        : Number
5.87/5.96	c   knapsack         : 2 
5.87/5.96	c   setppc           : 73321 
5.87/5.96	c   linear           : 24150 
5.87/5.96	c ** Instance transfer method used: 0
6.27/6.34	c ** ParaScipInstance copy does not increase the number of variables. **
6.57/6.67	c LC is working with racing ramp-up and with rebuilding tree after racing.
6.57/6.67	c                                Nodes    Active                                            
6.57/6.67	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3582.02/3598.00	c      3598              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3582.62/3598.60	c SCIP Status        : c solving was interrupted [hard time limit reached]
3582.62/3598.60	c Total Time         : 3598.6000
3582.62/3598.60	c   solving          : 3598.6000
3582.62/3598.60	c   presolving       : 4.7799 (included in solving)
3582.62/3598.60	c B&B Tree           :
3582.62/3598.60	c   nodes (total)    : 1
3582.62/3598.60	c Solution           :
3582.62/3598.60	c   Solutions found  : 0
3582.62/3598.60	c   Primal Bound     :          -
3582.62/3598.60	c   Dual Bound       :          -
3582.62/3598.60	c Gap                :          -
3583.02/3599.09	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61844 MiB free)
  memory of node 1: 64510 MiB (58880 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464692-1722387193/watcher-4464692-1722387193 -o /tmp/evaluation-result-4464692-1722387193/solver-4464692-1722387193 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC031-1722378597-29423 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464692-1722387193.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=35311, runsolver pid=35308
Current StackSize limit: 8192 KiB


[startup+0.100092 s]*
/proc/loadavg: 4.10 4.16 4.12 5/263 35312
/proc/meminfo: memFree=123529124/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=118468 memory=103304 CPUtime=0.09 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 23767 0 0 0 6 3 0 0 20 0 1 0 5321018 121311232 25826 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 29617 25826 2347 3035 0 26013 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 118468 KiB
Current children cumulated memory: 103304 KiB

[startup+0.205549 s]*
/proc/loadavg: 4.10 4.16 4.12 5/263 35312
/proc/meminfo: memFree=123480900/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=167820 memory=152884 CPUtime=0.2 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 36127 0 0 0 15 5 0 0 20 0 1 0 5321018 171847680 38221 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 41955 38221 2347 3035 0 38351 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 167820 KiB
Current children cumulated memory: 152884 KiB

[startup+0.305509 s]*
/proc/loadavg: 4.10 4.16 4.12 5/263 35312
/proc/meminfo: memFree=123430368/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=219208 memory=204156 CPUtime=0.3 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 48935 0 0 0 23 7 0 0 20 0 1 0 5321018 224468992 51039 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 54802 51039 2347 3035 0 51198 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 219208 KiB
Current children cumulated memory: 204156 KiB

[startup+0.700212 s]
/proc/loadavg: 4.09 4.16 4.11 5/263 35312
/proc/meminfo: memFree=123337388/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=428100 memory=415984 CPUtime=0.68 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 105329 0 0 0 53 15 0 0 20 0 1 0 5321018 438374400 103996 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 107025 103996 2539 3035 0 103421 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 428100 KiB
Current children cumulated memory: 415984 KiB

[startup+1.50022 s]
/proc/loadavg: 4.09 4.16 4.11 5/263 35312
/proc/meminfo: memFree=123041984/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=712312 memory=691340 CPUtime=1.48 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 174176 0 0 0 124 24 0 0 20 0 1 0 5321018 729407488 172835 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 178078 172835 2614 3035 0 174474 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 712312 KiB
Current children cumulated memory: 691340 KiB

[startup+3.10541 s]
/proc/loadavg: 4.09 4.16 4.11 5/263 35314
/proc/meminfo: memFree=122859592/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=793408 memory=767476 CPUtime=3.08 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 199506 0 0 0 277 31 0 0 20 0 1 0 5321018 812449792 191869 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 198352 191869 2726 3035 0 194748 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 793408 KiB
Current children cumulated memory: 767476 KiB

[startup+6.30021 s]
/proc/loadavg: 4.17 4.17 4.12 5/264 35315
/proc/meminfo: memFree=122599688/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=1294036 memory=1122708 CPUtime=6.27 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 266360 0 0 0 585 42 0 0 20 0 2 0 5321018 1325092864 280677 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 323509 280677 2790 3035 0 303553 0
[pid=35311/tid=35315] ppid=35308 vsize=1294036 memory=7740107011321522540 CPUtime=0 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) S 35308 35311 29413 0 -1 1077936192 1 0 0 0 0 0 0 0 20 0 2 0 5321614 1325092864 280677 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 1294036 KiB
Current children cumulated memory: 1122708 KiB

[startup+12.7008 s]
/proc/loadavg: 4.23 4.18 4.12 5/265 35316
/proc/meminfo: memFree=121901392/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=1902500 memory=1723704 CPUtime=12.61 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 451284 0 0 0 1195 66 0 0 20 0 3 0 5321018 1948160000 430926 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 475625 430926 2806 3035 0 462606 0
[pid=35311/tid=35315] ppid=35308 vsize=1902500 memory=11480 CPUtime=6.29 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 184918 0 0 0 606 23 0 0 20 0 3 0 5321614 1948160000 430926 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=1902500 memory=0 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 4 0 0 0 0 0 0 0 20 0 3 0 5321686 1948160000 430926 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 12.61 s
Current children cumulated vsize: 1902500 KiB
Current children cumulated memory: 1723704 KiB

[startup+25.5008 s]
/proc/loadavg: 4.20 4.18 4.12 5/265 35319
/proc/meminfo: memFree=121866280/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=1968036 memory=1747772 CPUtime=25.29 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 539128 0 0 0 2456 73 0 0 20 0 3 0 5321018 2015268864 436943 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 492009 436943 2806 3035 0 468628 0
[pid=35311/tid=35315] ppid=35308 vsize=1968036 memory=11480 CPUtime=18.97 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 272754 0 0 0 1867 30 0 0 20 0 3 0 5321614 2015268864 436943 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=1968036 memory=1745540 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 12 0 0 0 0 0 0 0 20 0 3 0 5321686 2015268864 436943 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 25.29 s
Current children cumulated vsize: 1968036 KiB
Current children cumulated memory: 1747772 KiB

[startup+51.1058 s]
/proc/loadavg: 4.12 4.16 4.12 5/265 35322
/proc/meminfo: memFree=121825720/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=1968036 memory=1772936 CPUtime=50.65 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 720534 0 0 0 4980 85 0 0 20 0 3 0 5321018 2015268864 443234 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 492009 443234 2806 3035 0 474682 0
[pid=35311/tid=35315] ppid=35308 vsize=1968036 memory=1770592 CPUtime=44.32 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 454145 0 0 0 4390 42 0 0 20 0 3 0 5321614 2015268864 443234 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=1968036 memory=1764884 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 27 0 0 0 0 0 0 0 20 0 3 0 5321686 2015268864 443234 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 50.65 s
Current children cumulated vsize: 1968036 KiB
Current children cumulated memory: 1772936 KiB

[startup+102.301 s]
/proc/loadavg: 4.09 4.15 4.11 5/265 35331
/proc/meminfo: memFree=121489512/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2295716 memory=2079872 CPUtime=101.37 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 880944 0 0 0 10029 108 0 0 20 0 3 0 5321018 2350813184 519968 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 573929 519968 2950 3035 0 553844 0
[pid=35311/tid=35315] ppid=35308 vsize=2295716 memory=2077844 CPUtime=95.04 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 614537 0 0 0 9439 65 0 0 20 0 3 0 5321614 2350813184 519968 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2295716 memory=11480 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 45 0 0 0 0 0 0 0 20 0 3 0 5321686 2350813184 519968 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 101.37 s
Current children cumulated vsize: 2295716 KiB
Current children cumulated memory: 2079872 KiB

[startup+162.301 s]
/proc/loadavg: 4.13 4.15 4.11 5/263 35727
/proc/meminfo: memFree=121555304/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2295716 memory=2084120 CPUtime=160.8 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 907507 0 0 0 15970 110 0 0 20 0 3 0 5321018 2350813184 521030 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 573929 521030 2950 3035 0 554716 0
[pid=35311/tid=35315] ppid=35308 vsize=2295716 memory=11480 CPUtime=154.48 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 641086 0 0 0 15380 68 0 0 20 0 3 0 5321614 2350813184 521030 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2295716 memory=2084064 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 59 0 0 0 0 0 0 0 20 0 3 0 5321686 2350813184 521030 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 160.8 s
Current children cumulated vsize: 2295716 KiB
Current children cumulated memory: 2084120 KiB

[startup+222.301 s]
/proc/loadavg: 4.16 4.15 4.11 5/263 35738
/proc/meminfo: memFree=121520772/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2295716 memory=2084420 CPUtime=220.23 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 923245 0 0 0 21912 111 0 0 20 0 3 0 5321018 2350813184 521105 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 573929 521105 2950 3035 0 554759 0
[pid=35311/tid=35315] ppid=35308 vsize=2295716 memory=2084292 CPUtime=213.9 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 656813 0 0 0 21322 68 0 0 20 0 3 0 5321614 2350813184 521105 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2295716 memory=2084364 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 70 0 0 0 0 0 0 0 20 0 3 0 5321686 2350813184 521105 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 220.23 s
Current children cumulated vsize: 2295716 KiB
Current children cumulated memory: 2084420 KiB

[startup+282.301 s]
/proc/loadavg: 4.16 4.15 4.11 5/263 35749
/proc/meminfo: memFree=121440060/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2295716 memory=2097096 CPUtime=279.66 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 949861 0 0 0 27853 113 0 0 20 0 3 0 5321018 2350813184 524274 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 573929 524274 2950 3035 0 556574 0
[pid=35311/tid=35315] ppid=35308 vsize=2295716 memory=2089716 CPUtime=273.35 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 683419 0 0 0 27264 71 0 0 20 0 3 0 5321614 2350813184 524274 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2295716 memory=11480 CPUtime=0 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 80 0 0 0 0 0 0 0 20 0 3 0 5321686 2350813184 524274 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0

################
# More data... #
################

/proc/loadavg: 1.08 1.17 1.93 2/235 37243
/proc/meminfo: memFree=123606144/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3386.84 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1224107 0 0 0 338533 151 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3380.48 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 957032 0 0 0 337943 105 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 713 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3386.84 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3462.3 s]
/proc/loadavg: 1.13 1.17 1.88 2/237 37259
/proc/meminfo: memFree=123605452/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3446.64 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1224420 0 0 0 344512 152 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3440.29 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 957332 0 0 0 343922 107 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=11480 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 726 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3446.64 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3522.3 s]
/proc/loadavg: 1.10 1.15 1.82 2/237 37270
/proc/meminfo: memFree=123604764/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3506.49 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228524 0 0 0 350496 153 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3500.13 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961428 0 0 0 349905 108 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 734 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3506.49 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3582.3 s]
/proc/loadavg: 1.08 1.14 1.78 2/237 37281
/proc/meminfo: memFree=123603900/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3566.36 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228896 0 0 0 356483 153 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=11480 CPUtime=3560.01 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961793 0 0 0 355893 108 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 741 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3566.36 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3599.1 s]
# the end of solver process 35311 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3581.55 s, system=1.57792 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 1.08 1.14 1.78 2/237 37282
/proc/meminfo: memFree=123603836/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3568.07 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228901 0 0 0 356653 154 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=-5155626916482870149 CPUtime=3561.71 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961798 0 0 0 356063 108 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=-7233808450367945412 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 741 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3568.07 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3590.4 s]
/proc/loadavg: 1.07 1.13 1.77 2/237 37282
/proc/meminfo: memFree=123603844/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3574.44 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228925 0 0 0 357290 154 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3568.08 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961819 0 0 0 356700 108 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 744 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3574.44 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3593.6 s]
/proc/loadavg: 1.06 1.13 1.77 2/237 37284
/proc/meminfo: memFree=123603760/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3577.63 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228937 0 0 0 357609 154 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3571.28 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961831 0 0 0 357019 109 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 744 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3577.63 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3596.8 s]
/proc/loadavg: 1.06 1.13 1.77 2/237 37284
/proc/meminfo: memFree=123603760/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3580.82 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1228947 0 0 0 357928 154 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=13616 CPUtime=3574.47 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 961838 0 0 0 357338 109 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=2226996 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 747 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3580.82 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3598.4 s]
/proc/loadavg: 1.06 1.13 1.76 2/237 37284
/proc/meminfo: memFree=123603760/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2361252 memory=2226996 CPUtime=3582.43 cores=0,2
/proc/35311/stat : 35311 (fscip) S 35308 35311 29413 0 -1 1077936128 1232169 0 0 0 358088 155 0 0 20 0 3 0 5321018 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 590313 556749 2982 3035 0 581358 0
[pid=35311/tid=35315] ppid=35308 vsize=2361252 memory=16136 CPUtime=3576.06 cores=0,2
/proc/35311/task/35315/stat : 35315 (fscip) R 35308 35311 29413 0 -1 4194368 965038 0 0 0 357497 109 0 0 20 0 3 0 5321614 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
[pid=35311/tid=35316] ppid=35308 vsize=2361252 memory=12960 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 747 0 0 0 1 2 0 0 20 0 3 0 5321686 2417922048 556749 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3582.43 s
Current children cumulated vsize: 2361252 KiB
Current children cumulated memory: 2226996 KiB

[startup+3598.8 s]
/proc/loadavg: 1.06 1.13 1.76 2/237 37284
/proc/meminfo: memFree=123603760/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2191316 memory=2031248 CPUtime=3582.82 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 1240948 0 0 0 358127 155 0 0 20 0 2 0 5321018 2243907584 507812 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 547829 507812 3030 3035 0 539242 0
[pid=35311/tid=35316] ppid=35308 vsize=2191316 memory=25988 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 747 0 0 0 1 2 0 0 20 0 2 0 5321686 2243907584 507812 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3582.82 s
Current children cumulated vsize: 2191316 KiB
Current children cumulated memory: 2031248 KiB

[startup+3599 s]*
/proc/loadavg: 1.06 1.13 1.76 2/236 37284
/proc/meminfo: memFree=123816196/131524600 swapFree=131071996/131071996
[pid=35311] ppid=35308 vsize=2160560 memory=2000940 CPUtime=3583.02 cores=0,2
/proc/35311/stat : 35311 (fscip) R 35308 35311 29413 0 -1 4194304 1242895 0 0 0 358147 155 0 0 20 0 2 0 5321018 2212413440 500235 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
/proc/35311/statm: 540140 500235 3030 3035 0 531553 0
[pid=35311/tid=35316] ppid=35308 vsize=2160560 memory=-6730461879609692511 CPUtime=0.03 cores=0,2
/proc/35311/task/35316/stat : 35316 (fscip) S 35308 35311 29413 0 -1 1077936192 747 0 0 0 1 2 0 0 20 0 2 0 5321686 2212413440 500235 134679101440 4194304 16623229 140720596558992 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 31645696 140720596567062 140720596567178 140720596567178 140720596574192 0
Current children cumulated CPU time: 3583.02 s
Current children cumulated vsize: 2160560 KiB
Current children cumulated memory: 2000940 KiB

Child status: 0

Real time (s): 3599.1
CPU time (s): 3583.13
CPU user time (s): 3581.55
CPU system time (s): 1.57792
CPU usage (%): 99.5562
Max. virtual memory (cumulated for all children) (KiB): 2426788
Max. memory (cumulated for all children) (KiB): 2226996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3581.55
system time used= 1.57792
maximum resident set size= 2229044
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1251375
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3633
involuntary context switches= 28903


# summary of solver processes directly reported to runsolver:
#   pid: 35311
#   total CPU time (s): 3583.13
#   total CPU user time (s): 3581.55
#   total CPU system time (s): 1.57792

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.90885 second user time and 15.5592 second system time

The end

Launcher Data 

Begin job on nodeC031 at 2024-07-31 02:53:13
IDJOB=4464692
IDBENCH=163951
IDSOLVER=3092
FILE ID=nodeC031/4464692-1722387193
RUNJOBID= nodeC031-1722378597-29423
SLURM_JOB_ID= 8249854
Free space on /tmp= 889992 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/miplib2003/normalized-stp3d.0.s.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464692-1722387193/watcher-4464692-1722387193 -o /tmp/evaluation-result-4464692-1722387193/solver-4464692-1722387193 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC031-1722378597-29423 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464692-1722387193.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 3669957ef10a08034abaee305bfecedd
RANDOM SEED=1588443281

nodeC031.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3659.453
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.348
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3666.540
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.409
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.113
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3684.362
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3605.064
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.230
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        123623300 kB
MemAvailable:   127764360 kB
Buffers:          102956 kB
Cached:          4866928 kB
SwapCached:            0 kB
Active:           271044 kB
Inactive:        7140080 kB
Active(anon):       1556 kB
Inactive(anon):  2461020 kB
Active(file):     269488 kB
Inactive(file):  4679060 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             37004 kB
Writeback:             4 kB
AnonPages:       2439572 kB
Mapped:           124380 kB
Shmem:             21336 kB
KReclaimable:      64320 kB
Slab:             145696 kB
SReclaimable:      64320 kB
SUnreclaim:        81376 kB
KernelStack:        4224 kB
PageTables:        14020 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1151908 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9440 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1515520 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      236244 kB
DirectMap2M:     8974336 kB
DirectMap1G:    126877696 kB

Free space on /tmp at the end= 890048 MiB
End job on nodeC031 at 2024-07-31 03:53:12