Trace number 4464164

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
FiberSCIP 2024-07-30? 3587.18 3599.06

General information on the benchmark

NamePB24/normalized-PB10/OPT-LIN/oliveras/
j120opt/normalized-j12051_4.std.opb
MD5SUMce5fda4b250413a1cb40a57b098d0841
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark218
Best CPU time to get the best result obtained on this benchmark3600.14
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints256145
Number of constraints which are clauses254945
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint95
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.89/0.93	c Default LC presolving (default).
0.89/0.93	c ** Before presolving: virtualMemUsedAtLc = 759561716, getVmSize() = 492490752, SCIPgetMemUsed() = 433569279, SCIPgetMemTotal() = 449256495, SCIPgetMemExternEstim() = 310305221
0.89/0.93	c ** set memory limit for presolving in LC to 8.79587e+12 for SCIP **
18.24/18.37	c ** Estimated virtualMemUsedAtSolver = 697141856, getVmSize() = 813486080, SCIPgetMemUsed() = 493179828, SCIPgetMemTotal() = 735407564, SCIPgetMemExternEstim() = 310305221
18.24/18.37	c ** set memory limit for solvers to 4.39803e+12 for each SCIP **
18.24/18.37	c Original Problem   :
18.24/18.37	c   Problem name     : instance-4464164-1722382196
18.24/18.37	c   Variables        : 72842 (72842 binary, 0 integer, 0 implicit integer, 0 continuous)
18.24/18.37	c   Constraints      : 256145
18.24/18.37	c   Objective sense  : minimize
18.24/18.37	c Presolved Problem  :
18.24/18.37	c   Variables        : 53904 (53904 binary, 0 integer, 0 implicit integer, 0 continuous)
18.24/18.37	c   Constraints      : 127154
18.24/18.37	c Constraints        : Number
18.24/18.37	c   knapsack         : 1178 
18.24/18.37	c   setppc           : 102926 
18.24/18.37	c   and              : 23046 
18.24/18.37	c   logicor          : 4 
18.24/18.37	c ** Instance transfer method used: 0
18.54/18.61	c ** ParaScipInstance copy increased the number of variables. **
18.74/18.86	c LC is working with racing ramp-up and with rebuilding tree after racing.
18.74/18.86	c                                Nodes    Active                                            
18.74/18.86	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3586.13/3598.05	c      3598              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3586.62/3598.60	c SCIP Status        : c solving was interrupted [hard time limit reached]
3586.62/3598.60	c Total Time         : 3598.5900
3586.62/3598.60	c   solving          : 3598.5900
3586.62/3598.60	c   presolving       : 17.4358 (included in solving)
3586.62/3598.60	c B&B Tree           :
3586.62/3598.60	c   nodes (total)    : 1
3586.62/3598.60	c Solution           :
3586.62/3598.60	c   Solutions found  : 0
3586.62/3598.60	c   Primal Bound     :          -
3586.62/3598.60	c   Dual Bound       :          -
3586.62/3598.60	c Gap                :          -
3587.12/3599.04	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (57842 MiB free)
  memory of node 1: 64473 MiB (63200 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464164-1722382196/watcher-4464164-1722382196 -o /tmp/evaluation-result-4464164-1722382196/solver-4464164-1722382196 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC028-1722378597-28644 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464164-1722382196.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=30627, runsolver pid=30624
Current StackSize limit: 8192 KiB


[startup+0.100089 s]*
/proc/loadavg: 4.10 4.10 4.03 5/262 30628
/proc/meminfo: memFree=123882740/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=87376 memory=74656 CPUtime=0.1 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 16547 0 0 0 8 2 0 0 20 0 1 0 4824162 89473024 18664 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 21844 18664 2347 3035 0 18240 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 87376 KiB
Current children cumulated memory: 74656 KiB

[startup+0.20563 s]*
/proc/loadavg: 4.10 4.10 4.03 5/262 30628
/proc/meminfo: memFree=123847484/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=121984 memory=110420 CPUtime=0.2 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 25522 0 0 0 17 3 0 0 20 0 1 0 4824162 124911616 27605 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 30496 27605 2347 3035 0 26892 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 121984 KiB
Current children cumulated memory: 110420 KiB

[startup+0.305572 s]*
/proc/loadavg: 4.10 4.10 4.03 5/262 30628
/proc/meminfo: memFree=123811620/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=161820 memory=150288 CPUtime=0.3 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 35477 0 0 0 26 4 0 0 20 0 1 0 4824162 165703680 37572 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 40455 37572 2347 3035 0 36851 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 161820 KiB
Current children cumulated memory: 150288 KiB

[startup+0.700213 s]
/proc/loadavg: 4.10 4.10 4.03 4/261 30628
/proc/meminfo: memFree=123714552/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=378344 memory=367320 CPUtime=0.68 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 90305 0 0 0 56 12 0 0 20 0 1 0 4824162 387424256 91830 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 94586 91830 2555 3035 0 90982 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 378344 KiB
Current children cumulated memory: 367320 KiB

[startup+1.50022 s]
/proc/loadavg: 4.10 4.10 4.03 5/265 30661
/proc/meminfo: memFree=123448012/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=524732 memory=509828 CPUtime=1.48 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 125335 0 0 0 130 18 0 0 20 0 1 0 4824162 537325568 127457 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 131183 127457 2630 3035 0 127579 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 524732 KiB
Current children cumulated memory: 509828 KiB

[startup+3.10585 s]
/proc/loadavg: 4.10 4.10 4.03 5/265 30661
/proc/meminfo: memFree=123342704/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=656368 memory=639376 CPUtime=3.09 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 144240 0 0 0 285 24 0 0 20 0 1 0 4824162 672120832 159844 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 164092 159844 2694 3035 0 160488 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 656368 KiB
Current children cumulated memory: 639376 KiB

[startup+6.30022 s]
/proc/loadavg: 4.09 4.10 4.03 5/261 30771
/proc/meminfo: memFree=128108976/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=656368 memory=639376 CPUtime=6.27 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 144276 0 0 0 603 24 0 0 20 0 1 0 4824162 672120832 159844 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 164092 159844 2694 3035 0 160488 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 656368 KiB
Current children cumulated memory: 639376 KiB

[startup+12.7002 s]
/proc/loadavg: 4.08 4.10 4.03 5/263 30804
/proc/meminfo: memFree=127694448/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=656368 memory=639628 CPUtime=12.66 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 144316 0 0 0 1241 25 0 0 20 0 1 0 4824162 672120832 159907 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 164092 159907 2726 3035 0 160488 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 656368 KiB
Current children cumulated memory: 639628 KiB

[startup+25.5008 s]
/proc/loadavg: 4.14 4.11 4.03 5/267 30810
/proc/meminfo: memFree=125573984/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1463084 memory=1290860 CPUtime=25.38 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 373875 0 0 0 2478 60 0 0 20 0 3 0 4824162 1498198016 322715 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 365771 322715 2806 3035 0 347308 0
[pid=30627/tid=30807] ppid=30624 vsize=1463084 memory=1290860 CPUtime=6.81 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 159761 0 0 0 659 22 0 0 20 0 3 0 4826000 1498198016 322715 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1463084 memory=11592 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 3 0 0 0 0 0 0 0 20 0 3 0 4826049 1498198016 322715 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 25.38 s
Current children cumulated vsize: 1463084 KiB
Current children cumulated memory: 1290860 KiB

[startup+51.1056 s]
/proc/loadavg: 4.09 4.10 4.03 5/267 30870
/proc/meminfo: memFree=125503416/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1463084 memory=1292828 CPUtime=50.9 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 508225 0 0 0 5021 69 0 0 20 0 3 0 4824162 1498198016 323207 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 365771 323207 2806 3035 0 347820 0
[pid=30627/tid=30807] ppid=30624 vsize=1463084 memory=1292828 CPUtime=32.33 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 294090 0 0 0 3202 31 0 0 20 0 3 0 4826000 1498198016 323207 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1463084 memory=12828 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 24 0 0 0 0 0 0 0 20 0 3 0 4826049 1498198016 323207 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 50.9 s
Current children cumulated vsize: 1463084 KiB
Current children cumulated memory: 1292828 KiB

[startup+102.3 s]
/proc/loadavg: 4.08 4.10 4.03 5/266 30928
/proc/meminfo: memFree=125053716/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1672620 memory=1544640 CPUtime=101.95 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 660306 0 0 0 10110 85 0 0 20 0 3 0 4824162 1712762880 386160 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 418155 386160 2950 3035 0 412130 0
[pid=30627/tid=30807] ppid=30624 vsize=1672620 memory=1544632 CPUtime=83.38 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 446149 0 0 0 8291 47 0 0 20 0 3 0 4826000 1712762880 386160 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1672620 memory=11592 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 46 0 0 0 0 0 0 0 20 0 3 0 4826049 1712762880 386160 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 101.95 s
Current children cumulated vsize: 1672620 KiB
Current children cumulated memory: 1544640 KiB

[startup+162.3 s]
/proc/loadavg: 4.13 4.11 4.03 5/265 30938
/proc/meminfo: memFree=124981148/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1673040 memory=1544784 CPUtime=161.74 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 679676 0 0 0 16086 88 0 0 20 0 3 0 4824162 1713192960 386196 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 418260 386196 2950 3035 0 412235 0
[pid=30627/tid=30807] ppid=30624 vsize=1673040 memory=1544776 CPUtime=143.16 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 465505 0 0 0 14267 49 0 0 20 0 3 0 4826000 1713192960 386196 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1673040 memory=54472 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 60 0 0 0 0 0 0 0 20 0 3 0 4826049 1713192960 386196 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 161.74 s
Current children cumulated vsize: 1673040 KiB
Current children cumulated memory: 1544784 KiB

[startup+222.3 s]
/proc/loadavg: 4.09 4.10 4.03 5/265 30948
/proc/meminfo: memFree=124973856/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1678620 memory=1548344 CPUtime=221.52 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 698023 0 0 0 22061 91 0 0 20 0 3 0 4824162 1718906880 387086 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 419655 387086 2950 3035 0 413630 0
[pid=30627/tid=30807] ppid=30624 vsize=1678620 memory=1548264 CPUtime=202.95 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 483842 0 0 0 20243 52 0 0 20 0 3 0 4826000 1718906880 387086 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1678620 memory=12828 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 70 0 0 0 0 0 0 0 20 0 3 0 4826049 1718906880 387086 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 221.52 s
Current children cumulated vsize: 1678620 KiB
Current children cumulated memory: 1548344 KiB

[startup+282.3 s]
/proc/loadavg: 4.15 4.11 4.04 5/263 30960
/proc/meminfo: memFree=124971616/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1678620 memory=1548432 CPUtime=281.31 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 716593 0 0 0 28038 93 0 0 20 0 3 0 4824162 1718906880 387108 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 419655 387108 2950 3035 0 413630 0
[pid=30627/tid=30807] ppid=30624 vsize=1678620 memory=11592 CPUtime=262.74 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 502404 0 0 0 26220 54 0 0 20 0 3 0 4826000 1718906880 387108 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1678620 memory=1548392 CPUtime=0 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 78 0 0 0 0 0 0 0 20 0 3 0 4826049 1718906880 387108 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 281.31 s
Current children cumulated vsize: 1678620 KiB
Current children cumulated memory: 1548432 KiB

[startup+342.3 s]
/proc/loadavg: 4.12 4.10 4.04 5/264 30971

################
# More data... #
################

/proc/loadavg: 4.10 4.10 4.09 5/265 32504
/proc/meminfo: memFree=124014444/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3390.92 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1337676 0 0 0 338927 165 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=12936 CPUtime=3372.31 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1122952 0 0 0 337108 123 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=1577264 CPUtime=0.03 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 613 0 0 0 1 2 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3390.92 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3462.3 s]
/proc/loadavg: 4.15 4.11 4.09 5/265 32515
/proc/meminfo: memFree=124007464/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3450.77 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1340069 0 0 0 344911 166 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=12936 CPUtime=3432.16 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1125331 0 0 0 343093 123 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=1577264 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 627 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3450.77 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3522.3 s]
/proc/loadavg: 4.16 4.12 4.09 5/265 32525
/proc/meminfo: memFree=123996272/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3510.62 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1342310 0 0 0 350896 166 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=12520 CPUtime=3492 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1127561 0 0 0 349077 123 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=12936 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 638 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3510.62 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3582.3 s]
/proc/loadavg: 4.11 4.11 4.09 5/267 32707
/proc/meminfo: memFree=123985052/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3570.47 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1343508 0 0 0 356880 167 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3551.86 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1128746 0 0 0 355062 124 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=1577304 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 651 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3570.47 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3599.06 s]
# the end of solver process 30627 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3585.43 s, system=1.75584 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.10 4.11 4.09 5/267 32707
/proc/meminfo: memFree=123985052/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3572.17 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1343508 0 0 0 357050 167 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=2104 CPUtime=3553.56 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1128746 0 0 0 355232 124 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=7078607063656472084 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 651 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3572.17 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3590.4 s]
/proc/loadavg: 4.09 4.11 4.09 5/267 32708
/proc/meminfo: memFree=123982836/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3578.55 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1343744 0 0 0 357688 167 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=12520 CPUtime=3559.94 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1128981 0 0 0 355870 124 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=5488 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 652 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3578.55 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3593.6 s]
/proc/loadavg: 4.09 4.11 4.09 5/267 32708
/proc/meminfo: memFree=123982832/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3581.74 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1343760 0 0 0 358007 167 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3563.13 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1128997 0 0 0 356189 124 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=12520 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 652 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3581.74 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3596.8 s]
/proc/loadavg: 4.16 4.12 4.09 5/267 32708
/proc/meminfo: memFree=123982840/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3584.93 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1343762 0 0 0 358326 167 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3566.32 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1128999 0 0 0 356508 124 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=1577304 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 652 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3584.93 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3598.4 s]
/proc/loadavg: 4.16 4.12 4.09 5/267 32708
/proc/meminfo: memFree=123982812/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1689916 memory=1577304 CPUtime=3586.53 cores=5,7
/proc/30627/stat : 30627 (fscip) S 30624 30627 28631 0 -1 1077936128 1374625 0 0 0 358485 168 0 0 20 0 3 0 4824162 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 422479 394326 2950 3035 0 416454 0
[pid=30627/tid=30807] ppid=30624 vsize=1689916 memory=11592 CPUtime=3567.91 cores=5,7
/proc/30627/task/30807/stat : 30807 (fscip) R 30624 30627 28631 0 -1 4194368 1159862 0 0 0 356666 125 0 0 20 0 3 0 4826000 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
[pid=30627/tid=30808] ppid=30624 vsize=1689916 memory=12936 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 655 0 0 0 1 3 0 0 20 0 3 0 4826049 1730473984 394326 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3586.53 s
Current children cumulated vsize: 1689916 KiB
Current children cumulated memory: 1577304 KiB

[startup+3598.8 s]
/proc/loadavg: 4.16 4.12 4.09 5/267 32708
/proc/meminfo: memFree=123982812/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1687724 memory=1537036 CPUtime=3586.93 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 1431237 0 0 0 358522 171 0 0 20 0 2 0 4824162 1728229376 384259 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 421931 384259 2998 3035 0 415906 0
[pid=30627/tid=30808] ppid=30624 vsize=1687724 memory=1577304 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 655 0 0 0 1 3 0 0 20 0 2 0 4826049 1728229376 384259 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3586.93 s
Current children cumulated vsize: 1687724 KiB
Current children cumulated memory: 1537036 KiB

[startup+3599 s]*
/proc/loadavg: 4.15 4.12 4.09 5/263 32724
/proc/meminfo: memFree=124167876/131524600 swapFree=131071996/131071996
[pid=30627] ppid=30624 vsize=1599412 memory=1448724 CPUtime=3587.12 cores=5,7
/proc/30627/stat : 30627 (fscip) R 30624 30627 28631 0 -1 4194304 1457116 0 0 0 358539 173 0 0 20 0 2 0 4824162 1637797888 362181 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
/proc/30627/statm: 399853 362181 2998 3035 0 393828 0
[pid=30627/tid=30808] ppid=30624 vsize=1599412 memory=-7668368413833854329 CPUtime=0.04 cores=5,7
/proc/30627/task/30808/stat : 30808 (fscip) S 30624 30627 28631 0 -1 1077936192 655 0 0 0 1 3 0 0 20 0 2 0 4826049 1637797888 362181 134679101440 4194304 16623229 140732180587872 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18838560 18947056 53338112 140732180595734 140732180595850 140732180595850 140732180602864 0
Current children cumulated CPU time: 3587.12 s
Current children cumulated vsize: 1599412 KiB
Current children cumulated memory: 1448724 KiB

Child status: 0

Real time (s): 3599.06
CPU time (s): 3587.18
CPU user time (s): 3585.43
CPU system time (s): 1.75584
CPU usage (%): 99.6701
Max. virtual memory (cumulated for all children) (KiB): 1752020
Max. memory (cumulated for all children) (KiB): 1577304

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3585.43
system time used= 1.75584
maximum resident set size= 1579352
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1469185
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3621
involuntary context switches= 4339


# summary of solver processes directly reported to runsolver:
#   pid: 30627
#   total CPU time (s): 3587.18
#   total CPU user time (s): 3585.43
#   total CPU system time (s): 1.75584

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.17631 second user time and 16.8585 second system time

The end

Launcher Data 

Begin job on nodeC028 at 2024-07-31 01:29:57
IDJOB=4464164
IDBENCH=149353
IDSOLVER=3092
FILE ID=nodeC028/4464164-1722382196
RUNJOBID= nodeC028-1722378597-28644
SLURM_JOB_ID= 8249851
Free space on /tmp= 889936 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB10/OPT-LIN/oliveras/j120opt/normalized-j12051_4.std.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464164-1722382196/watcher-4464164-1722382196 -o /tmp/evaluation-result-4464164-1722382196/solver-4464164-1722382196 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC028-1722378597-28644 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464164-1722382196.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= ce5fda4b250413a1cb40a57b098d0841
RANDOM SEED=881201410

nodeC028.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.966
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3679.015
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.079
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.489
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.948
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.759
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.159
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.471
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        123947680 kB
MemAvailable:   124831948 kB
Buffers:           88856 kB
Cached:          1619844 kB
SwapCached:            0 kB
Active:           321512 kB
Inactive:        6741156 kB
Active(anon):       1556 kB
Inactive(anon):  5374064 kB
Active(file):     319956 kB
Inactive(file):  1367092 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             36824 kB
Writeback:            48 kB
AnonPages:       5350300 kB
Mapped:           114508 kB
Shmem:             21336 kB
KReclaimable:      74088 kB
Slab:             160252 kB
SReclaimable:      74088 kB
SUnreclaim:        86164 kB
KernelStack:        4160 kB
PageTables:        19412 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    3164092 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9728 kB
HardwareCorrupted:     0 kB
AnonHugePages:   3878912 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      207572 kB
DirectMap2M:     6905856 kB
DirectMap1G:    128974848 kB

Free space on /tmp at the end= 889952 MiB
End job on nodeC028 at 2024-07-31 02:29:56