Trace number 4445780

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3589.93 3600.38

General information on the benchmark

NamePB24/normalized-PB10/DEC-LIN/oliveras/
j120/normalized-j12011_1-unsat.opb
MD5SUMcdcb4d035b8e87f1109f75a28aea48eb
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables37510
Total number of constraints119740
Number of constraints which are clauses119124
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints616
Minimum length of a constraint1
Maximum length of a constraint95
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 19
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 556
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.40/0.46	c Default LC presolving (default).
0.40/0.46	c ** Before presolving: virtualMemUsedAtLc = 370965812, getVmSize() = 254644224, SCIPgetMemUsed() = 211719251, SCIPgetMemTotal() = 222933211, SCIPgetMemExternEstim() = 148032601
0.40/0.46	c ** set memory limit for presolving in LC to 8.79598e+12 for SCIP **
37.28/37.47	c ** Estimated virtualMemUsedAtSolver = 335263712, getVmSize() = 399585280, SCIPgetMemUsed() = 245468207, SCIPgetMemTotal() = 354862967, SCIPgetMemExternEstim() = 148032601
37.28/37.47	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
37.28/37.47	c Original Problem   :
37.28/37.47	c   Problem name     : instance-4445780-1721321982
37.28/37.47	c   Variables        : 37510 (37510 binary, 0 integer, 0 implicit integer, 0 continuous)
37.28/37.47	c   Constraints      : 119740
37.28/37.47	c   Objective sense  : minimize
37.28/37.47	c Presolved Problem  :
37.28/37.47	c   Variables        : 21935 (21935 binary, 0 integer, 0 implicit integer, 0 continuous)
37.28/37.47	c   Constraints      : 36221
37.28/37.47	c Constraints        : Number
37.28/37.47	c   knapsack         : 576 
37.28/37.47	c   setppc           : 26247 
37.28/37.47	c   and              : 9384 
37.28/37.47	c   logicor          : 14 
37.28/37.47	c ** Instance transfer method used: 0
37.38/37.55	c ** ParaScipInstance copy increased the number of variables. **
37.48/37.63	c LC is working with racing ramp-up and with rebuilding tree after racing.
37.48/37.63	c                                Nodes    Active                                            
37.48/37.63	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3589.55/3600.04	c      3600              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3589.65/3600.20	c SCIP Status        : c solving was interrupted [hard time limit reached]
3589.65/3600.20	c Total Time         : 3600.2000
3589.65/3600.20	c   solving          : 3600.2000
3589.65/3600.20	c   presolving       : 37.0111 (included in solving)
3589.65/3600.20	c B&B Tree           :
3589.65/3600.20	c   nodes (total)    : 1
3589.65/3600.20	c Solution           :
3589.65/3600.20	c   Solutions found  : 0
3589.65/3600.20	c   Primal Bound     :          -
3589.65/3600.20	c   Dual Bound       :          -
3589.65/3600.20	c Gap                :          -
3589.84/3600.37	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (61855 MiB free)
  memory of node 1: 64473 MiB (62582 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4445780-1721321982/watcher-4445780-1721321982 -o /tmp/evaluation-result-4445780-1721321982/solver-4445780-1721321982 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1721317650-1007727 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4445780-1721321982.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1011382, runsolver pid=1011379

[startup+0.100445 s]*
/proc/loadavg: 4.20 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127377056/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=68520 memory=56560 CPUtime=0.09 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 12079 0 0 0 8 1 0 0 20 0 1 0 184366292 70164480 14140 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 17130 14140 2318 3032 0 13530 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 68520 KiB
Current children cumulated memory: 56560 KiB

[startup+0.205839 s]*
/proc/loadavg: 4.20 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127338744/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=109200 memory=97188 CPUtime=0.19 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 22206 0 0 0 17 2 0 0 20 0 1 0 184366292 111820800 24297 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 27300 24297 2318 3032 0 23700 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 109200 KiB
Current children cumulated memory: 97188 KiB

[startup+0.305822 s]*
/proc/loadavg: 4.20 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127276732/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=172360 memory=160864 CPUtime=0.3 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 38525 0 0 0 25 5 0 0 20 0 1 0 184366292 176496640 40216 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 43090 40216 2542 3032 0 39490 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 172360 KiB
Current children cumulated memory: 160864 KiB

[startup+0.700237 s]
/proc/loadavg: 4.20 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127188224/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=268472 memory=254764 CPUtime=0.68 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 61972 0 0 0 60 8 0 0 20 0 1 0 184366292 274915328 63691 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 67118 63691 2590 3032 0 63518 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 268472 KiB
Current children cumulated memory: 254764 KiB

[startup+1.50022 s]
/proc/loadavg: 4.18 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127131296/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=315764 memory=301720 CPUtime=1.48 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 74033 0 0 0 138 10 0 0 20 0 1 0 184366292 323342336 75430 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 78941 75430 2654 3032 0 75341 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 315764 KiB
Current children cumulated memory: 301720 KiB

[startup+3.10579 s]
/proc/loadavg: 4.18 4.18 4.17 5/266 1011383
/proc/meminfo: memFree=127140656/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=307856 memory=294740 CPUtime=3.09 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 79120 0 0 0 298 11 0 0 20 0 1 0 184366292 315244544 73685 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 76964 73685 2718 3032 0 73364 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 307856 KiB
Current children cumulated memory: 294740 KiB

[startup+6.30023 s]
/proc/loadavg: 4.16 4.18 4.16 5/266 1011383
/proc/meminfo: memFree=127122252/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=321336 memory=306132 CPUtime=6.27 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 81994 0 0 0 616 11 0 0 20 0 1 0 184366292 329048064 76533 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 80334 76533 2734 3032 0 76734 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 321336 KiB
Current children cumulated memory: 306132 KiB

[startup+12.7002 s]
/proc/loadavg: 4.15 4.17 4.16 5/266 1011386
/proc/meminfo: memFree=127101464/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=335016 memory=320820 CPUtime=12.65 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 85120 0 0 0 1253 12 0 0 20 0 1 0 184366292 343056384 80205 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 83754 80205 2734 3032 0 80154 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 335016 KiB
Current children cumulated memory: 320820 KiB

[startup+25.5002 s]
/proc/loadavg: 4.13 4.17 4.16 5/266 1011388
/proc/meminfo: memFree=127082204/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=340912 memory=326048 CPUtime=25.42 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 86492 0 0 0 2529 13 0 0 20 0 1 0 184366292 349093888 81512 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 85228 81512 2734 3032 0 81628 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 340912 KiB
Current children cumulated memory: 326048 KiB

[startup+51.1057 s]
/proc/loadavg: 4.13 4.17 4.16 5/266 1011395
/proc/meminfo: memFree=126724068/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=719820 memory=648348 CPUtime=50.95 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 232881 0 0 0 5063 32 0 0 20 0 3 0 184366292 737095680 162087 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 179955 162087 2910 3032 0 175561 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=719820 memory=560520 CPUtime=13.5 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 125770 0 0 0 1335 15 0 0 20 0 3 0 184370040 737095680 162087 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=719820 memory=43840 CPUtime=0 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 24 0 0 0 0 0 0 0 20 0 3 0 184370055 737095680 162087 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 719820 KiB
Current children cumulated memory: 648348 KiB

[startup+102.3 s]
/proc/loadavg: 4.18 4.17 4.16 5/266 1011415
/proc/meminfo: memFree=126638204/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=785356 memory=659068 CPUtime=102 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 271678 0 0 0 10165 35 0 0 20 0 3 0 184366292 804204544 164767 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 196339 164767 2910 3032 0 178633 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=785356 memory=11396 CPUtime=64.55 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 164537 0 0 0 6437 18 0 0 20 0 3 0 184370040 804204544 164767 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=785356 memory=13116 CPUtime=0 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 54 0 0 0 0 0 0 0 20 0 3 0 184370055 804204544 164767 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 102 s
Current children cumulated vsize: 785356 KiB
Current children cumulated memory: 659068 KiB

[startup+162.3 s]
/proc/loadavg: 4.12 4.15 4.16 5/266 1011425
/proc/meminfo: memFree=126549664/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=785356 memory=663080 CPUtime=161.84 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 296271 0 0 0 16147 37 0 0 20 0 3 0 184366292 804204544 165770 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 196339 165770 2910 3032 0 179141 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=785356 memory=663064 CPUtime=124.4 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 189116 0 0 0 12420 20 0 0 20 0 3 0 184370040 804204544 165770 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=785356 memory=11396 CPUtime=0 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 68 0 0 0 0 0 0 0 20 0 3 0 184370055 804204544 165770 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 161.84 s
Current children cumulated vsize: 785356 KiB
Current children cumulated memory: 663080 KiB

[startup+222.3 s]
/proc/loadavg: 4.09 4.14 4.15 5/266 1011438
/proc/meminfo: memFree=126461552/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=672492 CPUtime=221.68 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 306328 0 0 0 22130 38 0 0 20 0 3 0 184366292 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 168123 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=13116 CPUtime=184.23 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 199163 0 0 0 18402 21 0 0 20 0 3 0 184370040 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=672492 CPUtime=0 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 78 0 0 0 0 0 0 0 20 0 3 0 184370055 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 221.68 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 672492 KiB

[startup+282.3 s]
/proc/loadavg: 4.15 4.14 4.15 5/265 1011449
/proc/meminfo: memFree=126383288/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=672492 CPUtime=281.52 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 322082 0 0 0 28113 39 0 0 20 0 3 0 184366292 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 168123 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=672492 CPUtime=244.08 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 214909 0 0 0 24386 22 0 0 20 0 3 0 184370040 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=11396 CPUtime=0 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 86 0 0 0 0 0 0 0 20 0 3 0 184370055 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 281.52 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 672492 KiB

[startup+342.3 s]
/proc/loadavg: 4.16 4.14 4.15 5/263 1011459
/proc/meminfo: memFree=126325484/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=672492 CPUtime=341.37 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 329737 0 0 0 34097 40 0 0 20 0 3 0 184366292 810799104 168123 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 168123 2910 3032 0 181863 0

################
# More data... #
################

/proc/loadavg: 4.21 4.13 4.12 5/265 1013181
/proc/meminfo: memFree=114556252/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3452.32 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 474629 0 0 0 345180 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=691620 CPUtime=3414.84 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 367113 0 0 0 341452 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=-7880590079354495871 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 429 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3452.32 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3522.3 s]
/proc/loadavg: 4.08 4.10 4.11 5/267 1013363
/proc/meminfo: memFree=114554712/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3512.11 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 475819 0 0 0 351159 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=691620 CPUtime=3474.63 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 368297 0 0 0 347431 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=691620 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 435 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3512.11 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3582.3 s]
/proc/loadavg: 4.07 4.09 4.10 5/267 1013373
/proc/meminfo: memFree=114553480/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3571.9 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 476430 0 0 0 357138 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=691620 CPUtime=3534.42 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 368899 0 0 0 353410 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=11396 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 444 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3571.9 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3600.38 s]
# the end of solver process 1011382 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3589.4 s, system=0.535496 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.07 4.09 4.10 5/267 1013374
/proc/meminfo: memFree=114553364/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3573.6 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 476430 0 0 0 357308 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=-6952852786849484650 CPUtime=3536.12 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 368899 0 0 0 353580 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=1401351331561300026 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 444 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3573.6 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3590.4 s]
/proc/loadavg: 4.14 4.11 4.11 5/267 1013375
/proc/meminfo: memFree=114553308/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3579.98 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 476430 0 0 0 357946 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=43840 CPUtime=3542.49 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 368899 0 0 0 354217 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=11396 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 444 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3579.98 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3596.8 s]
/proc/loadavg: 4.29 4.14 4.12 5/267 1013375
/proc/meminfo: memFree=114553052/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3586.35 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 476430 0 0 0 358583 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=691620 CPUtime=3548.87 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 368899 0 0 0 354855 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=691620 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 444 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3586.35 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3598.4 s]
/proc/loadavg: 4.27 4.14 4.12 5/267 1013375
/proc/meminfo: memFree=114553044/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3587.95 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 476806 0 0 0 358743 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=31528 CPUtime=3550.46 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 369274 0 0 0 355014 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=16236 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 445 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3587.95 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3599.2 s]
/proc/loadavg: 4.27 4.14 4.12 5/267 1013377
/proc/meminfo: memFree=114553052/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3588.75 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 477017 0 0 0 358823 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=7092 CPUtime=3551.26 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 369485 0 0 0 355094 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=28308 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 445 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3588.75 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3600 s]*
/proc/loadavg: 4.27 4.14 4.12 5/267 1013377
/proc/meminfo: memFree=114552968/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=791796 memory=691620 CPUtime=3589.55 cores=5,7
/proc/1011382/stat : 1011382 (fscip) S 1011379 1011382 1007714 0 -1 1077936128 477017 0 0 0 358903 52 0 0 20 0 3 0 184366292 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 197949 172905 2910 3032 0 181863 0
[pid=1011382/tid=1011391] ppid=1011379 vsize=791796 memory=-6952852786849484650 CPUtime=3552.07 cores=5,7
/proc/1011382/task/1011391/stat : 1011391 (fscip) R 1011379 1011382 1007714 0 -1 4194368 369485 0 0 0 355175 32 0 0 20 0 3 0 184370040 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=791796 memory=30624 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 445 0 0 0 1 2 0 0 20 0 3 0 184370055 810799104 172905 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3589.55 s
Current children cumulated vsize: 791796 KiB
Current children cumulated memory: 691620 KiB

[startup+3600.22 s]
/proc/loadavg: 4.27 4.14 4.12 5/267 1013377
/proc/meminfo: memFree=114552968/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=719820 memory=651480 CPUtime=3589.76 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 479720 0 0 0 358924 52 0 0 20 0 2 0 184366292 737095680 162870 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 179955 162870 2958 3032 0 176039 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=719820 memory=-7169307044023800427 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 445 0 0 0 1 2 0 0 20 0 2 0 184370055 737095680 162870 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3589.76 s
Current children cumulated vsize: 719820 KiB
Current children cumulated memory: 651480 KiB

[startup+3600.3 s]
/proc/loadavg: 4.27 4.14 4.12 5/267 1013377
/proc/meminfo: memFree=114552968/131524600 swapFree=131071996/131071996
[pid=1011382] ppid=1011379 vsize=718764 memory=650424 CPUtime=3589.84 cores=5,7
/proc/1011382/stat : 1011382 (fscip) R 1011379 1011382 1007714 0 -1 4194304 479773 0 0 0 358932 52 0 0 20 0 2 0 184366292 736014336 162606 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
/proc/1011382/statm: 179691 162606 2958 3032 0 175775 0
[pid=1011382/tid=1011392] ppid=1011379 vsize=718764 memory=691620 CPUtime=0.03 cores=5,7
/proc/1011382/task/1011392/stat : 1011392 (fscip) S 1011379 1011382 1007714 0 -1 1077936192 445 0 0 0 1 2 0 0 20 0 2 0 184370055 736014336 162606 134679101440 4194304 16613245 140722548937408 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 38858752 140722548945939 140722548946055 140722548946055 140722548953072 0
Current children cumulated CPU time: 3589.84 s
Current children cumulated vsize: 718764 KiB
Current children cumulated memory: 650424 KiB

Child status: 0

Real time (s): 3600.38
CPU time (s): 3589.93
CPU user time (s): 3589.4
CPU system time (s): 0.535496
CPU usage (%): 99.7098
Max. virtual memory (cumulated for all children) (KiB): 791796
Max. memory (cumulated for all children) (KiB): 692056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3589.4
system time used= 0.535496
maximum resident set size= 692056
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 486353
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3581
involuntary context switches= 1090


# summary of solver processes directly reported to runsolver:
#   pid: 1011382
#   total CPU time (s): 3589.93
#   total CPU user time (s): 3589.4
#   total CPU system time (s): 0.535496

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.20948 second user time and 18.5554 second system time

The end

Launcher Data

Begin job on nodeC030 at 2024-07-18 18:59:55
IDJOB=4445780
IDBENCH=154365
IDSOLVER=3064
FILE ID=nodeC030/4445780-1721321982
RUNJOBID= nodeC030-1721317650-1007727
SLURM_JOB_ID= 7542666
Free space on /tmp= 889996 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB10/DEC-LIN/oliveras/j120/normalized-j12011_1-unsat.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4445780-1721321982/watcher-4445780-1721321982 -o /tmp/evaluation-result-4445780-1721321982/solver-4445780-1721321982 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1721317650-1007727 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4445780-1721321982.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= cdcb4d035b8e87f1109f75a28aea48eb
RANDOM SEED=2069952677

nodeC030.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3667.733
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.353
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.908
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.979
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3667.713
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.411
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.988
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.012
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        127424732 kB
MemAvailable:   128584472 kB
Buffers:          477660 kB
Cached:          1511088 kB
SwapCached:            0 kB
Active:          1103044 kB
Inactive:        2369412 kB
Active(anon):       1540 kB
Inactive(anon):  1519864 kB
Active(file):    1101504 kB
Inactive(file):   849548 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             32312 kB
Writeback:             0 kB
AnonPages:       1483356 kB
Mapped:           141772 kB
Shmem:             37720 kB
KReclaimable:      97024 kB
Slab:             209468 kB
SReclaimable:      97024 kB
SUnreclaim:       112444 kB
KernelStack:        4208 kB
PageTables:        11988 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1244384 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            69952 kB
HardwareCorrupted:     0 kB
AnonHugePages:    266240 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      234196 kB
DirectMap2M:    18413568 kB
DirectMap1G:    117440512 kB

Free space on /tmp at the end= 889900 MiB
End job on nodeC030 at 2024-07-18 19:59:55