Trace number 4464485

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3578.68 3598.73

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K143.opb
MD5SUM5b71eb3fc2b19671b5e391982561b6cd
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables17017
Total number of constraints17305
Number of constraints which are clauses17162
Number of constraints which are cardinality constraints (but not clauses)143
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint143
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 144
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.10/0.12	c Default LC presolving (default).
0.10/0.12	c ** Before presolving: virtualMemUsedAtLc = 101405489, getVmSize() = 91865088, SCIPgetMemUsed() = 61256477, SCIPgetMemTotal() = 68337277, SCIPgetMemExternEstim() = 33068212
0.10/0.12	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
41.03/41.20	c ** Estimated virtualMemUsedAtSolver = 209083424, getVmSize() = 312401920, SCIPgetMemUsed() = 208150581, SCIPgetMemTotal() = 280556925, SCIPgetMemExternEstim() = 33068212
41.03/41.20	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
41.03/41.20	c Original Problem   :
41.03/41.20	c   Problem name     : instance-4464485-1722384812
41.03/41.20	c   Variables        : 17017 (17017 binary, 0 integer, 0 implicit integer, 0 continuous)
41.03/41.20	c   Constraints      : 17305
41.03/41.20	c   Objective sense  : minimize
41.03/41.20	c Presolved Problem  :
41.03/41.20	c   Variables        : 15505 (15505 binary, 0 integer, 0 implicit integer, 0 continuous)
41.03/41.20	c   Constraints      : 15762
41.03/41.20	c Constraints        : Number
41.03/41.20	c   knapsack         : 1 
41.03/41.20	c   setppc           : 1933 
41.03/41.20	c   orbitope         : 1 
41.03/41.20	c   logicor          : 13827 
41.03/41.20	c ** Instance transfer method used: 0
41.03/41.25	c ** ParaScipInstance copy increased the number of variables. **
41.13/41.30	c LC is working with racing ramp-up and with rebuilding tree after racing.
41.13/41.30	c                                Nodes    Active                                            
41.13/41.30	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1059.56/1070.50	c      1071              2           1         1                -           0.0000          -
1077.39/1088.40	c      1088              3           2         1                -           0.0000          -
1113.44/1124.61	c      1125              5           4         1                -           0.0000          -
1120.70/1131.96	c      1132              6           5         1                -           0.0000          -
1149.38/1160.77	c      1161              7           6         1                -           0.0000          -
1290.76/1302.77	c      1303              9           6         1                -           0.0000          -
1649.63/1663.01	c      1663             10           7         1                -           0.0000          -
1741.53/1755.35	c      1755             11           6         1                -           0.0000          -
1861.13/1875.31	c      1875             12           7         1                -           0.0000          -
1965.28/1979.89	c      1980             13           8         1                -           0.0000          -
2095.61/2110.63	c      2111             14           7         1                -           0.0000          -
2282.56/2298.26	c      2298             15           8         1                -           0.0000          -
2540.62/2557.27	c      2557             16           9         1                -           0.0000          -
3578.43/3598.57	c      3599             16           9         0                -           0.0000          -
3578.53/3598.67	c SCIP Status        : c solving was interrupted [hard time limit reached]
3578.53/3598.67	c Total Time         : 3598.6600
3578.53/3598.67	c   solving          : 3598.6600
3578.53/3598.67	c   presolving       : 41.0852 (included in solving)
3578.53/3598.67	c B&B Tree           :
3578.53/3598.67	c   nodes (total)    : 1
3578.53/3598.67	c Solution           :
3578.53/3598.67	c   Solutions found  : 0
3578.53/3598.67	c   Primal Bound     :          -
3578.53/3598.67	c   Dual Bound       : +0.00000000000000e+00
3578.53/3598.67	c Gap                :          -
3578.64/3598.73	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (54286 MiB free)
  memory of node 1: 64473 MiB (45690 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464485-1722384812/watcher-4464485-1722384812 -o /tmp/evaluation-result-4464485-1722384812/solver-4464485-1722384812 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC026-1722378594-30204 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464485-1722384812.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=33923, runsolver pid=33920
Current StackSize limit: 8192 KiB


[startup+0.100097 s]*
/proc/loadavg: 4.08 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102318932/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=80716 memory=69860 CPUtime=0.1 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 15244 0 0 0 8 2 0 0 20 0 1 0 5081405 82653184 17465 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 20179 17465 2539 3035 0 16575 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 80716 KiB
Current children cumulated memory: 69860 KiB

[startup+0.206021 s]*
/proc/loadavg: 4.08 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102295288/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=105504 memory=91316 CPUtime=0.2 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 20058 0 0 0 18 2 0 0 20 0 1 0 5081405 108036096 22829 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 26376 22829 2614 3035 0 22772 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 105504 KiB
Current children cumulated memory: 91316 KiB

[startup+0.305846 s]*
/proc/loadavg: 4.08 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102280788/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=118804 memory=105468 CPUtime=0.3 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 26018 0 0 0 27 3 0 0 20 0 1 0 5081405 121655296 26367 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 29701 26367 2662 3035 0 26097 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 118804 KiB
Current children cumulated memory: 105468 KiB

[startup+0.70026 s]
/proc/loadavg: 4.08 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102280648/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=128852 memory=115488 CPUtime=0.68 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 30186 0 0 0 64 4 0 0 20 0 1 0 5081405 131944448 28872 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 32213 28872 2758 3035 0 28609 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 128852 KiB
Current children cumulated memory: 115488 KiB

[startup+1.50025 s]
/proc/loadavg: 4.08 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102266828/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=166512 memory=150356 CPUtime=1.49 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 37592 0 0 0 143 6 0 0 20 0 1 0 5081405 170508288 37589 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 41628 37589 2774 3035 0 38024 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 166512 KiB
Current children cumulated memory: 150356 KiB

[startup+3.10569 s]
/proc/loadavg: 4.07 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102232072/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=170196 memory=154308 CPUtime=3.08 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 38530 0 0 0 302 6 0 0 20 0 1 0 5081405 174280704 38577 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 42549 38577 2774 3035 0 38945 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 170196 KiB
Current children cumulated memory: 154308 KiB

[startup+6.30023 s]
/proc/loadavg: 4.07 4.12 4.10 5/263 33924
/proc/meminfo: memFree=102209120/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=171344 memory=155364 CPUtime=6.26 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 38849 0 0 0 620 6 0 0 20 0 1 0 5081405 175456256 38841 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 42836 38841 2774 3035 0 39232 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 171344 KiB
Current children cumulated memory: 155364 KiB

[startup+12.7002 s]
/proc/loadavg: 4.06 4.12 4.10 5/263 33926
/proc/meminfo: memFree=102195608/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=175356 memory=159420 CPUtime=12.64 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 39870 0 0 0 1258 6 0 0 20 0 1 0 5081405 179564544 39855 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 43839 39855 2774 3035 0 40235 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 175356 KiB
Current children cumulated memory: 159420 KiB

[startup+25.5003 s]
/proc/loadavg: 4.12 4.13 4.10 5/263 33927
/proc/meminfo: memFree=102193932/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=175908 memory=159940 CPUtime=25.39 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 39987 0 0 0 2532 7 0 0 20 0 1 0 5081405 180129792 39985 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 43977 39985 2774 3035 0 40373 0
Current children cumulated CPU time: 25.39 s
Current children cumulated vsize: 175908 KiB
Current children cumulated memory: 159940 KiB

[startup+51.1058 s]
/proc/loadavg: 4.20 4.15 4.11 5/265 33935
/proc/meminfo: memFree=101966472/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=478384 memory=378900 CPUtime=50.83 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 134540 0 0 0 5064 19 0 0 20 0 3 0 5081405 489865216 94725 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 119596 94725 2806 3035 0 112727 0
[pid=33923/tid=33932] ppid=33920 vsize=478384 memory=-5155635703885425541 CPUtime=9.73 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 68123 0 0 0 967 6 0 0 20 0 3 0 5085526 489865216 94725 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=478384 memory=360452 CPUtime=0 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 17 0 0 0 0 0 0 0 20 0 3 0 5085536 489865216 94725 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 50.83 s
Current children cumulated vsize: 478384 KiB
Current children cumulated memory: 378900 KiB

[startup+102.301 s]
/proc/loadavg: 4.12 4.14 4.11 5/265 33943
/proc/meminfo: memFree=101913384/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=544392 memory=429304 CPUtime=101.46 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 221030 0 0 0 10121 25 0 0 20 0 3 0 5081405 557457408 107326 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 136098 107326 2966 3035 0 125876 0
[pid=33923/tid=33932] ppid=33920 vsize=544392 memory=12340 CPUtime=60.37 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 154573 0 0 0 6024 13 0 0 20 0 3 0 5085526 557457408 107326 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=544392 memory=429224 CPUtime=0 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 57 0 0 0 0 0 0 0 20 0 3 0 5085536 557457408 107326 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 101.46 s
Current children cumulated vsize: 544392 KiB
Current children cumulated memory: 429304 KiB

[startup+162.301 s]
/proc/loadavg: 4.07 4.12 4.10 5/262 33953
/proc/meminfo: memFree=101901832/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=551592 memory=436148 CPUtime=160.82 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 238014 0 0 0 16055 27 0 0 20 0 3 0 5081405 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 137898 109037 2966 3035 0 127716 0
[pid=33923/tid=33932] ppid=33920 vsize=551592 memory=429640 CPUtime=119.73 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 171539 0 0 0 11958 15 0 0 20 0 3 0 5085526 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=551592 memory=12340 CPUtime=0 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 75 0 0 0 0 0 0 0 20 0 3 0 5085536 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 160.82 s
Current children cumulated vsize: 551592 KiB
Current children cumulated memory: 436148 KiB

[startup+222.301 s]
/proc/loadavg: 4.07 4.11 4.09 5/262 33963
/proc/meminfo: memFree=101901096/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=551592 memory=436148 CPUtime=220.15 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 247115 0 0 0 21987 28 0 0 20 0 3 0 5081405 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 137898 109037 2966 3035 0 127716 0
[pid=33923/tid=33932] ppid=33920 vsize=551592 memory=436148 CPUtime=179.06 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 180630 0 0 0 17890 16 0 0 20 0 3 0 5085526 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=551592 memory=436148 CPUtime=0 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 85 0 0 0 0 0 0 0 20 0 3 0 5085536 564830208 109037 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 220.15 s
Current children cumulated vsize: 551592 KiB
Current children cumulated memory: 436148 KiB

[startup+282.301 s]
/proc/loadavg: 4.34 4.20 4.12 5/262 33975
/proc/meminfo: memFree=101833476/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=587000 memory=495032 CPUtime=279.5 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 278022 0 0 0 27918 32 0 0 20 0 3 0 5081405 601088000 123758 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 146750 123758 2982 3035 0 142490 0
[pid=33923/tid=33932] ppid=33920 vsize=587000 memory=12340 CPUtime=238.41 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 211531 0 0 0 23821 20 0 0 20 0 3 0 5085526 601088000 123758 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=587000 memory=12680 CPUtime=0 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 91 0 0 0 0 0 0 0 20 0 3 0 5085536 601088000 123758 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 279.5 s
Current children cumulated vsize: 587000 KiB
Current children cumulated memory: 495032 KiB

[startup+342.301 s]
/proc/loadavg: 4.18 4.17 4.12 5/262 33986
/proc/meminfo: memFree=101818764/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=652720 memory=508376 CPUtime=338.85 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 318764 0 0 0 33849 36 0 0 20 0 3 0 5081405 668385280 127094 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0

################
# More data... #
################

[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3442.73 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1062352 0 0 0 344179 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=672192 CPUtime=3401.58 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 995266 0 0 0 340080 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=672192 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 447 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3442.73 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3522.3 s]
/proc/loadavg: 4.10 4.13 4.14 5/265 35961
/proc/meminfo: memFree=123234904/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3502.51 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1063154 0 0 0 350157 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=672192 CPUtime=3461.36 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 996062 0 0 0 346058 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=672192 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 453 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3502.51 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3582.3 s]
/proc/loadavg: 4.08 4.11 4.13 5/265 35971
/proc/meminfo: memFree=123192964/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3562.29 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064038 0 0 0 356135 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=12340 CPUtime=3521.14 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 996941 0 0 0 352036 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=12400 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 458 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3562.29 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3598.73 s]
# the end of solver process 33923 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3577.72 s, system=0.951662 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.08 4.11 4.13 5/265 35971
/proc/meminfo: memFree=123190500/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3563.99 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064038 0 0 0 356305 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=672192 CPUtime=3522.84 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 996941 0 0 0 352206 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=4500109349469449883 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 458 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3563.99 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3590.4 s]
/proc/loadavg: 4.07 4.11 4.13 5/265 35972
/proc/meminfo: memFree=123186364/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3570.36 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064038 0 0 0 356942 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=672192 CPUtime=3529.21 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 996941 0 0 0 352843 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=672192 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 458 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3570.36 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3593.6 s]
/proc/loadavg: 4.15 4.13 4.14 5/265 35972
/proc/meminfo: memFree=123173604/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3573.55 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064075 0 0 0 357261 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=672192 CPUtime=3532.4 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 996978 0 0 0 353162 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=672192 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 458 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3573.55 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3596.8 s]
/proc/loadavg: 4.15 4.13 4.14 5/265 35972
/proc/meminfo: memFree=123172944/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3576.74 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064127 0 0 0 357580 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=164 CPUtime=3535.59 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 997026 0 0 0 353481 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=280459621169968 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 462 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3576.74 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3597.6 s]
/proc/loadavg: 4.14 4.13 4.13 5/265 35972
/proc/meminfo: memFree=123171924/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3577.54 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064127 0 0 0 357660 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=16144 CPUtime=3536.39 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 997026 0 0 0 353561 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=2336 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 462 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3577.54 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3598.4 s]
/proc/loadavg: 4.14 4.13 4.13 5/265 35972
/proc/meminfo: memFree=123171756/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=719240 memory=672192 CPUtime=3578.33 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064127 0 0 0 357739 94 0 0 20 0 3 0 5081405 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 179810 168048 3030 3035 0 175871 0
[pid=33923/tid=33932] ppid=33920 vsize=719240 memory=12680 CPUtime=3537.19 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 997026 0 0 0 353641 78 0 0 20 0 3 0 5085526 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=719240 memory=12400 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 462 0 0 0 1 3 0 0 20 0 3 0 5085536 736501760 168048 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3578.33 s
Current children cumulated vsize: 719240 KiB
Current children cumulated memory: 672192 KiB

[startup+3598.6 s]
/proc/loadavg: 4.14 4.13 4.13 5/265 35972
/proc/meminfo: memFree=123171756/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=684016 memory=636968 CPUtime=3578.53 cores=0,2
/proc/33923/stat : 33923 (fscip) S 33920 33923 30194 0 -1 1077936128 1064232 0 0 0 357759 94 0 0 20 0 3 0 5081405 700432384 159242 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 171004 159242 3030 3035 0 167065 0
[pid=33923/tid=33932] ppid=33920 vsize=684016 memory=429 CPUtime=3537.38 cores=0,2
/proc/33923/task/33932/stat : 33932 (fscip) R 33920 33923 30194 0 -1 4194368 997117 0 0 0 353660 78 0 0 20 0 3 0 5085526 700432384 159242 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
[pid=33923/tid=33933] ppid=33920 vsize=684016 memory=15658 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 462 0 0 0 1 3 0 0 20 0 3 0 5085536 700432384 159242 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3578.53 s
Current children cumulated vsize: 684016 KiB
Current children cumulated memory: 636968 KiB

[startup+3598.71 s]
/proc/loadavg: 4.14 4.13 4.13 5/265 35972
/proc/meminfo: memFree=123171756/131524600 swapFree=131071996/131071996
[pid=33923] ppid=33920 vsize=675832 memory=629296 CPUtime=3578.64 cores=0,2
/proc/33923/stat : 33923 (fscip) R 33920 33923 30194 0 -1 4194304 1065030 0 0 0 357770 94 0 0 20 0 2 0 5081405 692051968 157324 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
/proc/33923/statm: 168958 157324 3030 3035 0 165019 0
[pid=33923/tid=33933] ppid=33920 vsize=675832 memory=672192 CPUtime=0.04 cores=0,2
/proc/33923/task/33933/stat : 33933 (fscip) S 33920 33923 30194 0 -1 1077936192 462 0 0 0 1 3 0 0 20 0 2 0 5085536 692051968 157324 134679101440 4194304 16623229 140726357601136 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 45375488 140726357607446 140726357607562 140726357607562 140726357614576 0
Current children cumulated CPU time: 3578.64 s
Current children cumulated vsize: 675832 KiB
Current children cumulated memory: 629296 KiB

Child status: 0

Real time (s): 3598.73
CPU time (s): 3578.68
CPU user time (s): 3577.72
CPU system time (s): 0.951662
CPU usage (%): 99.4427
Max. virtual memory (cumulated for all children) (KiB): 784776
Max. memory (cumulated for all children) (KiB): 672192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3577.72
system time used= 0.951662
maximum resident set size= 672192
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1065505
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3624
involuntary context switches= 30033


# summary of solver processes directly reported to runsolver:
#   pid: 33923
#   total CPU time (s): 3578.68
#   total CPU user time (s): 3577.72
#   total CPU system time (s): 0.951662

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.4046 second user time and 17.225 second system time

The end

Launcher Data 

Begin job on nodeC026 at 2024-07-31 02:13:32
IDJOB=4464485
IDBENCH=158274
IDSOLVER=3092
FILE ID=nodeC026/4464485-1722384812
RUNJOBID= nodeC026-1722378594-30204
SLURM_JOB_ID= 8249849
Free space on /tmp= 889748 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K143.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464485-1722384812/watcher-4464485-1722384812 -o /tmp/evaluation-result-4464485-1722384812/solver-4464485-1722384812 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC026-1722378594-30204 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464485-1722384812.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 5b71eb3fc2b19671b5e391982561b6cd
RANDOM SEED=1367756045

nodeC026.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3661.676
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.502
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.109
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.511
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.745
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.501
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3603.044
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.541
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        102376768 kB
MemAvailable:   106707676 kB
Buffers:          100900 kB
Cached:          5043484 kB
SwapCached:            0 kB
Active:           529060 kB
Inactive:       28051744 kB
Active(anon):       1496 kB
Inactive(anon): 23456296 kB
Active(file):     527564 kB
Inactive(file):  4595448 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29420 kB
Writeback:             4 kB
AnonPages:      23434640 kB
Mapped:           125048 kB
Shmem:             21336 kB
KReclaimable:      95436 kB
Slab:             180688 kB
SReclaimable:      95436 kB
SUnreclaim:        85252 kB
KernelStack:        4224 kB
PageTables:        55576 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:   15693544 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9792 kB
HardwareCorrupted:     0 kB
AnonHugePages:   6574080 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      205524 kB
DirectMap2M:    16345088 kB
DirectMap1G:    119537664 kB

Free space on /tmp at the end= 889972 MiB
End job on nodeC026 at 2024-07-31 03:13:31