Trace number 4452190

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3589.9 3601.56

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/
dec/miplib2003/normalized-stp3d.0.s.opb
MD5SUM3669957ef10a08034abaee305bfecedd
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables204880
Total number of constraints159489
Number of constraints which are clauses129232
Number of constraints which are cardinality constraints (but not clauses)5805
Number of constraints which are nor clauses,nor cardinality constraints24452
Minimum length of a constraint2
Maximum length of a constraint75648
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3258328
Number of bits of the biggest number in a constraint 22
Biggest sum of numbers in a constraint 503258152
Number of bits of the biggest sum of numbers29
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
1.78/1.82	c Default LC presolving (default).
1.78/1.82	c ** Before presolving: virtualMemUsedAtLc = 969836496, getVmSize() = 678944768, SCIPgetMemUsed() = 630135762, SCIPgetMemTotal() = 637336602, SCIPgetMemExternEstim() = 332499894
1.78/1.82	c ** set memory limit for presolving in LC to 8.7958e+12 for SCIP **
40.48/40.66	c ** Estimated virtualMemUsedAtSolver = 916937689, getVmSize() = 1204813824, SCIPgetMemUsed() = 847371176, SCIPgetMemTotal() = 1042906640, SCIPgetMemExternEstim() = 332499894
40.48/40.66	c ** set memory limit for solvers to 4.39802e+12 for each SCIP **
40.48/40.66	c Original Problem   :
40.48/40.66	c   Problem name     : instance-4452190-1721428816
40.48/40.66	c   Variables        : 204880 (204880 binary, 0 integer, 0 implicit integer, 0 continuous)
40.48/40.66	c   Constraints      : 159489
40.48/40.66	c   Objective sense  : minimize
40.48/40.66	c Presolved Problem  :
40.48/40.66	c   Variables        : 136034 (136034 binary, 0 integer, 0 implicit integer, 0 continuous)
40.48/40.66	c   Constraints      : 96859
40.48/40.66	c Constraints        : Number
40.48/40.66	c   knapsack         : 1 
40.48/40.66	c   setppc           : 72863 
40.48/40.66	c   linear           : 23995 
40.48/40.66	c ** Instance transfer method used: 0
40.88/41.04	c ** ParaScipInstance copy does not increase the number of variables. **
41.47/41.66	c LC is working with racing ramp-up and with rebuilding tree after racing.
41.47/41.66	c                                Nodes    Active                                            
41.47/41.66	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3588.35/3600.02	c      3600              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3588.94/3600.65	c SCIP Status        : c solving was interrupted [hard time limit reached]
3588.94/3600.65	c Total Time         : 3600.6500
3588.94/3600.65	c   solving          : 3600.6500
3588.94/3600.65	c   presolving       : 38.8418 (included in solving)
3588.94/3600.65	c B&B Tree           :
3588.94/3600.65	c   nodes (total)    : 1
3588.94/3600.65	c Solution           :
3588.94/3600.65	c   Solutions found  : 0
3588.94/3600.65	c   Primal Bound     :          -
3588.94/3600.65	c   Dual Bound       :          -
3588.94/3600.65	c Gap                :          -
3589.83/3601.53	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (58954 MiB free)
  memory of node 1: 64473 MiB (61511 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452190-1721428816/watcher-4452190-1721428816 -o /tmp/evaluation-result-4452190-1721428816/solver-4452190-1721428816 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC005-1721421610-1033552 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4452190-1721428816.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1038893, runsolver pid=1038890
Current StackSize limit: 8192 KiB


[startup+0.100098 s]*
/proc/loadavg: 4.19 4.19 4.20 5/247 1038894
/proc/meminfo: memFree=123303728/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=82108 memory=67156 CPUtime=0.1 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 14676 0 0 0 7 3 0 0 20 0 1 0 195040358 84078592 16789 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 20527 16789 2318 3032 0 16927 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 82108 KiB
Current children cumulated memory: 67156 KiB

[startup+0.211082 s]*
/proc/loadavg: 4.19 4.19 4.20 5/247 1038894
/proc/meminfo: memFree=123263892/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=116716 memory=101600 CPUtime=0.21 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 23328 0 0 0 15 6 0 0 20 0 1 0 195040358 119517184 25400 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 29179 25400 2318 3032 0 25579 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 116716 KiB
Current children cumulated memory: 101600 KiB

[startup+0.311207 s]*
/proc/loadavg: 4.19 4.19 4.20 5/247 1038894
/proc/meminfo: memFree=123252020/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=131564 memory=116468 CPUtime=0.31 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 27042 0 0 0 24 7 0 0 20 0 1 0 195040358 134721536 29117 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 32891 29117 2318 3032 0 29291 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 131564 KiB
Current children cumulated memory: 116468 KiB

[startup+0.700329 s]
/proc/loadavg: 4.19 4.19 4.20 5/247 1038894
/proc/meminfo: memFree=123197360/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=229904 memory=214780 CPUtime=0.69 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 51105 0 0 0 56 13 0 0 20 0 1 0 195040358 235421696 53695 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 57476 53695 2318 3032 0 53876 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 229904 KiB
Current children cumulated memory: 214780 KiB

[startup+1.50033 s]
/proc/loadavg: 4.19 4.19 4.20 5/247 1038894
/proc/meminfo: memFree=123069316/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=560212 memory=548352 CPUtime=1.49 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 137937 0 0 0 120 29 0 0 20 0 1 0 195040358 573657088 137088 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 140053 137088 2542 3032 0 136453 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 560212 KiB
Current children cumulated memory: 548352 KiB

[startup+3.11334 s]
/proc/loadavg: 4.17 4.18 4.20 5/247 1038894
/proc/meminfo: memFree=122634556/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=802280 memory=764928 CPUtime=3.1 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 185373 0 0 0 272 38 0 0 20 0 1 0 195040358 821534720 191232 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 200570 191232 2622 3032 0 196970 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 802280 KiB
Current children cumulated memory: 764928 KiB

[startup+6.30031 s]
/proc/loadavg: 4.17 4.18 4.20 5/247 1038895
/proc/meminfo: memFree=122483400/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=919648 memory=882292 CPUtime=6.28 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 218038 0 0 0 582 46 0 0 20 0 1 0 195040358 941719552 220573 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 229912 220573 2750 3032 0 226312 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 919648 KiB
Current children cumulated memory: 882292 KiB

[startup+12.7003 s]
/proc/loadavg: 4.22 4.19 4.20 5/249 1038899
/proc/meminfo: memFree=122465984/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=936248 memory=898988 CPUtime=12.66 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 222183 0 0 0 1219 47 0 0 20 0 1 0 195040358 958717952 224747 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 234062 224747 2750 3032 0 230462 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 936248 KiB
Current children cumulated memory: 898988 KiB

[startup+25.5003 s]
/proc/loadavg: 4.19 4.19 4.20 5/249 1038902
/proc/meminfo: memFree=122433896/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=948872 memory=911160 CPUtime=25.42 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 225292 0 0 0 2494 48 0 0 20 0 1 0 195040358 971644928 227790 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 237218 227790 2750 3032 0 233618 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 948872 KiB
Current children cumulated memory: 911160 KiB

[startup+51.1128 s]
/proc/loadavg: 4.12 4.17 4.19 5/251 1038907
/proc/meminfo: memFree=121502772/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=1966404 memory=1792336 CPUtime=50.94 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 473293 0 0 0 4996 98 0 0 20 0 3 0 195040358 2013597696 448084 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 491601 448084 2798 3032 0 480148 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=1966404 memory=-7736474891429502584 CPUtime=10.01 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 196272 0 0 0 960 41 0 0 20 0 3 0 195044425 2013597696 448084 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=1966404 memory=50128 CPUtime=0 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 7 0 0 0 0 0 0 0 20 0 3 0 195044526 2013597696 448084 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 1966404 KiB
Current children cumulated memory: 1792336 KiB

[startup+102.3 s]
/proc/loadavg: 4.16 4.17 4.18 5/251 1038916
/proc/meminfo: memFree=121141956/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2294084 memory=2111644 CPUtime=101.98 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 709618 0 0 0 10075 123 0 0 20 0 3 0 195040358 2349142016 527911 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 573521 527911 2910 3032 0 561853 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2294084 memory=50128 CPUtime=61.05 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 432569 0 0 0 6039 66 0 0 20 0 3 0 195044425 2349142016 527911 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2294084 memory=2111600 CPUtime=0 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 35 0 0 0 0 0 0 0 20 0 3 0 195044526 2349142016 527911 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 2294084 KiB
Current children cumulated memory: 2111644 KiB

[startup+162.3 s]
/proc/loadavg: 4.06 4.14 4.17 5/251 1038927
/proc/meminfo: memFree=121124328/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2294084 memory=2112536 CPUtime=161.82 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 740445 0 0 0 16052 130 0 0 20 0 3 0 195040358 2349142016 528134 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 573521 528134 2910 3032 0 561853 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2294084 memory=2111624 CPUtime=120.88 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 463376 0 0 0 12016 72 0 0 20 0 3 0 195044425 2349142016 528134 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2294084 memory=12740 CPUtime=0 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 55 0 0 0 0 0 0 0 20 0 3 0 195044526 2349142016 528134 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 161.82 s
Current children cumulated vsize: 2294084 KiB
Current children cumulated memory: 2112536 KiB

[startup+222.3 s]
/proc/loadavg: 4.19 4.16 4.18 5/252 1038938
/proc/meminfo: memFree=121123748/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2294084 memory=2112540 CPUtime=221.66 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 763773 0 0 0 22030 136 0 0 20 0 3 0 195040358 2349142016 528135 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 573521 528135 2910 3032 0 561853 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2294084 memory=2111624 CPUtime=180.72 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 486693 0 0 0 17994 78 0 0 20 0 3 0 195044425 2349142016 528135 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2294084 memory=2112540 CPUtime=0 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 66 0 0 0 0 0 0 0 20 0 3 0 195044526 2349142016 528135 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 221.66 s
Current children cumulated vsize: 2294084 KiB
Current children cumulated memory: 2112540 KiB

[startup+282.3 s]
/proc/loadavg: 4.28 4.18 4.18 5/252 1038997
/proc/meminfo: memFree=121432320/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2294084 memory=2112768 CPUtime=281.49 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 786943 0 0 0 28006 143 0 0 20 0 3 0 195040358 2349142016 528192 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 573521 528192 2910 3032 0 561853 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2294084 memory=2111624 CPUtime=240.54 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 509852 0 0 0 23969 85 0 0 20 0 3 0 195044425 2349142016 528192 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2294084 memory=2112756 CPUtime=0 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 77 0 0 0 0 0 0 0 20 0 3 0 195044526 2349142016 528192 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 281.49 s
Current children cumulated vsize: 2294084 KiB
Current children cumulated memory: 2112768 KiB

[startup+342.3 s]
/proc/loadavg: 4.44 4.26 4.21 5/248 1039053
/proc/meminfo: memFree=121349568/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2294084 memory=2112920 CPUtime=341.27 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 803000 0 0 0 33979 148 0 0 20 0 3 0 195040358 2349142016 528230 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 573521 528230 2910 3032 0 561853 0

################
# More data... #
################

/proc/1038893/statm: 622673 571209 2942 3032 0 602087 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=2282060 CPUtime=3350.24 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2326031 0 0 0 334774 250 0 0 20 0 3 0 195044425 2550468608 571209 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=2284504 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 771 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 571209 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3391.24 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2284836 KiB

[startup+3462.3 s]
/proc/loadavg: 4.11 4.17 4.17 5/249 1040793
/proc/meminfo: memFree=119179704/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2288616 CPUtime=3451.08 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2606921 0 0 0 344797 311 0 0 20 0 3 0 195040358 2550468608 572154 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 572154 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=2282060 CPUtime=3410.08 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2329123 0 0 0 340758 250 0 0 20 0 3 0 195044425 2550468608 572154 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=2288416 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 784 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 572154 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3451.08 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2288616 KiB

[startup+3522.3 s]
/proc/loadavg: 4.43 4.23 4.19 5/249 1040803
/proc/meminfo: memFree=119178844/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2289092 CPUtime=3510.9 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2609611 0 0 0 350779 311 0 0 20 0 3 0 195040358 2550468608 572273 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 572273 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=2288416 CPUtime=3469.9 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2331802 0 0 0 346740 250 0 0 20 0 3 0 195044425 2550468608 572273 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=12740 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 795 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 572273 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3510.9 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2289092 KiB

[startup+3582.3 s]
/proc/loadavg: 4.64 4.35 4.23 5/249 1040814
/proc/meminfo: memFree=119173704/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3570.7 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2611481 0 0 0 356758 312 0 0 20 0 3 0 195040358 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 573430 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=12740 CPUtime=3529.7 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2333660 0 0 0 352719 251 0 0 20 0 3 0 195044425 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=2268 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 807 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3570.7 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2293720 KiB

[startup+3601.56 s]
# the end of solver process 1038893 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3586.65 s, system=3.24725 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.67 4.36 4.24 5/249 1040815
/proc/meminfo: memFree=119173652/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3572.4 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2611481 0 0 0 356928 312 0 0 20 0 3 0 195040358 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 573430 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=-7383225827200243043 CPUtime=3531.41 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2333660 0 0 0 352890 251 0 0 20 0 3 0 195044425 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=1471338356517208193 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 807 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3572.4 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2293720 KiB

[startup+3590.4 s]
/proc/loadavg: 4.53 4.34 4.23 4/234 1040866
/proc/meminfo: memFree=119820936/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3578.77 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2611494 0 0 0 357565 312 0 0 20 0 3 0 195040358 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 573430 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=12740 CPUtime=3537.77 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2333671 0 0 0 353526 251 0 0 20 0 3 0 195044425 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 809 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3578.77 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2293720 KiB

[startup+3596.8 s]
/proc/loadavg: 4.33 4.30 4.22 3/231 1040879
/proc/meminfo: memFree=119850732/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3585.15 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2611502 0 0 0 358203 312 0 0 20 0 3 0 195040358 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 573430 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3544.15 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2333676 0 0 0 354164 251 0 0 20 0 3 0 195044425 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=5624 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 812 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3585.15 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2293720 KiB

[startup+3600 s]*
/proc/loadavg: 4.14 4.26 4.21 3/231 1040879
/proc/meminfo: memFree=119850732/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2490692 memory=2293720 CPUtime=3588.35 cores=5,7
/proc/1038893/stat : 1038893 (fscip) S 1038890 1038893 1033539 0 -1 1077936128 2611514 0 0 0 358523 312 0 0 20 0 3 0 195040358 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 622673 573430 2942 3032 0 602094 0
[pid=1038893/tid=1038905] ppid=1038890 vsize=2490692 memory=-7383225827200243043 CPUtime=3547.35 cores=5,7
/proc/1038893/task/1038905/stat : 1038905 (fscip) R 1038890 1038893 1033539 0 -1 4194368 2333687 0 0 0 354484 251 0 0 20 0 3 0 195044425 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2490692 memory=1471338356517208193 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 813 0 0 0 2 4 0 0 20 0 3 0 195044526 2550468608 573430 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3588.35 s
Current children cumulated vsize: 2490692 KiB
Current children cumulated memory: 2293720 KiB

[startup+3600.8 s]
/proc/loadavg: 4.14 4.26 4.21 3/231 1040879
/proc/meminfo: memFree=119850732/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2190952 memory=2049684 CPUtime=3589.13 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 2690332 0 0 0 358596 317 0 0 20 0 2 0 195040358 2243534848 512421 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 547738 512421 2990 3032 0 536218 0
[pid=1038893/tid=1038906] ppid=1038890 vsize=2190952 memory=2293720 CPUtime=0.06 cores=5,7
/proc/1038893/task/1038906/stat : 1038906 (fscip) S 1038890 1038893 1033539 0 -1 1077936192 813 0 0 0 2 4 0 0 20 0 2 0 195044526 2243534848 512421 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
Current children cumulated CPU time: 3589.13 s
Current children cumulated vsize: 2190952 KiB
Current children cumulated memory: 2049684 KiB

[startup+3601.2 s]
/proc/loadavg: 4.14 4.26 4.21 3/230 1040879
/proc/meminfo: memFree=120097208/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2187856 memory=2046832 CPUtime=3589.53 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 2691474 0 0 0 358636 317 0 0 20 0 1 0 195040358 2240364544 511708 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 546964 511708 2990 3032 0 535444 0
Current children cumulated CPU time: 3589.53 s
Current children cumulated vsize: 2187856 KiB
Current children cumulated memory: 2046832 KiB

[startup+3601.4 s]
/proc/loadavg: 4.14 4.26 4.21 3/230 1040879
/proc/meminfo: memFree=120097208/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=2127560 memory=1987116 CPUtime=3589.73 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 2707288 0 0 0 358654 319 0 0 20 0 1 0 195040358 2178621440 496779 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 531890 496779 2990 3032 0 520370 0
Current children cumulated CPU time: 3589.73 s
Current children cumulated vsize: 2127560 KiB
Current children cumulated memory: 1987116 KiB

[startup+3601.5 s]
/proc/loadavg: 4.14 4.26 4.21 3/230 1040879
/proc/meminfo: memFree=120097208/131655788 swapFree=131071996/131071996
[pid=1038893] ppid=1038890 vsize=1983176 memory=1842752 CPUtime=3589.83 cores=5,7
/proc/1038893/stat : 1038893 (fscip) R 1038890 1038893 1033539 0 -1 4194304 2728039 0 0 0 358662 321 0 0 20 0 1 0 195040358 2030772224 460688 134679101440 4194304 16613245 140733166283040 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 47501312 140733166289939 140733166290055 140733166290055 140733166297072 0
/proc/1038893/statm: 495794 460688 2990 3032 0 484274 0
Current children cumulated CPU time: 3589.83 s
Current children cumulated vsize: 1983176 KiB
Current children cumulated memory: 1842752 KiB

Child status: 0

Real time (s): 3601.56
CPU time (s): 3589.9
CPU user time (s): 3586.65
CPU system time (s): 3.24725
CPU usage (%): 99.6762
Max. virtual memory (cumulated for all children) (KiB): 2490692
Max. memory (cumulated for all children) (KiB): 2293720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3586.65
system time used= 3.24725
maximum resident set size= 2293720
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2734840
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3607
involuntary context switches= 2448


# summary of solver processes directly reported to runsolver:
#   pid: 1038893
#   total CPU time (s): 3589.9
#   total CPU user time (s): 3586.65
#   total CPU system time (s): 3.24725

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 18.0917 second user time and 35.1646 second system time

The end

Launcher Data

Begin job on nodeC005 at 2024-07-20 00:40:27
IDJOB=4452190
IDBENCH=163951
IDSOLVER=3064
FILE ID=nodeC005/4452190-1721428816
RUNJOBID= nodeC005-1721421610-1033552
SLURM_JOB_ID= 7545501
Free space on /tmp= 723692 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/miplib2003/normalized-stp3d.0.s.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452190-1721428816/watcher-4452190-1721428816 -o /tmp/evaluation-result-4452190-1721428816/solver-4452190-1721428816 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC005-1721421610-1033552 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4452190-1721428816.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 3669957ef10a08034abaee305bfecedd
RANDOM SEED=101758795

nodeC005.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3671.884
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3673.493
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.359
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.200
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3635.436
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 2960.639
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.199
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1267.239
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        123357068 kB
MemAvailable:   128890640 kB
Buffers:          543380 kB
Cached:          5771092 kB
SwapCached:            0 kB
Active:          1147436 kB
Inactive:        6449412 kB
Active(anon):       3456 kB
Inactive(anon):  1324484 kB
Active(file):    1143980 kB
Inactive(file):  5124928 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             94148 kB
Writeback:            12 kB
AnonPages:       1273828 kB
Mapped:           143812 kB
Shmem:             45896 kB
KReclaimable:     209724 kB
Slab:             329356 kB
SReclaimable:     209724 kB
SUnreclaim:       119632 kB
KernelStack:        3980 kB
PageTables:        12152 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:     934480 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            61568 kB
HardwareCorrupted:     0 kB
AnonHugePages:    919552 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      285512 kB
DirectMap2M:    36319232 kB
DirectMap1G:    99614720 kB

Free space on /tmp at the end= 723712 MiB
End job on nodeC005 at 2024-07-20 01:40:29