Trace number 4446470

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3591.83 3602.54

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K134.opb
MD5SUM963edb3c79c326322e0bda3e585d3232
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables15946
Total number of constraints16216
Number of constraints which are clauses16082
Number of constraints which are cardinality constraints (but not clauses)134
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint134
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 135
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.00/0.09	c Default LC presolving (default).
0.00/0.09	c ** Before presolving: virtualMemUsedAtLc = 95806094, getVmSize() = 88551424, SCIPgetMemUsed() = 57549881, SCIPgetMemTotal() = 64819961, SCIPgetMemExternEstim() = 30986133
0.00/0.09	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
20.72/20.86	c ** Estimated virtualMemUsedAtSolver = 194786401, getVmSize() = 292814848, SCIPgetMemUsed() = 193801877, SCIPgetMemTotal() = 261193469, SCIPgetMemExternEstim() = 30986133
20.72/20.86	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
20.72/20.86	c Original Problem   :
20.72/20.86	c   Problem name     : instance-4446470-1721334723
20.72/20.86	c   Variables        : 15946 (15946 binary, 0 integer, 0 implicit integer, 0 continuous)
20.72/20.86	c   Constraints      : 16216
20.72/20.86	c   Objective sense  : minimize
20.72/20.86	c Presolved Problem  :
20.72/20.86	c   Variables        : 14432 (14432 binary, 0 integer, 0 implicit integer, 0 continuous)
20.72/20.86	c   Constraints      : 14680
20.72/20.86	c Constraints        : Number
20.72/20.86	c   setppc           : 1807 
20.72/20.86	c   orbitope         : 1 
20.72/20.86	c   logicor          : 12872 
20.72/20.86	c ** Instance transfer method used: 0
20.83/20.90	c ** ParaScipInstance copy increased the number of variables. **
20.83/20.93	c LC is working with racing ramp-up and with rebuilding tree after racing.
20.83/20.93	c                                Nodes    Active                                            
20.83/20.93	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
714.04/716.10	c       716              2           1         1                -           0.0000          -
740.86/743.09	c       743              5           4         1                -           0.0000          -
769.69/771.98	c       772              6           5         1                -           0.0000          -
780.65/782.90	c       783              7           6         1                -           0.0000          -
804.78/807.12	c       807              8           7         1                -           0.0000          -
826.92/829.35	c       829             10           9         1                -           0.0000          -
854.33/856.82	c       857             12          11         1                -           0.0000          -
860.41/862.90	c       863             13          12         1                -           0.0000          -
1000.94/1003.96	c      1004             14          13         1                -           0.0000          -
1071.51/1074.79	c      1075             15          14         1                -           0.0000          -
1223.31/1227.06	c      1227             17          14         1                -           0.0000          -
1312.30/1316.35	c      1316             18          13         1                -           0.0000          -
1403.91/1408.22	c      1408             19          14         1                -           0.0000          -
2829.07/2837.66	c      2838             20          15         1                -           0.0000          -
2965.41/2974.44	c      2974             22          17         1                -           0.0000          -
3325.66/3335.75	c      3336             23          18         1                -           0.0000          -
3346.61/3356.74	c      3357             25          20         1                -           0.0000          -
3414.91/3425.24	c      3425             26          21         1                -           0.0000          -
3591.58/3602.38	c      3602             26          21         0                -           0.0000          -
3591.68/3602.48	c SCIP Status        : c solving was interrupted [hard time limit reached]
3591.68/3602.48	c Total Time         : 3602.4700
3591.68/3602.48	c   solving          : 3602.4700
3591.68/3602.48	c   presolving       : 20.7711 (included in solving)
3591.68/3602.48	c B&B Tree           :
3591.68/3602.48	c   nodes (total)    : 1
3591.68/3602.48	c Solution           :
3591.68/3602.48	c   Solutions found  : 0
3591.68/3602.48	c   Primal Bound     :          -
3591.68/3602.48	c   Dual Bound       : +0.00000000000000e+00
3591.68/3602.48	c Gap                :          -
3591.78/3602.53	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (54697 MiB free)
  memory of node 1: 64510 MiB (60980 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446470-1721334723/watcher-4446470-1721334723 -o /tmp/evaluation-result-4446470-1721334723/solver-4446470-1721334723 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000263 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446470-1721334723.opb -qsol -t 3600 -sth 1 

running on 2 cores: 1,3

CPU governors:
  performance: 1 3

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1003098, runsolver pid=1003095

[startup+0.100969 s]*
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118386384/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=90420 memory=77272 CPUtime=0.09 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 17089 0 0 0 7 2 0 0 20 0 1 0 185634201 92590080 19318 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 22605 19318 2574 3032 0 19005 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 90420 KiB
Current children cumulated memory: 77272 KiB

[startup+0.205986 s]*
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118363536/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=113408 memory=100332 CPUtime=0.19 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 25087 0 0 0 16 3 0 0 20 0 1 0 185634201 116129792 25083 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 28352 25083 2638 3032 0 24752 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 113408 KiB
Current children cumulated memory: 100332 KiB

[startup+0.305668 s]*
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118363312/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=113408 memory=100332 CPUtime=0.29 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 25089 0 0 0 26 3 0 0 20 0 1 0 185634201 116129792 25083 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 28352 25083 2638 3032 0 24752 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 113408 KiB
Current children cumulated memory: 100332 KiB

[startup+0.700232 s]
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118355892/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=122096 memory=108056 CPUtime=0.68 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 29240 0 0 0 64 4 0 0 20 0 1 0 185634201 125026304 27014 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 30524 27014 2718 3032 0 26924 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 122096 KiB
Current children cumulated memory: 108056 KiB

[startup+1.50024 s]
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118326976/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=157576 memory=141012 CPUtime=1.48 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 36182 0 0 0 143 5 0 0 20 0 1 0 185634201 161357824 35253 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 39394 35253 2734 3032 0 35794 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 157576 KiB
Current children cumulated memory: 141012 KiB

[startup+3.1057 s]
/proc/loadavg: 4.08 4.09 4.07 5/264 1003099
/proc/meminfo: memFree=118322524/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=157576 memory=141012 CPUtime=3.08 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 36182 0 0 0 303 5 0 0 20 0 1 0 185634201 161357824 35253 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 39394 35253 2734 3032 0 35794 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 157576 KiB
Current children cumulated memory: 141012 KiB

[startup+6.30023 s]
/proc/loadavg: 4.07 4.09 4.06 5/264 1003099
/proc/meminfo: memFree=118316968/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=163924 memory=146664 CPUtime=6.26 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 37619 0 0 0 621 5 0 0 20 0 1 0 185634201 167858176 36666 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 40981 36666 2734 3032 0 37381 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 163924 KiB
Current children cumulated memory: 146664 KiB

[startup+12.7002 s]
/proc/loadavg: 4.06 4.09 4.06 5/264 1003100
/proc/meminfo: memFree=118315152/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=165532 memory=148248 CPUtime=12.64 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 38010 0 0 0 1259 5 0 0 20 0 1 0 185634201 169504768 37062 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 41383 37062 2734 3032 0 37783 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 165532 KiB
Current children cumulated memory: 148248 KiB

[startup+25.5003 s]
/proc/loadavg: 4.20 4.11 4.07 5/266 1003104
/proc/meminfo: memFree=118107984/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=455928 memory=352836 CPUtime=25.4 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 107604 0 0 0 2526 14 0 0 20 0 3 0 185634201 466870272 88209 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 113982 88209 2782 3032 0 104826 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=455928 memory=148248 CPUtime=4.56 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 45285 0 0 0 452 4 0 0 20 0 3 0 185636288 466870272 88209 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=455928 memory=146664 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 7 0 0 0 0 0 0 0 20 0 3 0 185636295 466870272 88209 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 455928 KiB
Current children cumulated memory: 352836 KiB

[startup+51.1059 s]
/proc/loadavg: 4.13 4.10 4.07 5/266 1003108
/proc/meminfo: memFree=118059520/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=525088 memory=401340 CPUtime=50.94 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 163992 0 0 0 5076 18 0 0 20 0 3 0 185634201 537690112 100335 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 131272 100335 2926 3032 0 117648 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=525088 memory=45552 CPUtime=30.09 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 101638 0 0 0 3001 8 0 0 20 0 3 0 185636288 537690112 100335 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=525088 memory=129135642 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 42 0 0 0 0 0 0 0 20 0 3 0 185636295 537690112 100335 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 525088 KiB
Current children cumulated memory: 401340 KiB

[startup+102.3 s]
/proc/loadavg: 4.10 4.10 4.07 5/265 1003118
/proc/meminfo: memFree=118030388/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=525088 memory=402424 CPUtime=101.98 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 181633 0 0 0 10179 19 0 0 20 0 3 0 185634201 537690112 100606 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 131272 100606 2926 3032 0 118145 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=525088 memory=11544 CPUtime=81.14 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 119255 0 0 0 8105 9 0 0 20 0 3 0 185636288 537690112 100606 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=525088 memory=402424 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 66 0 0 0 0 0 0 0 20 0 3 0 185636295 537690112 100606 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 525088 KiB
Current children cumulated memory: 402424 KiB

[startup+162.3 s]
/proc/loadavg: 4.14 4.11 4.08 5/264 1003129
/proc/meminfo: memFree=117764936/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=555852 memory=449276 CPUtime=161.81 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 208524 0 0 0 16160 21 0 0 20 0 3 0 185634201 569192448 112319 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 138963 112319 2942 3032 0 130289 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=555852 memory=164 CPUtime=140.97 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 146132 0 0 0 14085 12 0 0 20 0 3 0 185636288 569192448 112319 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=555852 memory=11544 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 80 0 0 0 0 0 0 0 20 0 3 0 185636295 569192448 112319 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 161.81 s
Current children cumulated vsize: 555852 KiB
Current children cumulated memory: 449276 KiB

[startup+222.3 s]
/proc/loadavg: 4.10 4.11 4.08 5/264 1003140
/proc/meminfo: memFree=117728648/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=556024 memory=466252 CPUtime=221.63 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 245516 0 0 0 22140 23 0 0 20 0 3 0 185634201 569368576 116563 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 139006 116563 2942 3032 0 134598 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=556024 memory=466240 CPUtime=200.79 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 183113 0 0 0 20065 14 0 0 20 0 3 0 185636288 569368576 116563 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=556024 memory=466252 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 91 0 0 0 0 0 0 0 20 0 3 0 185636295 569368576 116563 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 221.63 s
Current children cumulated vsize: 556024 KiB
Current children cumulated memory: 466252 KiB

[startup+282.3 s]
/proc/loadavg: 4.15 4.12 4.08 5/263 1003150
/proc/meminfo: memFree=117715744/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=621560 memory=478680 CPUtime=281.46 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 282856 0 0 0 28121 25 0 0 20 0 3 0 185634201 636477440 119670 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 155390 119670 2942 3032 0 138253 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=621560 memory=477636 CPUtime=260.63 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 220446 0 0 0 26047 16 0 0 20 0 3 0 185636288 636477440 119670 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=621560 memory=477636 CPUtime=0 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 98 0 0 0 0 0 0 0 20 0 3 0 185636295 636477440 119670 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 281.46 s
Current children cumulated vsize: 621560 KiB
Current children cumulated memory: 478680 KiB

[startup+342.3 s]
/proc/loadavg: 4.12 4.11 4.08 5/263 1003161

################
# More data... #
################

[pid=1003098] ppid=1003095 vsize=688036 memory=621808 CPUtime=3451.93 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1062794 0 0 0 345115 78 0 0 20 0 3 0 185634201 704548864 155452 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 155452 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=5472 CPUtime=3431.04 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 999726 0 0 0 343039 65 0 0 20 0 3 0 185636288 704548864 155452 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=615628 CPUtime=0.03 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 454 0 0 0 1 2 0 0 20 0 3 0 185636295 704548864 155452 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3451.93 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 621808 KiB

[startup+3522.3 s]
/proc/loadavg: 4.10 4.10 4.09 5/269 1005070
/proc/meminfo: memFree=124724444/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629796 CPUtime=3511.78 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1063471 0 0 0 351100 78 0 0 20 0 3 0 185634201 704548864 157449 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157449 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=629796 CPUtime=3490.89 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1000397 0 0 0 349024 65 0 0 20 0 3 0 185636288 704548864 157449 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=629524 CPUtime=0.03 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 460 0 0 0 1 2 0 0 20 0 3 0 185636295 704548864 157449 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3511.78 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629796 KiB

[startup+3582.3 s]
/proc/loadavg: 4.08 4.09 4.09 5/269 1005081
/proc/meminfo: memFree=124695096/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3571.63 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064432 0 0 0 357085 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=11544 CPUtime=3550.74 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001352 0 0 0 355009 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=629812 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3571.63 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3602.54 s]
# the end of solver process 1003098 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3591.04 s, system=0.786622 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.08 4.09 4.09 5/269 1005081
/proc/meminfo: memFree=124695088/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3573.33 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064432 0 0 0 357255 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=-7952647673543353212 CPUtime=3552.44 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001352 0 0 0 355179 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=-9187040416277887686 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3573.33 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3590.4 s]
/proc/loadavg: 4.07 4.09 4.09 5/269 1005082
/proc/meminfo: memFree=124693568/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3579.71 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064432 0 0 0 357893 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=629812 CPUtime=3558.82 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001352 0 0 0 355817 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=629812 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3579.71 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3596.8 s]
/proc/loadavg: 4.15 4.10 4.09 5/269 1005082
/proc/meminfo: memFree=124693428/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3586.09 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064434 0 0 0 358531 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=13196 CPUtime=3565.2 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001354 0 0 0 356455 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=45552 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3586.09 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3600 s]*
/proc/loadavg: 4.13 4.10 4.09 5/269 1005084
/proc/meminfo: memFree=124692548/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3589.29 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064434 0 0 0 358851 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=-7952647673543353212 CPUtime=3568.4 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001354 0 0 0 356775 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=-9187040416277887686 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3589.29 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3601.6 s]
/proc/loadavg: 4.13 4.10 4.09 5/269 1005084
/proc/meminfo: memFree=124692548/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3590.88 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064434 0 0 0 359010 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=629812 CPUtime=3569.99 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001354 0 0 0 356934 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=629812 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3590.88 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3602 s]*
/proc/loadavg: 4.13 4.10 4.09 5/269 1005084
/proc/meminfo: memFree=124692044/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=688036 memory=629812 CPUtime=3591.29 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064435 0 0 0 359051 78 0 0 20 0 3 0 185634201 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 172009 157453 3310 3032 0 164247 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=688036 memory=-7952647673543353212 CPUtime=3570.39 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001355 0 0 0 356974 65 0 0 20 0 3 0 185636288 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=688036 memory=-9187040416277887686 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 704548864 157453 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3591.29 s
Current children cumulated vsize: 688036 KiB
Current children cumulated memory: 629812 KiB

[startup+3602.4 s]
/proc/loadavg: 4.13 4.10 4.09 5/269 1005084
/proc/meminfo: memFree=124692044/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=657444 memory=599220 CPUtime=3591.68 cores=1,3
/proc/1003098/stat : 1003098 (fscip) S 1003095 1003098 1000251 0 -1 1077936128 1064779 0 0 0 359090 78 0 0 20 0 3 0 185634201 673222656 149805 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 164361 149805 3310 3032 0 156599 0
[pid=1003098/tid=1003103] ppid=1003095 vsize=657444 memory=2320 CPUtime=3570.79 cores=1,3
/proc/1003098/task/1003103/stat : 1003103 (fscip) R 1003095 1003098 1000251 0 -1 4194368 1001686 0 0 0 357014 65 0 0 20 0 3 0 185636288 673222656 149805 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=657444 memory=-7384917975595062633 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 185636295 673222656 149805 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3591.68 s
Current children cumulated vsize: 657444 KiB
Current children cumulated memory: 599220 KiB

[startup+3602.5 s]
/proc/loadavg: 4.13 4.10 4.09 5/269 1005084
/proc/meminfo: memFree=124692044/131524600 swapFree=131071996/131071996
[pid=1003098] ppid=1003095 vsize=653320 memory=593596 CPUtime=3591.78 cores=1,3
/proc/1003098/stat : 1003098 (fscip) R 1003095 1003098 1000251 0 -1 4194304 1066110 0 0 0 359100 78 0 0 20 0 2 0 185634201 668999680 148399 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
/proc/1003098/statm: 163330 148399 3310 3032 0 155568 0
[pid=1003098/tid=1003104] ppid=1003095 vsize=653320 memory=629812 CPUtime=0.04 cores=1,3
/proc/1003098/task/1003104/stat : 1003104 (fscip) S 1003095 1003098 1000251 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 2 0 185636295 668999680 148399 134679101440 4194304 16613245 140725700970096 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 47828992 140725700977683 140725700977799 140725700977799 140725700984816 0
Current children cumulated CPU time: 3591.78 s
Current children cumulated vsize: 653320 KiB
Current children cumulated memory: 593596 KiB

Child status: 0

Real time (s): 3602.54
CPU time (s): 3591.83
CPU user time (s): 3591.04
CPU system time (s): 0.786622
CPU usage (%): 99.7027
Max. virtual memory (cumulated for all children) (KiB): 688036
Max. memory (cumulated for all children) (KiB): 629812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3591.04
system time used= 0.786622
maximum resident set size= 629812
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1066517
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3654
involuntary context switches= 1537


# summary of solver processes directly reported to runsolver:
#   pid: 1003098
#   total CPU time (s): 3591.83
#   total CPU user time (s): 3591.04
#   total CPU system time (s): 0.786622

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.43824 second user time and 17.4267 second system time

The end

Launcher Data 

Begin job on nodeC017 at 2024-07-18 22:32:16
IDJOB=4446470
IDBENCH=158262
IDSOLVER=3064
FILE ID=nodeC017/4446470-1721334723
RUNJOBID= nodeC017-1721330666-1000263
SLURM_JOB_ID= 7542711
Free space on /tmp= 889948 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K134.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446470-1721334723/watcher-4446470-1721334723 -o /tmp/evaluation-result-4446470-1721334723/solver-4446470-1721334723 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000263 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446470-1721334723.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 963edb3c79c326322e0bda3e585d3232
RANDOM SEED=567774999

nodeC017.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.423
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3676.449
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.767
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.808
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3672.781
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3673.126
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.048
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.153
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        118454320 kB
MemAvailable:   121035432 kB
Buffers:          538168 kB
Cached:          2860160 kB
SwapCached:            0 kB
Active:          1268740 kB
Inactive:       11131228 kB
Active(anon):       1544 kB
Inactive(anon):  9037820 kB
Active(file):    1267196 kB
Inactive(file):  2093408 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29228 kB
Writeback:             0 kB
AnonPages:       8999128 kB
Mapped:           142020 kB
Shmem:             37720 kB
KReclaimable:     120308 kB
Slab:             234396 kB
SReclaimable:     120308 kB
SUnreclaim:       114088 kB
KernelStack:        4208 kB
PageTables:        27688 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    6260564 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68192 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2660352 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      287444 kB
DirectMap2M:    40380416 kB
DirectMap1G:    95420416 kB

Free space on /tmp at the end= 889964 MiB
End job on nodeC017 at 2024-07-18 23:32:19