Trace number 4446680

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3591.07 3600.2

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K165.opb
MD5SUM75fbe782de7ac9ce41dec078153ff02c
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark179.209
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables19635
Total number of constraints19967
Number of constraints which are clauses19802
Number of constraints which are cardinality constraints (but not clauses)165
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint165
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 166
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.13	c Default LC presolving (default).
0.09/0.13	c ** Before presolving: virtualMemUsedAtLc = 115805807, getVmSize() = 101539840, SCIPgetMemUsed() = 70250701, SCIPgetMemTotal() = 77648069, SCIPgetMemExternEstim() = 38157738
0.09/0.13	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
50.24/50.49	c ** Estimated virtualMemUsedAtSolver = 239330253, getVmSize() = 353763328, SCIPgetMemUsed() = 242509322, SCIPgetMemTotal() = 320837642, SCIPgetMemExternEstim() = 38157738
50.24/50.49	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
50.24/50.49	c Original Problem   :
50.24/50.49	c   Problem name     : instance-4446680-1721340559
50.24/50.49	c   Variables        : 19635 (19635 binary, 0 integer, 0 implicit integer, 0 continuous)
50.24/50.49	c   Constraints      : 19967
50.24/50.49	c   Objective sense  : minimize
50.24/50.49	c Presolved Problem  :
50.24/50.49	c   Variables        : 18092 (18092 binary, 0 integer, 0 implicit integer, 0 continuous)
50.24/50.49	c   Constraints      : 18371
50.24/50.49	c Constraints        : Number
50.24/50.49	c   setppc           : 2242 
50.24/50.49	c   orbitope         : 1 
50.24/50.49	c   logicor          : 16128 
50.24/50.49	c ** Instance transfer method used: 0
50.34/50.53	c ** ParaScipInstance copy increased the number of variables. **
50.34/50.58	c LC is working with racing ramp-up and with rebuilding tree after racing.
50.34/50.58	c                                Nodes    Active                                            
50.34/50.58	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1205.43/1208.74	c      1209              2           1         1                -           0.0000          -
1239.54/1242.91	c      1243              3           0         1                -           0.0000          -
1248.42/1251.82	c      1252              4           1         1                -           0.0000          -
1281.65/1285.17	c      1285              6           1         1                -           0.0000          -
1287.54/1291.01	c      1291              7           2         1                -           0.0000          -
1317.95/1321.57	c      1322              8           3         1                -           0.0000          -
1323.94/1327.57	c      1328              9           4         1                -           0.0000          -
1347.49/1351.12	c      1351             10           5         1                -           0.0000          -
1353.27/1356.96	c      1357             11           6         1                -           0.0000          -
1379.50/1383.20	c      1383             12           7         1                -           0.0000          -
1388.57/1392.39	c      1392             13           8         1                -           0.0000          -
1418.20/1422.01	c      1422             14           9         1                -           0.0000          -
1475.95/1479.94	c      1480             17          10         1                -           0.0000          -
2346.13/2352.31	c      2352             18           9         1                -           0.0000          -
3590.87/3600.01	c      3600             18           9         0                -           0.0000          -
3590.97/3600.12	c SCIP Status        : c solving was interrupted [hard time limit reached]
3590.97/3600.12	c Total Time         : 3600.1200
3590.97/3600.12	c   solving          : 3600.1200
3590.97/3600.12	c   presolving       : 50.3550 (included in solving)
3590.97/3600.12	c B&B Tree           :
3590.97/3600.12	c   nodes (total)    : 1
3590.97/3600.12	c Solution           :
3590.97/3600.12	c   Solutions found  : 0
3590.97/3600.12	c   Primal Bound     :          -
3590.97/3600.12	c   Dual Bound       : +0.00000000000000e+00
3590.97/3600.12	c Gap                :          -
3590.97/3600.19	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (62136 MiB free)
  memory of node 1: 64510 MiB (63335 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446680-1721340559/watcher-4446680-1721340559 -o /tmp/evaluation-result-4446680-1721340559/solver-4446680-1721340559 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC015-1721340572-980431 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446680-1721340559.opb -qsol -t 3600 -sth 1 

running on 2 cores: 5,7

CPU governors:
  performance: 5 7

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=980489, runsolver pid=980475

[startup+0.100435 s]*
/proc/loadavg: 1.08 1.20 2.13 9/260 980492
/proc/meminfo: memFree=128232244/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=82568 memory=72308 CPUtime=0.09 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 15858 0 0 0 7 2 0 0 20 0 1 0 186216174 84549632 18077 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 20642 18077 2542 3032 0 17042 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 82568 KiB
Current children cumulated memory: 72308 KiB

[startup+0.206632 s]*
/proc/loadavg: 1.08 1.20 2.13 6/260 980492
/proc/meminfo: memFree=128143360/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=111364 memory=94788 CPUtime=0.2 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 21497 0 0 0 16 4 0 0 20 0 1 0 186216174 114036736 23697 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 27841 23697 2590 3032 0 24241 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 111364 KiB
Current children cumulated memory: 94788 KiB

[startup+0.307114 s]*
/proc/loadavg: 1.08 1.20 2.13 8/260 980492
/proc/meminfo: memFree=128073808/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=132756 memory=119356 CPUtime=0.3 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 28847 0 0 0 25 5 0 0 20 0 1 0 186216174 135942144 29839 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 33189 29839 2654 3032 0 29589 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 132756 KiB
Current children cumulated memory: 119356 KiB

[startup+0.700244 s]
/proc/loadavg: 1.08 1.20 2.13 8/260 980492
/proc/meminfo: memFree=128074724/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=140968 memory=127860 CPUtime=0.68 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 33202 0 0 0 62 6 0 0 20 0 1 0 186216174 144351232 31965 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 35242 31965 2686 3032 0 31642 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 140968 KiB
Current children cumulated memory: 127860 KiB

[startup+1.50024 s]
/proc/loadavg: 1.31 1.25 2.14 8/260 980492
/proc/meminfo: memFree=128002980/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=181364 memory=165868 CPUtime=1.48 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 41980 0 0 0 141 7 0 0 20 0 1 0 186216174 185716736 41467 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 45341 41467 2734 3032 0 41741 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 181364 KiB
Current children cumulated memory: 165868 KiB

[startup+3.10668 s]
/proc/loadavg: 1.31 1.25 2.14 8/260 980494
/proc/meminfo: memFree=127877080/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=185372 memory=169560 CPUtime=3.08 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 42925 0 0 0 301 7 0 0 20 0 1 0 186216174 189820928 42390 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 46343 42390 2734 3032 0 42743 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 185372 KiB
Current children cumulated memory: 169560 KiB

[startup+6.30023 s]
/proc/loadavg: 1.53 1.30 2.15 8/260 980494
/proc/meminfo: memFree=127868648/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=188632 memory=172720 CPUtime=6.27 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 43739 0 0 0 619 8 0 0 20 0 1 0 186216174 193159168 43180 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 47158 43180 2734 3032 0 43558 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 188632 KiB
Current children cumulated memory: 172720 KiB

[startup+12.7002 s]
/proc/loadavg: 1.72 1.34 2.16 8/260 980495
/proc/meminfo: memFree=127849064/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=193592 memory=177752 CPUtime=12.65 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 45043 0 0 0 1257 8 0 0 20 0 1 0 186216174 198238208 44438 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 48398 44438 2734 3032 0 44798 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 193592 KiB
Current children cumulated memory: 177752 KiB

[startup+25.5002 s]
/proc/loadavg: 2.16 1.44 2.19 8/260 980497
/proc/meminfo: memFree=127844792/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=194880 memory=179064 CPUtime=25.41 cores=5,7
/proc/980489/stat : 980489 (fscip) R 980475 980489 980418 0 -1 4194304 45390 0 0 0 2533 8 0 0 20 0 1 0 186216174 199557120 44766 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 48720 44766 2734 3032 0 45120 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 194880 KiB
Current children cumulated memory: 179064 KiB

[startup+51.1074 s]
/proc/loadavg: 3.00 1.72 2.26 9/271 980799
/proc/meminfo: memFree=126908528/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=524040 memory=421708 CPUtime=50.94 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 105605 0 0 0 5077 17 0 0 20 0 3 0 186216174 536616960 105427 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 131010 105427 2782 3032 0 124715 0
[pid=980489/tid=980798] ppid=980475 vsize=524040 memory=180104 CPUtime=0.55 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 29130 0 0 0 51 4 0 0 20 0 3 0 186221223 536616960 105427 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=524040 memory=180104 CPUtime=0 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 3 0 186221233 536616960 105427 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 524040 KiB
Current children cumulated memory: 421708 KiB

[startup+102.3 s]
/proc/loadavg: 3.61 2.09 2.36 8/271 980810
/proc/meminfo: memFree=126699720/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=589916 memory=495212 CPUtime=101.98 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 228570 0 0 0 10172 26 0 0 20 0 3 0 186216174 604073984 123803 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 147479 123803 2926 3032 0 143707 0
[pid=980489/tid=980798] ppid=980475 vsize=589916 memory=0 CPUtime=51.59 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 152040 0 0 0 5146 13 0 0 20 0 3 0 186221223 604073984 123803 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=589916 memory=279595123714704 CPUtime=0 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 55 0 0 0 0 0 0 0 20 0 3 0 186221233 604073984 123803 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 589916 KiB
Current children cumulated memory: 495212 KiB

[startup+162.3 s]
/proc/loadavg: 3.97 2.47 2.47 8/271 980820
/proc/meminfo: memFree=126671812/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=593552 memory=497388 CPUtime=161.81 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 246527 0 0 0 16154 27 0 0 20 0 3 0 186216174 607797248 124347 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 148388 124347 2926 3032 0 144616 0
[pid=980489/tid=980798] ppid=980475 vsize=593552 memory=11400 CPUtime=111.42 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 169980 0 0 0 11128 14 0 0 20 0 3 0 186221223 607797248 124347 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=593552 memory=497020 CPUtime=0 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 72 0 0 0 0 0 0 0 20 0 3 0 186221233 607797248 124347 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 161.81 s
Current children cumulated vsize: 593552 KiB
Current children cumulated memory: 497388 KiB

[startup+222.3 s]
/proc/loadavg: 3.99 2.75 2.57 8/268 980831
/proc/meminfo: memFree=126590720/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=598516 memory=501568 CPUtime=221.65 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 259600 0 0 0 22137 28 0 0 20 0 3 0 186216174 612880384 125392 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 149629 125392 2926 3032 0 145964 0
[pid=980489/tid=980798] ppid=980475 vsize=598516 memory=497516 CPUtime=171.26 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 183039 0 0 0 17111 15 0 0 20 0 3 0 186221223 612880384 125392 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=598516 memory=11400 CPUtime=0 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 86 0 0 0 0 0 0 0 20 0 3 0 186221233 612880384 125392 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 221.65 s
Current children cumulated vsize: 598516 KiB
Current children cumulated memory: 501568 KiB

[startup+282.3 s]
/proc/loadavg: 4.11 3.01 2.67 8/267 980842
/proc/meminfo: memFree=126453400/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=598516 memory=501572 CPUtime=281.49 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 270752 0 0 0 28120 29 0 0 20 0 3 0 186216174 612880384 125393 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 149629 125393 2926 3032 0 145964 0
[pid=980489/tid=980798] ppid=980475 vsize=598516 memory=11400 CPUtime=231.09 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 194184 0 0 0 23094 15 0 0 20 0 3 0 186221223 612880384 125393 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=598516 memory=501572 CPUtime=0 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 93 0 0 0 0 0 0 0 20 0 3 0 186221233 612880384 125393 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 281.49 s
Current children cumulated vsize: 598516 KiB
Current children cumulated memory: 501572 KiB

[startup+342.3 s]
/proc/loadavg: 4.10 3.21 2.76 8/264 980853
/proc/meminfo: memFree=126336820/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=712048 memory=577056 CPUtime=341.33 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 304830 0 0 0 34101 32 0 0 20 0 3 0 186216174 729137152 144264 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 178012 144264 2942 3032 0 165574 0

################
# More data... #
################

/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=751532 CPUtime=3403.05 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 601021 0 0 0 340257 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=751532 CPUtime=0.03 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 461 0 0 0 1 2 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3453.48 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3522.3 s]
/proc/loadavg: 4.28 4.32 4.19 8/262 982618
/proc/meminfo: memFree=125576232/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3513.34 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 678595 0 0 0 351269 65 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=751532 CPUtime=3462.9 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 601537 0 0 0 346242 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=11400 CPUtime=0.03 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 468 0 0 0 1 2 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3513.34 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3582.3 s]
/proc/loadavg: 4.15 4.28 4.18 8/262 982628
/proc/meminfo: memFree=125575536/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3573.21 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679113 0 0 0 357255 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=751532 CPUtime=3522.76 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602048 0 0 0 352228 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=16160 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3573.21 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3600.2 s]
# the end of solver process 980489 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3590.39 s, system=0.673064 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.15 4.28 4.18 8/262 982628
/proc/meminfo: memFree=125575508/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3574.91 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679113 0 0 0 357425 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=8508281403248053407 CPUtime=3524.47 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602048 0 0 0 352399 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=-9033800158172978549 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3574.91 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3590.4 s]
/proc/loadavg: 4.14 4.27 4.18 8/262 982628
/proc/meminfo: memFree=125575516/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3581.29 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679113 0 0 0 358063 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=11400 CPUtime=3530.84 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602048 0 0 0 353036 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=44432 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3581.29 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3596.8 s]
/proc/loadavg: 4.13 4.27 4.18 8/262 982630
/proc/meminfo: memFree=125575492/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3587.67 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679113 0 0 0 358701 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=2248 CPUtime=3537.23 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602048 0 0 0 353675 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=5448 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3587.67 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3598.4 s]
/proc/loadavg: 4.20 4.28 4.18 8/262 982630
/proc/meminfo: memFree=125575476/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3589.27 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679113 0 0 0 358861 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=12740 CPUtime=3538.82 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602048 0 0 0 353834 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=751532 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3589.27 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3599.2 s]
/proc/loadavg: 4.20 4.28 4.18 8/262 982630
/proc/meminfo: memFree=125575492/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3590.06 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679114 0 0 0 358940 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=11400 CPUtime=3539.62 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602049 0 0 0 353914 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=44432 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3590.06 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3599.6 s]
/proc/loadavg: 4.20 4.28 4.18 8/262 982630
/proc/meminfo: memFree=125575492/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3590.46 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679114 0 0 0 358980 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=1904 CPUtime=3540.02 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602049 0 0 0 353954 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=11400 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3590.46 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3600 s]*
/proc/loadavg: 4.20 4.28 4.18 8/262 982630
/proc/meminfo: memFree=125575484/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=843264 memory=751532 CPUtime=3590.87 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679114 0 0 0 359021 66 0 0 20 0 3 0 186216174 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 210816 187883 3310 3032 0 198955 0
[pid=980489/tid=980798] ppid=980475 vsize=843264 memory=6720665458640437874 CPUtime=3540.43 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602049 0 0 0 353995 48 0 0 20 0 3 0 186221223 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=843264 memory=-7592636480274063739 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 863502336 187883 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3590.87 s
Current children cumulated vsize: 843264 KiB
Current children cumulated memory: 751532 KiB

[startup+3600.11 s]
/proc/loadavg: 4.20 4.28 4.18 8/262 982630
/proc/meminfo: memFree=125575484/131524600 swapFree=131071996/131071996
[pid=980489] ppid=980475 vsize=790304 memory=699948 CPUtime=3590.97 cores=5,7
/proc/980489/stat : 980489 (fscip) S 980475 980489 980418 0 -1 1077936128 679897 0 0 0 359031 66 0 0 20 0 3 0 186216174 809271296 174987 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 17 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
/proc/980489/statm: 197576 174987 3310 3032 0 185715 0
[pid=980489/tid=980798] ppid=980475 vsize=790304 memory=751532 CPUtime=3540.53 cores=5,7
/proc/980489/task/980798/stat : 980798 (fscip) R 980475 980489 980418 0 -1 4194368 602817 0 0 0 354005 48 0 0 20 0 3 0 186221223 809271296 174987 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 0 0 0 -1 5 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
[pid=980489/tid=980799] ppid=980475 vsize=790304 memory=16160 CPUtime=0.04 cores=5,7
/proc/980489/task/980799/stat : 980799 (fscip) S 980475 980489 980418 0 -1 1077936192 475 0 0 0 1 3 0 0 20 0 3 0 186221233 809271296 174987 134679101440 4194304 16613245 140737333264208 0 0 0 0 0 2 1 0 0 -1 7 0 0 0 0 0 18822208 18930672 45641728 140737333269524 140737333269640 140737333269640 140737333276656 0
Current children cumulated CPU time: 3590.97 s
Current children cumulated vsize: 790304 KiB
Current children cumulated memory: 699948 KiB

Child status: 0

Real time (s): 3600.2
CPU time (s): 3591.07
CPU user time (s): 3590.39
CPU system time (s): 0.673064
CPU usage (%): 99.7464
Max. virtual memory (cumulated for all children) (KiB): 843264
Max. memory (cumulated for all children) (KiB): 751532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3590.39
system time used= 0.673064
maximum resident set size= 755100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 683487
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3608
involuntary context switches= 3014


# summary of solver processes directly reported to runsolver:
#   pid: 980489
#   total CPU time (s): 3591.07
#   total CPU user time (s): 3590.39
#   total CPU system time (s): 0.673064

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.40991 second user time and 20.7594 second system time

The end

Launcher Data

Begin job on nodeC015 at 2024-07-19 00:09:32
IDJOB=4446680
IDBENCH=158290
IDSOLVER=3064
FILE ID=nodeC015/4446680-1721340559
RUNJOBID= nodeC015-1721340572-980431
SLURM_JOB_ID= 7542724
Free space on /tmp= 890080 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K165.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446680-1721340559/watcher-4446680-1721340559 -o /tmp/evaluation-result-4446680-1721340559/solver-4446680-1721340559 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC015-1721340572-980431 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446680-1721340559.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 75fbe782de7ac9ce41dec078153ff02c
RANDOM SEED=22247647

nodeC015.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3797.473
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3853.237
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.25
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3710.445
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.230
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.25
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3703.760
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3611.684
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.25
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3727.270
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3745.741
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.25
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        128484468 kB
MemAvailable:   129674344 kB
Buffers:          506884 kB
Cached:          1510364 kB
SwapCached:            0 kB
Active:          1640624 kB
Inactive:         766452 kB
Active(anon):       1476 kB
Inactive(anon):   426388 kB
Active(file):    1639148 kB
Inactive(file):   340064 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            116536 kB
Writeback:             0 kB
AnonPages:        388408 kB
Mapped:           106996 kB
Shmem:             37720 kB
KReclaimable:     100620 kB
Slab:             213016 kB
SReclaimable:     100620 kB
SUnreclaim:       112396 kB
KernelStack:        3920 kB
PageTables:        10260 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     768208 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68224 kB
HardwareCorrupted:     0 kB
AnonHugePages:    356352 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      291540 kB
DirectMap2M:    38279168 kB
DirectMap1G:    97517568 kB

Free space on /tmp at the end= 889968 MiB
End job on nodeC015 at 2024-07-19 01:09:32