Trace number 4446590

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3590.09 3600.37

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K151.opb
MD5SUMabcade21393c5164863b40206a5f4f64
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables17969
Total number of constraints18273
Number of constraints which are clauses18122
Number of constraints which are cardinality constraints (but not clauses)151
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint151
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 152
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.11	c Default LC presolving (default).
0.09/0.11	c ** Before presolving: virtualMemUsedAtLc = 106475298, getVmSize() = 95391744, SCIPgetMemUsed() = 64527053, SCIPgetMemTotal() = 71556349, SCIPgetMemExternEstim() = 34918949
0.09/0.11	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
39.37/39.53	c ** Estimated virtualMemUsedAtSolver = 221097999, getVmSize() = 329158656, SCIPgetMemUsed() = 221582426, SCIPgetMemTotal() = 296728050, SCIPgetMemExternEstim() = 34918949
39.37/39.53	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
39.37/39.53	c Original Problem   :
39.37/39.53	c   Problem name     : instance-4446590-1721338326
39.37/39.53	c   Variables        : 17969 (17969 binary, 0 integer, 0 implicit integer, 0 continuous)
39.37/39.53	c   Constraints      : 18273
39.37/39.53	c   Objective sense  : minimize
39.37/39.53	c Presolved Problem  :
39.37/39.53	c   Variables        : 16439 (16439 binary, 0 integer, 0 implicit integer, 0 continuous)
39.37/39.53	c   Constraints      : 16701
39.37/39.53	c Constraints        : Number
39.37/39.53	c   setppc           : 2043 
39.37/39.53	c   orbitope         : 1 
39.37/39.53	c   logicor          : 14657 
39.37/39.53	c ** Instance transfer method used: 0
39.37/39.57	c ** ParaScipInstance copy increased the number of variables. **
39.47/39.62	c LC is working with racing ramp-up and with rebuilding tree after racing.
39.47/39.62	c                                Nodes    Active                                            
39.47/39.62	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1050.47/1054.50	c      1054              2           1         1                -           0.0000          -
1056.26/1060.38	c      1060              4           3         1                -           0.0000          -
1080.81/1084.93	c      1085              5           4         1                -           0.0000          -
1105.25/1109.45	c      1109              7           6         1                -           0.0000          -
1110.94/1115.15	c      1115              8           7         1                -           0.0000          -
1131.38/1135.64	c      1136              9           8         1                -           0.0000          -
1138.67/1142.90	c      1143             10           9         1                -           0.0000          -
1159.62/1163.92	c      1164             11          10         1                -           0.0000          -
1182.96/1187.35	c      1187             12          11         1                -           0.0000          -
1194.64/1199.05	c      1199             13          12         1                -           0.0000          -
1211.89/1216.36	c      1216             14          13         1                -           0.0000          -
1405.63/1410.53	c      1411             17          14         1                -           0.0000          -
1491.52/1496.65	c      1497             18          15         1                -           0.0000          -
1524.34/1529.55	c      1530             19          16         1                -           0.0000          -
1597.36/1602.74	c      1603             20          17         1                -           0.0000          -
1644.25/1649.74	c      1650             21          18         1                -           0.0000          -
1728.93/1734.66	c      1735             22          19         1                -           0.0000          -
1738.01/1743.75	c      1744             23          20         1                -           0.0000          -
3589.91/3600.21	c      3600             23          20         0                -           0.0000          -
3590.01/3600.30	c SCIP Status        : c solving was interrupted [hard time limit reached]
3590.01/3600.30	c Total Time         : 3600.3000
3590.01/3600.30	c   solving          : 3600.3000
3590.01/3600.30	c   presolving       : 39.4190 (included in solving)
3590.01/3600.30	c B&B Tree           :
3590.01/3600.30	c   nodes (total)    : 1
3590.01/3600.30	c Solution           :
3590.01/3600.30	c   Solutions found  : 0
3590.01/3600.30	c   Primal Bound     :          -
3590.01/3600.30	c   Dual Bound       : +0.00000000000000e+00
3590.01/3600.30	c Gap                :          -
3590.01/3600.36	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (60452 MiB free)
  memory of node 1: 64510 MiB (61923 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446590-1721338326/watcher-4446590-1721338326 -o /tmp/evaluation-result-4446590-1721338326/solver-4446590-1721338326 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000263 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446590-1721338326.opb -qsol -t 3600 -sth 1 

running on 2 cores: 1,3

CPU governors:
  performance: 1 3

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1005129, runsolver pid=1005126

[startup+0.10089 s]*
/proc/loadavg: 4.13 4.10 4.09 5/267 1005130
/proc/meminfo: memFree=125243132/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=88836 memory=78052 CPUtime=0.09 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 17293 0 0 0 8 1 0 0 20 0 1 0 185994496 90968064 19513 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 22209 19513 2542 3032 0 18609 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 88836 KiB
Current children cumulated memory: 78052 KiB

[startup+0.205781 s]*
/proc/loadavg: 4.13 4.10 4.09 5/267 1005130
/proc/meminfo: memFree=125221080/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=122680 memory=106920 CPUtime=0.19 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 23939 0 0 0 17 2 0 0 20 0 1 0 185994496 125624320 26730 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 30670 26730 2622 3032 0 27070 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 122680 KiB
Current children cumulated memory: 106920 KiB

[startup+0.305842 s]*
/proc/loadavg: 4.13 4.10 4.09 6/267 1005130
/proc/meminfo: memFree=125210552/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=123576 memory=110040 CPUtime=0.3 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 26817 0 0 0 27 3 0 0 20 0 1 0 185994496 126541824 27510 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 30894 27510 2638 3032 0 27294 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 123576 KiB
Current children cumulated memory: 110040 KiB

[startup+0.700235 s]
/proc/loadavg: 4.13 4.10 4.09 5/267 1005130
/proc/meminfo: memFree=125218060/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=136944 memory=122744 CPUtime=0.68 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 32701 0 0 0 64 4 0 0 20 0 1 0 185994496 140230656 30686 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 34236 30686 2718 3032 0 30636 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 136944 KiB
Current children cumulated memory: 122744 KiB

[startup+1.50023 s]
/proc/loadavg: 4.13 4.10 4.09 5/267 1005130
/proc/meminfo: memFree=125173984/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=175468 memory=157624 CPUtime=1.48 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 38380 0 0 0 143 5 0 0 20 0 1 0 185994496 179679232 39406 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 43867 39406 2734 3032 0 40267 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 175468 KiB
Current children cumulated memory: 157624 KiB

[startup+3.106 s]
/proc/loadavg: 4.12 4.10 4.09 5/267 1005130
/proc/meminfo: memFree=125161300/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=175944 memory=158148 CPUtime=3.08 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 38507 0 0 0 303 5 0 0 20 0 1 0 185994496 180166656 39537 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 43986 39537 2734 3032 0 40386 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 175944 KiB
Current children cumulated memory: 158148 KiB

[startup+6.30023 s]
/proc/loadavg: 4.12 4.10 4.09 5/267 1005132
/proc/meminfo: memFree=125153280/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=182896 memory=164528 CPUtime=6.27 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 40153 0 0 0 622 5 0 0 20 0 1 0 185994496 187285504 41132 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 45724 41132 2734 3032 0 42124 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 182896 KiB
Current children cumulated memory: 164528 KiB

[startup+12.7002 s]
/proc/loadavg: 4.10 4.10 4.09 5/267 1005132
/proc/meminfo: memFree=125149880/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=183528 memory=165040 CPUtime=12.66 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 40317 0 0 0 1260 6 0 0 20 0 1 0 185994496 187932672 41260 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 45882 41260 2734 3032 0 42282 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 183528 KiB
Current children cumulated memory: 165040 KiB

[startup+25.5003 s]
/proc/loadavg: 4.09 4.09 4.09 5/267 1005135
/proc/meminfo: memFree=125141604/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=184560 memory=166084 CPUtime=25.42 cores=1,3
/proc/1005129/stat : 1005129 (fscip) R 1005126 1005129 1000251 0 -1 4194304 40575 0 0 0 2536 6 0 0 20 0 1 0 185994496 188989440 41521 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 46140 41521 2734 3032 0 42540 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 184560 KiB
Current children cumulated memory: 166084 KiB

[startup+51.1059 s]
/proc/loadavg: 4.12 4.10 4.09 5/269 1005140
/proc/meminfo: memFree=124841592/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=561836 memory=443884 CPUtime=50.87 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 161617 0 0 0 5068 19 0 0 20 0 3 0 185994496 575320064 110971 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 140459 110971 2910 3032 0 130727 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=561836 memory=392368 CPUtime=11.41 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 92973 0 0 0 1132 9 0 0 20 0 3 0 185998450 575320064 110971 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=561836 memory=388952 CPUtime=0 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 17 0 0 0 0 0 0 0 20 0 3 0 185998459 575320064 110971 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 50.87 s
Current children cumulated vsize: 561836 KiB
Current children cumulated memory: 443884 KiB

[startup+102.301 s]
/proc/loadavg: 4.10 4.10 4.09 5/270 1005154
/proc/meminfo: memFree=124805736/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=562028 memory=451872 CPUtime=101.56 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 206414 0 0 0 10133 23 0 0 20 0 3 0 185994496 575516672 112968 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 140507 112968 2926 3032 0 132627 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=562028 memory=11544 CPUtime=62.1 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 137732 0 0 0 6198 12 0 0 20 0 3 0 185998450 575516672 112968 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=562028 memory=451872 CPUtime=0 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 55 0 0 0 0 0 0 0 20 0 3 0 185998459 575516672 112968 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 101.56 s
Current children cumulated vsize: 562028 KiB
Current children cumulated memory: 451872 KiB

[startup+162.301 s]
/proc/loadavg: 4.18 4.12 4.10 5/269 1005166
/proc/meminfo: memFree=124782972/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=562028 memory=452488 CPUtime=160.98 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 217209 0 0 0 16074 24 0 0 20 0 3 0 185994496 575516672 113122 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 140507 113122 2926 3032 0 132785 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=562028 memory=451872 CPUtime=121.51 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 148509 0 0 0 12138 13 0 0 20 0 3 0 185998450 575516672 113122 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=562028 memory=11544 CPUtime=0 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 73 0 0 0 0 0 0 0 20 0 3 0 185998459 575516672 113122 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 160.98 s
Current children cumulated vsize: 562028 KiB
Current children cumulated memory: 452488 KiB

[startup+222.301 s]
/proc/loadavg: 4.14 4.12 4.09 5/265 1005176
/proc/meminfo: memFree=124702508/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=667308 memory=510876 CPUtime=220.4 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 244905 0 0 0 22013 27 0 0 20 0 3 0 185994496 683323392 127719 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 166827 127719 2942 3032 0 147746 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=667308 memory=45552 CPUtime=180.94 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 176195 0 0 0 18077 17 0 0 20 0 3 0 185998450 683323392 127719 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=667308 memory=11544 CPUtime=0 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 83 0 0 0 0 0 0 0 20 0 3 0 185998459 683323392 127719 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 220.4 s
Current children cumulated vsize: 667308 KiB
Current children cumulated memory: 510876 KiB

[startup+282.3 s]
/proc/loadavg: 4.33 4.16 4.11 5/265 1005186
/proc/meminfo: memFree=124597668/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=670992 memory=529656 CPUtime=280.21 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 288960 0 0 0 27991 30 0 0 20 0 3 0 185994496 687095808 132414 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 167748 132414 2942 3032 0 153052 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=670992 memory=525748 CPUtime=240.74 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 220243 0 0 0 24055 19 0 0 20 0 3 0 185998450 687095808 132414 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=670992 memory=529656 CPUtime=0 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 90 0 0 0 0 0 0 0 20 0 3 0 185998459 687095808 132414 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 280.21 s
Current children cumulated vsize: 670992 KiB
Current children cumulated memory: 529656 KiB

[startup+342.3 s]
/proc/loadavg: 4.36 4.20 4.12 5/265 1005198
/proc/meminfo: memFree=124583528/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=674832 memory=537764 CPUtime=340.04 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 297425 0 0 0 33974 30 0 0 20 0 3 0 185994496 691027968 134441 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 168708 134441 2942 3032 0 155366 0

################
# More data... #
################

/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=712372 CPUtime=3412.8 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 791704 0 0 0 341220 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=712372 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 413 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3452.29 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3522.3 s]
/proc/loadavg: 1.08 1.93 3.07 2/238 1007573
/proc/meminfo: memFree=126599816/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3512.16 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 861794 0 0 0 351144 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=-7312297431587394663 CPUtime=3472.67 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 792599 0 0 0 347207 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=11544 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 419 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3512.16 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3582.3 s]
/proc/loadavg: 1.12 1.78 2.95 2/238 1007582
/proc/meminfo: memFree=126599720/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3572.05 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 862710 0 0 0 357133 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=712372 CPUtime=3532.55 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 793509 0 0 0 353195 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=712372 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3572.05 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3600.37 s]
# the end of solver process 1005129 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3589.36 s, system=0.735908 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 1.11 1.77 2.94 2/238 1007584
/proc/meminfo: memFree=126599692/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3573.75 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 862710 0 0 0 357303 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=7036 CPUtime=3534.26 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 793509 0 0 0 353366 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=8042190336800551066 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3573.75 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3590.4 s]
/proc/loadavg: 1.10 1.76 2.93 2/238 1007584
/proc/meminfo: memFree=126599692/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3580.13 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 862710 0 0 0 357941 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=712372 CPUtime=3540.64 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 793509 0 0 0 354004 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=712372 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3580.13 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3596.8 s]
/proc/loadavg: 1.09 1.75 2.91 2/238 1007585
/proc/meminfo: memFree=126599876/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3586.52 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 863072 0 0 0 358580 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=712372 CPUtime=3547.03 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 793871 0 0 0 354643 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=712372 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3586.52 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3598.4 s]
/proc/loadavg: 1.08 1.73 2.90 2/238 1007585
/proc/meminfo: memFree=126599876/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3588.11 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 863433 0 0 0 358739 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=5444 CPUtime=3548.62 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 794232 0 0 0 354802 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=2760 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3588.11 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3599.2 s]
/proc/loadavg: 1.08 1.73 2.90 2/238 1007585
/proc/meminfo: memFree=126599868/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3588.91 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 863434 0 0 0 358819 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=11544 CPUtime=3549.42 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 794233 0 0 0 354882 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=45552 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3588.91 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3600 s]*
/proc/loadavg: 1.08 1.73 2.90 2/238 1007585
/proc/meminfo: memFree=126599876/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3589.71 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 863434 0 0 0 358899 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=-7312297431587394663 CPUtime=3550.22 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 794233 0 0 0 354962 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=-7312297431587394663 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3589.71 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3600.2 s]
/proc/loadavg: 1.08 1.73 2.90 2/238 1007585
/proc/meminfo: memFree=126599876/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=805904 memory=712372 CPUtime=3589.91 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 863434 0 0 0 358919 72 0 0 20 0 3 0 185994496 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 201476 178093 3310 3032 0 185879 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=805904 memory=712372 CPUtime=3550.42 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 794233 0 0 0 354982 60 0 0 20 0 3 0 185998450 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=805904 memory=-7312297431587394663 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 825245696 178093 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3589.91 s
Current children cumulated vsize: 805904 KiB
Current children cumulated memory: 712372 KiB

[startup+3600.3 s]
/proc/loadavg: 1.08 1.73 2.90 2/238 1007585
/proc/meminfo: memFree=126599876/131524600 swapFree=131071996/131071996
[pid=1005129] ppid=1005126 vsize=758768 memory=665312 CPUtime=3590.01 cores=1,3
/proc/1005129/stat : 1005129 (fscip) S 1005126 1005129 1000251 0 -1 1077936128 864006 0 0 0 358929 72 0 0 20 0 3 0 185994496 776978432 166328 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
/proc/1005129/statm: 189692 166328 3310 3032 0 174095 0
[pid=1005129/tid=1005137] ppid=1005126 vsize=758768 memory=712372 CPUtime=3550.52 cores=1,3
/proc/1005129/task/1005137/stat : 1005137 (fscip) R 1005126 1005129 1000251 0 -1 4194368 794808 0 0 0 354992 60 0 0 20 0 3 0 185998450 776978432 166328 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
[pid=1005129/tid=1005138] ppid=1005126 vsize=758768 memory=1812 CPUtime=0.03 cores=1,3
/proc/1005129/task/1005138/stat : 1005138 (fscip) S 1005126 1005129 1000251 0 -1 1077936192 425 0 0 0 1 2 0 0 20 0 3 0 185998459 776978432 166328 134679101440 4194304 16613245 140724906054656 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18822208 18930672 25370624 140724906062867 140724906062983 140724906062983 140724906070000 0
Current children cumulated CPU time: 3590.01 s
Current children cumulated vsize: 758768 KiB
Current children cumulated memory: 665312 KiB

Child status: 0

Real time (s): 3600.37
CPU time (s): 3590.09
CPU user time (s): 3589.36
CPU system time (s): 0.735908
CPU usage (%): 99.7145
Max. virtual memory (cumulated for all children) (KiB): 805904
Max. memory (cumulated for all children) (KiB): 712372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3589.36
system time used= 0.735908
maximum resident set size= 712372
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 867665
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3631
involuntary context switches= 3804


# summary of solver processes directly reported to runsolver:
#   pid: 1005129
#   total CPU time (s): 3590.09
#   total CPU user time (s): 3589.36
#   total CPU system time (s): 0.735908

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.61286 second user time and 14.8864 second system time

The end

Launcher Data 

Begin job on nodeC017 at 2024-07-18 23:32:19
IDJOB=4446590
IDBENCH=158279
IDSOLVER=3064
FILE ID=nodeC017/4446590-1721338326
RUNJOBID= nodeC017-1721330666-1000263
SLURM_JOB_ID= 7542711
Free space on /tmp= 889992 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K151.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446590-1721338326/watcher-4446590-1721338326 -o /tmp/evaluation-result-4446590-1721338326/solver-4446590-1721338326 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000263 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446590-1721338326.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= abcade21393c5164863b40206a5f4f64
RANDOM SEED=1971451749

nodeC017.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.185
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3676.581
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.935
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.625
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3665.214
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3673.149
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.813
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3619.109
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125313136 kB
MemAvailable:   127870116 kB
Buffers:          542060 kB
Cached:          2832456 kB
SwapCached:            0 kB
Active:          1227800 kB
Inactive:        4327152 kB
Active(anon):       1544 kB
Inactive(anon):  2216604 kB
Active(file):    1226256 kB
Inactive(file):  2110548 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29156 kB
Writeback:             0 kB
AnonPages:       2180404 kB
Mapped:           142244 kB
Shmem:             37720 kB
KReclaimable:     119644 kB
Slab:             233828 kB
SReclaimable:     119644 kB
SUnreclaim:       114184 kB
KernelStack:        4256 kB
PageTables:        13948 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    2117440 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68320 kB
HardwareCorrupted:     0 kB
AnonHugePages:    509952 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      287444 kB
DirectMap2M:    40380416 kB
DirectMap1G:    95420416 kB

Free space on /tmp at the end= 890052 MiB
End job on nodeC017 at 2024-07-19 00:32:19