Trace number 4446530

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3587.19 3600.26

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K143.opb
MD5SUM5b71eb3fc2b19671b5e391982561b6cd
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables17017
Total number of constraints17305
Number of constraints which are clauses17162
Number of constraints which are cardinality constraints (but not clauses)143
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint143
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 144
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.11	c Default LC presolving (default).
0.09/0.11	c ** Before presolving: virtualMemUsedAtLc = 101405489, getVmSize() = 91754496, SCIPgetMemUsed() = 61256397, SCIPgetMemTotal() = 68337277, SCIPgetMemExternEstim() = 33068212
0.09/0.11	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
38.93/39.11	c ** Estimated virtualMemUsedAtSolver = 209340251, getVmSize() = 312791040, SCIPgetMemUsed() = 207680725, SCIPgetMemTotal() = 280942165, SCIPgetMemExternEstim() = 33068212
38.93/39.11	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
38.93/39.11	c Original Problem   :
38.93/39.11	c   Problem name     : instance-4446530-1721337862
38.93/39.11	c   Variables        : 17017 (17017 binary, 0 integer, 0 implicit integer, 0 continuous)
38.93/39.11	c   Constraints      : 17305
38.93/39.11	c   Objective sense  : minimize
38.93/39.11	c Presolved Problem  :
38.93/39.11	c   Variables        : 15495 (15495 binary, 0 integer, 0 implicit integer, 0 continuous)
38.93/39.11	c   Constraints      : 15752
38.93/39.11	c Constraints        : Number
38.93/39.11	c   setppc           : 1934 
38.93/39.11	c   orbitope         : 1 
38.93/39.11	c   logicor          : 13817 
38.93/39.11	c ** Instance transfer method used: 0
38.93/39.15	c ** ParaScipInstance copy increased the number of variables. **
38.93/39.19	c LC is working with racing ramp-up and with rebuilding tree after racing.
38.93/39.19	c                                Nodes    Active                                            
38.93/39.19	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
788.37/792.81	c       793              2           1         1                -           0.0000          -
803.71/808.21	c       808              4           3         1                -           0.0000          -
827.23/831.83	c       832              5           4         1                -           0.0000          -
834.90/839.59	c       840              6           5         1                -           0.0000          -
856.72/861.50	c       862              7           6         1                -           0.0000          -
883.83/888.63	c       889              9           8         1                -           0.0000          -
901.48/906.34	c       906             10           9         1                -           0.0000          -
917.53/922.48	c       922             11          10         1                -           0.0000          -
936.96/941.91	c       942             12          11         1                -           0.0000          -
957.70/962.70	c       963             14          13         1                -           0.0000          -
1124.72/1130.37	c      1130             16          13         1                -           0.0000          -
1135.59/1141.26	c      1141             17          12         1                -           0.0000          -
1156.12/1161.82	c      1162             18          13         1                -           0.0000          -
1176.76/1182.50	c      1183             19          14         1                -           0.0000          -
1238.66/1244.61	c      1245             20          13         1                -           0.0000          -
1245.74/1251.72	c      1252             23          14         1                -           0.0000          -
1286.51/1292.68	c      1293             25          16         1                -           0.0000          -
1293.09/1299.23	c      1299             26          15         1                -           0.0000          -
1523.37/1530.25	c      1530             28          15         1                -           0.0000          -
1530.25/1537.16	c      1537             29          14         1                -           0.0000          -
1535.24/1542.19	c      1542             31          14         1                -           0.0000          -
1552.28/1559.21	c      1559             32          15         1                -           0.0000          -
1916.55/1924.63	c      1925             35          16         1                -           0.0000          -
1933.40/1941.51	c      1942             36          17         1                -           0.0000          -
1941.38/1949.50	c      1950             37          16         1                -           0.0000          -
1949.25/1957.42	c      1957             38          17         1                -           0.0000          -
2019.24/2027.63	c      2028             39          18         1                -           0.0000          -
2026.72/2035.10	c      2035             40          19         1                -           0.0000          -
2217.03/2226.02	c      2226             41          20         1                -           0.0000          -
2773.47/2784.29	c      2784             42          19         1                -           0.0000          -
2795.80/2806.67	c      2807             43          20         1                -           0.0000          -
2841.46/2852.43	c      2852             44          19         1                -           0.0000          -
2950.53/2961.85	c      2962             46          21         1                -           0.0000          -
2968.79/2980.18	c      2980             47          22         1                -           0.0000          -
3586.92/3600.10	c      3600             47          22         0                -           0.0000          -
3587.02/3600.20	c SCIP Status        : c solving was interrupted [hard time limit reached]
3587.02/3600.20	c Total Time         : 3600.1900
3587.02/3600.20	c   solving          : 3600.1900
3587.02/3600.20	c   presolving       : 38.9947 (included in solving)
3587.02/3600.20	c B&B Tree           :
3587.02/3600.20	c   nodes (total)    : 1
3587.02/3600.20	c Solution           :
3587.02/3600.20	c   Solutions found  : 0
3587.02/3600.20	c   Primal Bound     :          -
3587.02/3600.20	c   Dual Bound       : +0.00000000000000e+00
3587.02/3600.20	c Gap                :          -
3587.13/3600.26	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61559 MiB free)
  memory of node 1: 64510 MiB (59623 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446530-1721337862/watcher-4446530-1721337862 -o /tmp/evaluation-result-4446530-1721337862/solver-4446530-1721337862 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000261 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446530-1721337862.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1004335, runsolver pid=1004332

[startup+0.10073 s]*
/proc/loadavg: 4.18 4.11 4.10 5/262 1004336
/proc/meminfo: memFree=123971784/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=82200 memory=71440 CPUtime=0.09 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 15617 0 0 0 7 2 0 0 20 0 1 0 185948013 84172800 17860 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 20550 17860 2542 3032 0 16950 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 82200 KiB
Current children cumulated memory: 71440 KiB

[startup+0.205476 s]*
/proc/loadavg: 4.18 4.11 4.10 5/262 1004336
/proc/meminfo: memFree=123938692/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=108900 memory=95292 CPUtime=0.2 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 21060 0 0 0 17 3 0 0 20 0 1 0 185948013 111513600 23823 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 27225 23823 2622 3032 0 23625 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 108900 KiB
Current children cumulated memory: 95292 KiB

[startup+0.305497 s]*
/proc/loadavg: 4.18 4.11 4.10 5/262 1004336
/proc/meminfo: memFree=123907080/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=118792 memory=105252 CPUtime=0.3 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 25493 0 0 0 26 4 0 0 20 0 1 0 185948013 121643008 26313 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 29698 26313 2638 3032 0 26098 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 118792 KiB
Current children cumulated memory: 105252 KiB

[startup+0.70024 s]
/proc/loadavg: 4.18 4.11 4.10 5/262 1004336
/proc/meminfo: memFree=123922184/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=131732 memory=117392 CPUtime=0.68 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 30238 0 0 0 64 4 0 0 20 0 1 0 185948013 134893568 29348 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 32933 29348 2718 3032 0 29333 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 131732 KiB
Current children cumulated memory: 117392 KiB

[startup+1.50023 s]
/proc/loadavg: 4.18 4.11 4.10 5/262 1004336
/proc/meminfo: memFree=123860252/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=167396 memory=151132 CPUtime=1.48 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 36765 0 0 0 143 5 0 0 20 0 1 0 185948013 171413504 37783 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 41849 37783 2734 3032 0 38249 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 167396 KiB
Current children cumulated memory: 151132 KiB

[startup+3.10556 s]
/proc/loadavg: 4.17 4.11 4.09 5/262 1004336
/proc/meminfo: memFree=123805588/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=168892 memory=152440 CPUtime=3.08 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 37129 0 0 0 303 5 0 0 20 0 1 0 185948013 172945408 38110 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 42223 38110 2734 3032 0 38623 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 168892 KiB
Current children cumulated memory: 152440 KiB

[startup+6.30022 s]
/proc/loadavg: 4.17 4.11 4.09 5/262 1004336
/proc/meminfo: memFree=123803168/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=171004 memory=154280 CPUtime=6.26 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 37559 0 0 0 621 5 0 0 20 0 1 0 185948013 175108096 38570 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 42751 38570 2734 3032 0 39151 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 171004 KiB
Current children cumulated memory: 154280 KiB

[startup+12.7015 s]
/proc/loadavg: 4.14 4.10 4.09 5/260 1004384
/proc/meminfo: memFree=126079392/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=175240 memory=158308 CPUtime=12.63 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 38634 0 0 0 1258 5 0 0 20 0 1 0 185948013 179445760 39577 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 43810 39577 2734 3032 0 40210 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 175240 KiB
Current children cumulated memory: 158308 KiB

[startup+25.5002 s]
/proc/loadavg: 4.19 4.11 4.10 5/260 1004385
/proc/meminfo: memFree=126065204/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=176276 memory=159356 CPUtime=25.38 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 38893 0 0 0 2533 5 0 0 20 0 1 0 185948013 180506624 39839 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 44069 39839 2734 3032 0 40469 0
Current children cumulated CPU time: 25.38 s
Current children cumulated vsize: 176276 KiB
Current children cumulated memory: 159356 KiB

[startup+51.1057 s]
/proc/loadavg: 4.18 4.12 4.10 5/261 1004776
/proc/meminfo: memFree=125795892/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=544596 memory=422108 CPUtime=50.81 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 154725 0 0 0 5064 17 0 0 20 0 3 0 185948013 557666304 105527 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 136149 105527 2910 3032 0 123916 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=544596 memory=0 CPUtime=11.81 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 89411 0 0 0 1174 7 0 0 20 0 3 0 185951925 557666304 105527 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=544596 memory=298300 CPUtime=0 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 23 0 0 0 0 0 0 0 20 0 3 0 185951933 557666304 105527 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 50.81 s
Current children cumulated vsize: 544596 KiB
Current children cumulated memory: 422108 KiB

[startup+102.301 s]
/proc/loadavg: 4.13 4.11 4.09 5/265 1004789
/proc/meminfo: memFree=125052552/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=544780 memory=430432 CPUtime=101.47 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 202665 0 0 0 10127 20 0 0 20 0 3 0 185948013 557854720 107608 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 136195 107608 2926 3032 0 126029 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=544780 memory=430432 CPUtime=62.48 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 137309 0 0 0 6237 11 0 0 20 0 3 0 185951925 557854720 107608 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=544780 memory=45552 CPUtime=0 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 65 0 0 0 0 0 0 0 20 0 3 0 185951933 557854720 107608 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 101.47 s
Current children cumulated vsize: 544780 KiB
Current children cumulated memory: 430432 KiB

[startup+162.301 s]
/proc/loadavg: 4.15 4.12 4.09 5/265 1004799
/proc/meminfo: memFree=125032560/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=544780 memory=430940 CPUtime=160.84 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 212381 0 0 0 16063 21 0 0 20 0 3 0 185948013 557854720 107735 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 136195 107735 2926 3032 0 126152 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=544780 memory=11544 CPUtime=121.86 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 147008 0 0 0 12174 12 0 0 20 0 3 0 185951925 557854720 107735 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=544780 memory=430940 CPUtime=0 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 82 0 0 0 0 0 0 0 20 0 3 0 185951933 557854720 107735 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 160.84 s
Current children cumulated vsize: 544780 KiB
Current children cumulated memory: 430940 KiB

[startup+222.301 s]
/proc/loadavg: 4.10 4.11 4.09 5/266 1004980
/proc/meminfo: memFree=124968812/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=580180 memory=485504 CPUtime=220.23 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 235545 0 0 0 21999 24 0 0 20 0 3 0 185948013 594104320 121376 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 145045 121376 2942 3032 0 140107 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=580180 memory=45552 CPUtime=181.23 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 170161 0 0 0 18109 14 0 0 20 0 3 0 185951925 594104320 121376 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=580180 memory=11544 CPUtime=0 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 93 0 0 0 0 0 0 0 20 0 3 0 185951933 594104320 121376 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 220.23 s
Current children cumulated vsize: 580180 KiB
Current children cumulated memory: 485504 KiB

[startup+282.3 s]
/proc/loadavg: 4.08 4.10 4.09 5/267 1004991
/proc/meminfo: memFree=124940936/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=649676 memory=509624 CPUtime=279.81 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 276102 0 0 0 27955 26 0 0 20 0 3 0 185948013 665268224 127406 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 162419 127406 2942 3032 0 147215 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=649676 memory=11544 CPUtime=240.81 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 210711 0 0 0 24065 16 0 0 20 0 3 0 185951925 665268224 127406 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=649676 memory=500732 CPUtime=0 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 100 0 0 0 0 0 0 0 20 0 3 0 185951933 665268224 127406 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 279.81 s
Current children cumulated vsize: 649676 KiB
Current children cumulated memory: 509624 KiB

[startup+342.3 s]
/proc/loadavg: 4.08 4.10 4.09 5/269 1005062
/proc/meminfo: memFree=124744340/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=654152 memory=516996 CPUtime=339.6 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 307605 0 0 0 33932 28 0 0 20 0 3 0 185948013 669851648 129249 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 163538 129249 2942 3032 0 149531 0

################
# More data... #
################

[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3389.78 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 588139 0 0 0 338926 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=662048 CPUtime=3350.75 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 522098 0 0 0 335035 40 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 438 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3389.78 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3462.3 s]
/proc/loadavg: 4.08 4.11 4.09 5/265 1006780
/proc/meminfo: memFree=124117088/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3449.61 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 589310 0 0 0 344909 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=662048 CPUtime=3410.59 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 523263 0 0 0 341018 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 444 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3449.61 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3522.3 s]
/proc/loadavg: 4.13 4.12 4.09 5/265 1006791
/proc/meminfo: memFree=124116800/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3509.44 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 590148 0 0 0 350892 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=45552 CPUtime=3470.41 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 524095 0 0 0 347000 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 450 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3509.44 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3582.3 s]
/proc/loadavg: 4.05 4.10 4.09 5/265 1006804
/proc/meminfo: memFree=124116472/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3569.27 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591199 0 0 0 356875 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=11544 CPUtime=3530.24 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525141 0 0 0 352983 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 455 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3569.27 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3600.26 s]
# the end of solver process 1004335 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3586.66 s, system=0.530387 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.04 4.09 4.09 5/265 1006804
/proc/meminfo: memFree=124116500/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3570.97 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591203 0 0 0 357045 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=2752 CPUtime=3531.94 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525145 0 0 0 353153 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=1401069873814724666 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 455 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3570.97 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3590.4 s]
/proc/loadavg: 4.04 4.09 4.09 5/265 1006807
/proc/meminfo: memFree=124116348/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3577.35 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591426 0 0 0 357683 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=13196 CPUtime=3538.32 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525366 0 0 0 353791 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3577.35 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3596.8 s]
/proc/loadavg: 4.12 4.11 4.09 5/265 1006807
/proc/meminfo: memFree=124116364/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3583.73 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591437 0 0 0 358321 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=164 CPUtime=3544.7 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525377 0 0 0 354429 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=662048 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3583.73 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3598.4 s]
/proc/loadavg: 4.11 4.10 4.09 5/265 1006807
/proc/meminfo: memFree=124116364/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3585.32 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591437 0 0 0 358480 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=2028 CPUtime=3546.29 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525377 0 0 0 354588 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=11544 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3585.32 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3599.2 s]
/proc/loadavg: 4.11 4.10 4.09 5/265 1006808
/proc/meminfo: memFree=124116336/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3586.12 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591437 0 0 0 358560 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=13196 CPUtime=3547.09 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525377 0 0 0 354668 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=5472 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3586.12 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3600 s]*
/proc/loadavg: 4.11 4.10 4.09 5/265 1006808
/proc/meminfo: memFree=124177672/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=719688 memory=662048 CPUtime=3586.92 cores=0,2
/proc/1004335/stat : 1004335 (fscip) S 1004332 1004335 1000251 0 -1 1077936128 591437 0 0 0 358640 52 0 0 20 0 3 0 185948013 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 179922 165512 3310 3032 0 173226 0
[pid=1004335/tid=1004774] ppid=1004332 vsize=719688 memory=5020 CPUtime=3547.89 cores=0,2
/proc/1004335/task/1004774/stat : 1004774 (fscip) R 1004332 1004335 1000251 0 -1 4194368 525377 0 0 0 354748 41 0 0 20 0 3 0 185951925 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=719688 memory=903408 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 3 0 185951933 736960512 165512 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3586.92 s
Current children cumulated vsize: 719688 KiB
Current children cumulated memory: 662048 KiB

[startup+3600.22 s]
/proc/loadavg: 4.11 4.10 4.09 5/265 1006808
/proc/meminfo: memFree=124177672/131524600 swapFree=131071996/131071996
[pid=1004335] ppid=1004332 vsize=676220 memory=608220 CPUtime=3587.13 cores=0,2
/proc/1004335/stat : 1004335 (fscip) R 1004332 1004335 1000251 0 -1 4194304 592396 0 0 0 358661 52 0 0 20 0 2 0 185948013 692449280 152055 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
/proc/1004335/statm: 169055 152055 3310 3032 0 162359 0
[pid=1004335/tid=1004775] ppid=1004332 vsize=676220 memory=6860 CPUtime=0.02 cores=0,2
/proc/1004335/task/1004775/stat : 1004775 (fscip) S 1004332 1004335 1000251 0 -1 1077936192 457 0 0 0 1 1 0 0 20 0 2 0 185951933 692449280 152055 134679101440 4194304 16613245 140732085967008 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 48685056 140732085974035 140732085974151 140732085974151 140732085981168 0
Current children cumulated CPU time: 3587.13 s
Current children cumulated vsize: 676220 KiB
Current children cumulated memory: 608220 KiB

Child status: 0

Real time (s): 3600.26
CPU time (s): 3587.19
CPU user time (s): 3586.66
CPU system time (s): 0.530387
CPU usage (%): 99.6369
Max. virtual memory (cumulated for all children) (KiB): 719688
Max. memory (cumulated for all children) (KiB): 662048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3586.66
system time used= 0.530387
maximum resident set size= 662048
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 592913
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3679
involuntary context switches= 26332


# summary of solver processes directly reported to runsolver:
#   pid: 1004335
#   total CPU time (s): 3587.19
#   total CPU user time (s): 3586.66
#   total CPU system time (s): 0.530387

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.90689 second user time and 14.8693 second system time

The end

Launcher Data 

Begin job on nodeC017 at 2024-07-18 23:24:34
IDJOB=4446530
IDBENCH=158274
IDSOLVER=3064
FILE ID=nodeC017/4446530-1721337862
RUNJOBID= nodeC017-1721330666-1000261
SLURM_JOB_ID= 7542711
Free space on /tmp= 889988 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K143.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446530-1721337862/watcher-4446530-1721337862 -o /tmp/evaluation-result-4446530-1721337862/solver-4446530-1721337862 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC017-1721330666-1000261 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446530-1721337862.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 5b71eb3fc2b19671b5e391982561b6cd
RANDOM SEED=567774999

nodeC017.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3669.956
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.203
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.035
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.114
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3673.078
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.227
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3626.564
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.905
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        124095564 kB
MemAvailable:   126655396 kB
Buffers:          541760 kB
Cached:          2835100 kB
SwapCached:            0 kB
Active:          1231084 kB
Inactive:        5539432 kB
Active(anon):       1520 kB
Inactive(anon):  3429536 kB
Active(file):    1229564 kB
Inactive(file):  2109896 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             59188 kB
Writeback:             0 kB
AnonPages:       3392972 kB
Mapped:           140448 kB
Shmem:             37720 kB
KReclaimable:     120036 kB
Slab:             234100 kB
SReclaimable:     120036 kB
SUnreclaim:       114064 kB
KernelStack:        4304 kB
PageTables:        17116 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    3286356 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68288 kB
HardwareCorrupted:     0 kB
AnonHugePages:    831488 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      287444 kB
DirectMap2M:    40380416 kB
DirectMap1G:    95420416 kB

Free space on /tmp at the end= 889964 MiB
End job on nodeC017 at 2024-07-19 00:24:34