Trace number 4464420

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3587.14 3600.01

General information on the benchmark

NamePB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/
normalized-ooo.ex.mem.LdValue.ucl.opb
MD5SUMab585d5a9f1265a4903b33e81faedd32
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark17.3591
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables77106
Total number of constraints218779
Number of constraints which are clauses205559
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints13220
Minimum length of a constraint1
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 129
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 510
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.78/0.82	c Default LC presolving (default).
0.78/0.83	c ** Before presolving: virtualMemUsedAtLc = 702486207, getVmSize() = 461205504, SCIPgetMemUsed() = 408267439, SCIPgetMemTotal() = 421835423, SCIPgetMemExternEstim() = 280650784
0.78/0.83	c ** set memory limit for presolving in LC to 8.79588e+12 for SCIP **
38.43/38.68	c ** Estimated virtualMemUsedAtSolver = 732171662, getVmSize() = 888156160, SCIPgetMemUsed() = 513263597, SCIPgetMemTotal() = 817606709, SCIPgetMemExternEstim() = 280650784
38.43/38.68	c ** set memory limit for solvers to 4.39802e+12 for each SCIP **
38.43/38.68	c Original Problem   :
38.43/38.68	c   Problem name     : instance-4464420-1722378597
38.43/38.68	c   Variables        : 77106 (77106 binary, 0 integer, 0 implicit integer, 0 continuous)
38.43/38.68	c   Constraints      : 218779
38.43/38.68	c   Objective sense  : minimize
38.43/38.68	c Presolved Problem  :
38.43/38.68	c   Variables        : 67151 (67151 binary, 0 integer, 0 implicit integer, 0 continuous)
38.43/38.68	c   Constraints      : 73848
38.43/38.68	c Constraints        : Number
38.43/38.68	c   knapsack         : 13220 
38.43/38.68	c   setppc           : 1652 
38.43/38.68	c   and              : 58968 
38.43/38.68	c   logicor          : 8 
38.43/38.68	c ** Instance transfer method used: 0
38.63/38.88	c ** ParaScipInstance copy increased the number of variables. **
38.84/39.08	c LC is working with racing ramp-up and with rebuilding tree after racing.
38.84/39.08	c                                Nodes    Active                                            
38.84/39.08	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1734.04/1740.02	c      1740              2           1         1                -           0.0000          -
1840.65/1847.00	c      1847              3           2         1                -           0.0000          -
1874.60/1881.14	c      1881              4           3         1                -           0.0000          -
1975.45/1982.35	c      1982              5           4         1                -           0.0000          -
2001.35/2008.30	c      2008              6           5         1                -           0.0000          -
2069.91/2077.14	c      2077              7           6         1                -           0.0000          -
2096.41/2103.76	c      2104              8           7         1                -           0.0000          -
2190.66/2198.32	c      2198              9           8         1                -           0.0000          -
2429.55/2438.07	c      2438             10           9         1                -           0.0000          -
2448.16/2456.73	c      2457             11          10         1                -           0.0000          -
2507.36/2516.14	c      2516             12          11         1                -           0.0000          -
2521.40/2530.25	c      2530             13          12         1                -           0.0000          -
2584.56/2593.60	c      2594             14          13         1                -           0.0000          -
2680.27/2689.77	c      2690             15          14         1                -           0.0000          -
2705.66/2715.26	c      2715             16          15         1                -           0.0000          -
2730.75/2740.42	c      2740             17          16         1                -           0.0000          -
2905.10/2915.46	c      2915             18          17         1                -           0.0000          -
2966.28/2976.89	c      2977             19          18         1                -           0.0000          -
2981.42/2992.00	c      2992             20          19         1                -           0.0000          -
2996.95/3007.66	c      3008             21          20         1                -           0.0000          -
3016.17/3026.94	c      3027             22          21         1                -           0.0000          -
3033.40/3044.22	c      3044             23          22         1                -           0.0000          -
3053.61/3064.53	c      3065             24          23         1                -           0.0000          -
3586.13/3599.01	c      3599             24          23         0                -           0.0000          -
3586.71/3599.60	c SCIP Status        : c solving was interrupted [hard time limit reached]
3586.71/3599.60	c Total Time         : 3599.6100
3586.71/3599.60	c   solving          : 3599.6100
3586.71/3599.60	c   presolving       : 37.8480 (included in solving)
3586.71/3599.60	c B&B Tree           :
3586.71/3599.60	c   nodes (total)    : 1
3586.71/3599.60	c Solution           :
3586.71/3599.60	c   Solutions found  : 0
3586.71/3599.60	c   Primal Bound     :          -
3586.71/3599.60	c   Dual Bound       : +0.00000000000000e+00
3586.71/3599.60	c Gap                :          -
3587.12/3600.00	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (63481 MiB free)
  memory of node 1: 64473 MiB (63096 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464420-1722378597/watcher-4464420-1722378597 -o /tmp/evaluation-result-4464420-1722378597/solver-4464420-1722378597 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1722378597-35199 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464420-1722378597.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=35247, runsolver pid=35242

[startup+0.10036 s]*
/proc/loadavg: 0.11 0.09 0.09 7/258 35266
/proc/meminfo: memFree=129452828/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=72404 memory=60680 CPUtime=0.09 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 13030 0 0 0 8 1 0 0 20 0 1 0 4461624 74141696 15170 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 18101 15170 2347 3035 0 14497 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 72404 KiB
Current children cumulated memory: 60680 KiB

[startup+0.206588 s]*
/proc/loadavg: 0.11 0.09 0.09 5/258 35266
/proc/meminfo: memFree=129304600/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=120356 memory=107956 CPUtime=0.2 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 24870 0 0 0 17 3 0 0 20 0 1 0 4461624 123244544 26989 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 30089 26989 2347 3035 0 26485 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 120356 KiB
Current children cumulated memory: 107956 KiB

[startup+0.30622 s]*
/proc/loadavg: 0.11 0.09 0.09 5/258 35268
/proc/meminfo: memFree=129179992/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=160916 memory=148388 CPUtime=0.3 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 34984 0 0 0 26 4 0 0 20 0 1 0 4461624 164777984 37097 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 40229 37097 2347 3035 0 36625 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 160916 KiB
Current children cumulated memory: 148388 KiB

[startup+0.700237 s]
/proc/loadavg: 0.11 0.09 0.09 5/258 35268
/proc/meminfo: memFree=128944460/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=380208 memory=368684 CPUtime=0.69 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 90532 0 0 0 58 11 0 0 20 0 1 0 4461624 389332992 92171 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 95052 92171 2539 3035 0 91448 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 380208 KiB
Current children cumulated memory: 368684 KiB

[startup+1.50025 s]
/proc/loadavg: 0.11 0.09 0.09 5/258 35268
/proc/meminfo: memFree=128645264/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=626700 memory=600352 CPUtime=1.48 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 127923 0 0 0 130 18 0 0 20 0 1 0 4461624 641740800 150088 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 156675 150088 2662 3035 0 153071 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 626700 KiB
Current children cumulated memory: 600352 KiB

[startup+3.10638 s]
/proc/loadavg: 0.42 0.15 0.11 4/253 35278
/proc/meminfo: memFree=128510024/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=658640 memory=636940 CPUtime=3.08 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 138062 0 0 0 287 21 0 0 20 0 1 0 4461624 674447360 159235 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 164660 159235 2726 3035 0 161056 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 658640 KiB
Current children cumulated memory: 636940 KiB

[startup+6.30024 s]
/proc/loadavg: 0.42 0.15 0.11 6/258 35412
/proc/meminfo: memFree=127942800/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=658640 memory=636940 CPUtime=6.26 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 138117 0 0 0 605 21 0 0 20 0 1 0 4461624 674447360 159235 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 164660 159235 2726 3035 0 161056 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 658640 KiB
Current children cumulated memory: 636940 KiB

[startup+12.7002 s]
/proc/loadavg: 0.71 0.22 0.13 5/259 35470
/proc/meminfo: memFree=127883496/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=658640 memory=636940 CPUtime=12.63 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 138173 0 0 0 1242 21 0 0 20 0 1 0 4461624 674447360 159235 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 164660 159235 2726 3035 0 161056 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 658640 KiB
Current children cumulated memory: 636940 KiB

[startup+25.5003 s]
/proc/loadavg: 1.44 0.40 0.19 5/261 35474
/proc/meminfo: memFree=127658800/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=658640 memory=636940 CPUtime=25.39 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 138229 0 0 0 2517 22 0 0 20 0 1 0 4461624 674447360 159235 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 164660 159235 2726 3035 0 161056 0
Current children cumulated CPU time: 25.39 s
Current children cumulated vsize: 658640 KiB
Current children cumulated memory: 636940 KiB

[startup+51.1062 s]
/proc/loadavg: 2.38 0.71 0.30 6/263 35480
/proc/meminfo: memFree=125781492/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=1802552 memory=1620368 CPUtime=50.89 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 452371 0 0 0 5026 63 0 0 20 0 3 0 4461624 1845813248 405092 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 450638 405092 2966 3035 0 440606 0
[pid=35247/tid=35476] ppid=35242 vsize=1802552 memory=1292784 CPUtime=12.16 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 232207 0 0 0 1187 29 0 0 20 0 3 0 4465493 1845813248 405092 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=1802552 memory=11596 CPUtime=0 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 10 0 0 0 0 0 0 0 20 0 3 0 4465534 1845813248 405092 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 50.89 s
Current children cumulated vsize: 1802552 KiB
Current children cumulated memory: 1620368 KiB

[startup+102.3 s]
/proc/loadavg: 3.42 1.25 0.51 6/267 35495
/proc/meminfo: memFree=124962972/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2154400 memory=1970112 CPUtime=101.89 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 750438 0 0 0 10089 100 0 0 20 0 3 0 4461624 2206105600 492528 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 538600 492528 2982 3035 0 529811 0
[pid=35247/tid=35476] ppid=35242 vsize=2154400 memory=11596 CPUtime=63.15 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 530250 0 0 0 6250 65 0 0 20 0 3 0 4465493 2206105600 492528 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2154400 memory=-5155633496389544837 CPUtime=0 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 34 0 0 0 0 0 0 0 20 0 3 0 4465534 2206105600 492528 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 101.89 s
Current children cumulated vsize: 2154400 KiB
Current children cumulated memory: 1970112 KiB

[startup+162.3 s]
/proc/loadavg: 3.91 1.78 0.74 6/267 35505
/proc/meminfo: memFree=124208672/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2154400 memory=1971272 CPUtime=161.68 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 923856 0 0 0 16059 109 0 0 20 0 3 0 4461624 2206105600 492818 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 538600 492818 2982 3035 0 529811 0
[pid=35247/tid=35476] ppid=35242 vsize=2154400 memory=1971104 CPUtime=122.96 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 703656 0 0 0 12221 75 0 0 20 0 3 0 4465493 2206105600 492818 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2154400 memory=11596 CPUtime=0 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 46 0 0 0 0 0 0 0 20 0 3 0 4465534 2206105600 492818 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 161.68 s
Current children cumulated vsize: 2154400 KiB
Current children cumulated memory: 1971272 KiB

[startup+222.3 s]
/proc/loadavg: 4.09 2.22 0.96 6/265 35515
/proc/meminfo: memFree=124012644/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2154400 memory=1971744 CPUtime=221.49 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 999912 0 0 0 22036 113 0 0 20 0 3 0 4461624 2206105600 492936 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 538600 492936 2982 3035 0 529811 0
[pid=35247/tid=35476] ppid=35242 vsize=2154400 memory=1971744 CPUtime=182.76 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 779706 0 0 0 18197 79 0 0 20 0 3 0 4465493 2206105600 492936 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2154400 memory=11596 CPUtime=0 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 52 0 0 0 0 0 0 0 20 0 3 0 4465534 2206105600 492936 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 221.49 s
Current children cumulated vsize: 2154400 KiB
Current children cumulated memory: 1971744 KiB

[startup+282.3 s]
/proc/loadavg: 4.08 2.56 1.16 5/265 35526
/proc/meminfo: memFree=123967060/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2154400 memory=1971820 CPUtime=281.29 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 1141665 0 0 0 28008 121 0 0 20 0 3 0 4461624 2206105600 492955 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 538600 492955 2982 3035 0 529811 0
[pid=35247/tid=35476] ppid=35242 vsize=2154400 memory=1971820 CPUtime=242.56 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 921450 0 0 0 24169 87 0 0 20 0 3 0 4465493 2206105600 492955 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2154400 memory=1971820 CPUtime=0 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 61 0 0 0 0 0 0 0 20 0 3 0 4465534 2206105600 492955 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 281.29 s
Current children cumulated vsize: 2154400 KiB
Current children cumulated memory: 1971820 KiB

[startup+342.3 s]
/proc/loadavg: 4.07 2.84 1.34 5/259 35536
/proc/meminfo: memFree=123951548/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2154400 memory=1971860 CPUtime=341.11 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 1248336 0 0 0 33984 127 0 0 20 0 3 0 4461624 2206105600 492965 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 538600 492965 2982 3035 0 529811 0

################
# More data... #
################

[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3390.16 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2658250 0 0 0 338794 222 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3351.39 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2437363 0 0 0 334953 186 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=2315516 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 387 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3390.16 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3462.3 s]
/proc/loadavg: 4.06 4.11 4.03 5/261 37058
/proc/meminfo: memFree=122425728/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3449.94 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2662713 0 0 0 344772 222 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3411.16 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2441821 0 0 0 340930 186 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=-7523099919130911868 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 392 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3449.94 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3522.3 s]
/proc/loadavg: 4.06 4.10 4.03 5/263 37238
/proc/meminfo: memFree=122415256/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3509.71 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2664997 0 0 0 350749 222 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3470.93 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2444099 0 0 0 346907 186 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=2315516 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 398 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3509.71 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3582.3 s]
/proc/loadavg: 4.12 4.11 4.04 5/263 37248
/proc/meminfo: memFree=122398072/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3569.49 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2669322 0 0 0 356726 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3530.71 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2448419 0 0 0 352884 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=11596 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 403 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3569.49 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3600.01 s]
# the end of solver process 35247 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3584.86 s, system=2.2803 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.11 4.11 4.04 5/263 37248
/proc/meminfo: memFree=122398140/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3571.19 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2669322 0 0 0 356896 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=6976 CPUtime=3532.41 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2448419 0 0 0 353054 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=4792 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 403 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3571.19 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3590.4 s]
/proc/loadavg: 4.10 4.11 4.04 5/263 37248
/proc/meminfo: memFree=122396352/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3577.56 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2669333 0 0 0 357533 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=11596 CPUtime=3538.78 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2448427 0 0 0 353691 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=2315516 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 406 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3577.56 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3596.8 s]
/proc/loadavg: 4.09 4.10 4.04 5/263 37250
/proc/meminfo: memFree=122395504/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3583.93 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2669345 0 0 0 358170 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3545.15 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2448438 0 0 0 354328 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=5600 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 407 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3583.93 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3598.4 s]
/proc/loadavg: 4.09 4.10 4.04 5/263 37250
/proc/meminfo: memFree=122395360/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3585.53 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2669345 0 0 0 358330 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3546.75 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2448438 0 0 0 354488 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=4354026035579874971 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 407 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3585.53 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3599.2 s]
/proc/loadavg: 4.01 4.09 4.03 5/254 37332
/proc/meminfo: memFree=124711080/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3586.32 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2671740 0 0 0 358409 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=1836 CPUtime=3547.54 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2450818 0 0 0 354567 187 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=2160 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 407 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3586.32 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3599.6 s]
/proc/loadavg: 4.01 4.09 4.03 5/254 37332
/proc/meminfo: memFree=124711080/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=2482080 memory=2315516 CPUtime=3586.71 cores=0,2
/proc/35247/stat : 35247 (fscip) S 35242 35247 35189 0 -1 1077936128 2672845 0 0 0 358448 223 0 0 20 0 3 0 4461624 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 620520 578879 3030 3035 0 609122 0
[pid=35247/tid=35476] ppid=35242 vsize=2482080 memory=13016 CPUtime=3547.94 cores=0,2
/proc/35247/task/35476/stat : 35476 (fscip) R 35242 35247 35189 0 -1 4194368 2451923 0 0 0 354606 188 0 0 20 0 3 0 4465493 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
[pid=35247/tid=35477] ppid=35242 vsize=2482080 memory=12272 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 407 0 0 0 2 2 0 0 20 0 3 0 4465534 2541649920 578879 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3586.71 s
Current children cumulated vsize: 2482080 KiB
Current children cumulated memory: 2315516 KiB

[startup+3600 s]*
/proc/loadavg: 4.01 4.09 4.03 5/260 37344
/proc/meminfo: memFree=124802992/131524600 swapFree=131071996/131071996
[pid=35247] ppid=35242 vsize=1719712 memory=1678332 CPUtime=3587.12 cores=0,2
/proc/35247/stat : 35247 (fscip) R 35242 35247 35189 0 -1 4194304 2687259 0 0 0 358485 227 0 0 20 0 2 0 4461624 1760985088 419583 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
/proc/35247/statm: 429928 419583 3030 3035 0 421506 0
[pid=35247/tid=35477] ppid=35242 vsize=1719712 memory=-6000919468445230444 CPUtime=0.04 cores=0,2
/proc/35247/task/35477/stat : 35477 (fscip) S 35242 35247 35189 0 -1 1077936192 407 0 0 0 2 2 0 0 20 0 2 0 4465534 1760985088 419583 134679101440 4194304 16623229 140731670240016 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 28082176 140731670242330 140731670242446 140731670242446 140731670249456 0
Current children cumulated CPU time: 3587.12 s
Current children cumulated vsize: 1719712 KiB
Current children cumulated memory: 1678332 KiB

Child status: 0

Real time (s): 3600.01
CPU time (s): 3587.14
CPU user time (s): 3584.86
CPU system time (s): 2.2803
CPU usage (%): 99.6423
Max. virtual memory (cumulated for all children) (KiB): 2482080
Max. memory (cumulated for all children) (KiB): 2315516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3584.86
system time used= 2.2803
maximum resident set size= 2315516
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2687263
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3669
involuntary context switches= 25335


# summary of solver processes directly reported to runsolver:
#   pid: 35247
#   total CPU time (s): 3587.14
#   total CPU user time (s): 3584.86
#   total CPU system time (s): 2.2803

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.72893 second user time and 17.5705 second system time

The end

Launcher Data 

Begin job on nodeC030 at 2024-07-31 00:29:57
IDJOB=4464420
IDBENCH=147714
IDSOLVER=3092
FILE ID=nodeC030/4464420-1722378597
RUNJOBID= nodeC030-1722378597-35199
SLURM_JOB_ID= 8249853
Free space on /tmp= 890064 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/normalized-ooo.ex.mem.LdValue.ucl.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464420-1722378597/watcher-4464420-1722378597 -o /tmp/evaluation-result-4464420-1722378597/solver-4464420-1722378597 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1722378597-35199 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464420-1722378597.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= ab585d5a9f1265a4903b33e81faedd32
RANDOM SEED=576650998

nodeC030.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3587.455
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3128.212
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3489.179
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3656.265
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3580.721
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.600
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3623.204
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3589.128
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        129616544 kB
MemAvailable:   129934772 kB
Buffers:           83280 kB
Cached:          1070896 kB
SwapCached:            0 kB
Active:           252808 kB
Inactive:        1176212 kB
Active(anon):       1452 kB
Inactive(anon):   295124 kB
Active(file):     251356 kB
Inactive(file):   881088 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            125140 kB
Writeback:             0 kB
AnonPages:        275320 kB
Mapped:            88288 kB
Shmem:             21328 kB
KReclaimable:      51216 kB
Slab:             132624 kB
SReclaimable:      51216 kB
SUnreclaim:        81408 kB
KernelStack:        3792 kB
PageTables:         9136 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     567860 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9152 kB
HardwareCorrupted:     0 kB
AnonHugePages:    165888 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      221908 kB
DirectMap2M:     6891520 kB
DirectMap1G:    128974848 kB

Free space on /tmp at the end= 889948 MiB
End job on nodeC030 at 2024-07-31 01:29:57