Trace number 4441490

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3587.11 3601.87

General information on the benchmark

NamePB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/
normalized-ooo.ex.mem.LdValue.ucl.opb
MD5SUMab585d5a9f1265a4903b33e81faedd32
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark17.3591
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables77106
Total number of constraints218779
Number of constraints which are clauses205559
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints13220
Minimum length of a constraint1
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 129
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 510
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.78/0.83	c Default LC presolving (default).
0.78/0.83	c ** Before presolving: virtualMemUsedAtLc = 702486207, getVmSize() = 461189120, SCIPgetMemUsed() = 408267359, SCIPgetMemTotal() = 421835423, SCIPgetMemExternEstim() = 280650784
0.78/0.83	c ** set memory limit for presolving in LC to 8.79588e+12 for SCIP **
39.00/39.25	c ** Estimated virtualMemUsedAtSolver = 732171662, getVmSize() = 888135680, SCIPgetMemUsed() = 513263517, SCIPgetMemTotal() = 817606709, SCIPgetMemExternEstim() = 280650784
39.00/39.25	c ** set memory limit for solvers to 4.39802e+12 for each SCIP **
39.00/39.25	c Original Problem   :
39.00/39.25	c   Problem name     : instance-4441490-1721293756
39.00/39.25	c   Variables        : 77106 (77106 binary, 0 integer, 0 implicit integer, 0 continuous)
39.00/39.25	c   Constraints      : 218779
39.00/39.25	c   Objective sense  : minimize
39.00/39.25	c Presolved Problem  :
39.00/39.25	c   Variables        : 67151 (67151 binary, 0 integer, 0 implicit integer, 0 continuous)
39.00/39.25	c   Constraints      : 73848
39.00/39.25	c Constraints        : Number
39.00/39.25	c   knapsack         : 13220 
39.00/39.25	c   setppc           : 1652 
39.00/39.25	c   and              : 58968 
39.00/39.25	c   logicor          : 8 
39.00/39.25	c ** Instance transfer method used: 0
39.21/39.45	c ** ParaScipInstance copy increased the number of variables. **
39.40/39.66	c LC is working with racing ramp-up and with rebuilding tree after racing.
39.40/39.66	c                                Nodes    Active                                            
39.40/39.66	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1710.39/1719.37	c      1719              2           1         1                -           0.0000          -
1814.09/1823.32	c      1823              3           2         1                -           0.0000          -
1844.49/1853.80	c      1854              4           3         1                -           0.0000          -
1942.28/1951.95	c      1952              5           4         1                -           0.0000          -
1968.48/1978.20	c      1978              6           5         1                -           0.0000          -
2035.48/2045.44	c      2045              7           6         1                -           0.0000          -
2059.20/2069.21	c      2069              8           7         1                -           0.0000          -
2144.64/2154.91	c      2155              9           8         1                -           0.0000          -
2374.74/2385.76	c      2386             10           9         1                -           0.0000          -
2393.77/2404.86	c      2405             11          10         1                -           0.0000          -
2456.45/2467.70	c      2468             12          11         1                -           0.0000          -
2471.80/2483.10	c      2483             13          12         1                -           0.0000          -
2533.61/2545.16	c      2545             14          13         1                -           0.0000          -
2619.53/2631.35	c      2631             15          14         1                -           0.0000          -
2642.66/2654.56	c      2655             16          15         1                -           0.0000          -
2667.66/2679.69	c      2680             17          16         1                -           0.0000          -
2835.76/2848.25	c      2848             18          17         1                -           0.0000          -
2898.46/2911.10	c      2911             19          18         1                -           0.0000          -
2914.09/2926.84	c      2927             20          19         1                -           0.0000          -
2928.35/2941.16	c      2941             21          20         1                -           0.0000          -
2945.78/2958.64	c      2959             22          21         1                -           0.0000          -
2961.33/2974.23	c      2974             23          22         1                -           0.0000          -
2980.07/2993.08	c      2993             24          23         1                -           0.0000          -
3586.03/3600.88	c      3601             24          23         0                -           0.0000          -
3586.63/3601.47	c SCIP Status        : c solving was interrupted [hard time limit reached]
3586.63/3601.48	c Total Time         : 3601.4800
3586.63/3601.48	c   solving          : 3601.4800
3586.63/3601.48	c   presolving       : 38.4143 (included in solving)
3586.63/3601.48	c B&B Tree           :
3586.63/3601.48	c   nodes (total)    : 1
3586.63/3601.48	c Solution           :
3586.63/3601.48	c   Solutions found  : 0
3586.63/3601.48	c   Primal Bound     :          -
3586.63/3601.48	c   Dual Bound       : +0.00000000000000e+00
3586.63/3601.48	c Gap                :          -
3587.03/3601.85	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (62738 MiB free)
  memory of node 1: 64473 MiB (63260 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4441490-1721293756/watcher-4441490-1721293756 -o /tmp/evaluation-result-4441490-1721293756/solver-4441490-1721293756 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC026-1721293769-954237 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4441490-1721293756.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=954279, runsolver pid=954276

[startup+0.100334 s]*
/proc/loadavg: 1.41 1.15 1.18 5/257 954300
/proc/meminfo: memFree=128918760/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=70084 memory=58092 CPUtime=0.09 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 12464 0 0 0 7 2 0 0 20 0 1 0 181541808 71766016 14523 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 17521 14523 2318 3032 0 13921 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 70084 KiB
Current children cumulated memory: 58092 KiB

[startup+0.205613 s]*
/proc/loadavg: 1.41 1.15 1.18 5/257 954300
/proc/meminfo: memFree=128784612/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=115800 memory=103424 CPUtime=0.19 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 23762 0 0 0 15 4 0 0 20 0 1 0 181541808 118579200 25856 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 28950 25856 2318 3032 0 25350 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 115800 KiB
Current children cumulated memory: 103424 KiB

[startup+0.305582 s]*
/proc/loadavg: 1.41 1.15 1.18 5/257 954300
/proc/meminfo: memFree=128652932/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=157308 memory=144900 CPUtime=0.3 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 34137 0 0 0 24 6 0 0 20 0 1 0 181541808 161083392 36225 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 39327 36225 2318 3032 0 35727 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 157308 KiB
Current children cumulated memory: 144900 KiB

[startup+0.700226 s]
/proc/loadavg: 1.41 1.15 1.18 5/257 954300
/proc/meminfo: memFree=128380404/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=376668 memory=364736 CPUtime=0.69 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 89520 0 0 0 55 14 0 0 20 0 1 0 181541808 385708032 91184 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 94167 91184 2542 3032 0 90567 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 376668 KiB
Current children cumulated memory: 364736 KiB

[startup+1.50024 s]
/proc/loadavg: 1.41 1.15 1.18 5/257 954300
/proc/meminfo: memFree=127685772/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=636660 memory=612116 CPUtime=1.48 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 128817 0 0 0 127 21 0 0 20 0 1 0 181541808 651939840 153029 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 159165 153029 2638 3032 0 155565 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 636660 KiB
Current children cumulated memory: 612116 KiB

[startup+3.10565 s]
/proc/loadavg: 1.41 1.15 1.18 5/259 954302
/proc/meminfo: memFree=126598228/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=658624 memory=636524 CPUtime=3.07 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 138548 0 0 0 284 23 0 0 20 0 1 0 181541808 674430976 159131 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 164656 159131 2654 3032 0 161056 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 658624 KiB
Current children cumulated memory: 636524 KiB

[startup+6.30024 s]
/proc/loadavg: 1.62 1.20 1.20 5/259 954302
/proc/meminfo: memFree=126220816/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=658624 memory=636856 CPUtime=6.26 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 138598 0 0 0 602 24 0 0 20 0 1 0 181541808 674430976 159214 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 164656 159214 2702 3032 0 161056 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 658624 KiB
Current children cumulated memory: 636856 KiB

[startup+12.7002 s]
/proc/loadavg: 1.81 1.24 1.21 5/259 954304
/proc/meminfo: memFree=126156760/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=658624 memory=636856 CPUtime=12.63 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 138675 0 0 0 1238 25 0 0 20 0 1 0 181541808 674430976 159214 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 164656 159214 2702 3032 0 161056 0
Current children cumulated CPU time: 12.63 s
Current children cumulated vsize: 658624 KiB
Current children cumulated memory: 636856 KiB

[startup+25.5002 s]
/proc/loadavg: 2.37 1.40 1.26 5/259 954353
/proc/meminfo: memFree=124213552/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=658624 memory=636856 CPUtime=25.38 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 138727 0 0 0 2512 26 0 0 20 0 1 0 181541808 674430976 159214 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 164656 159214 2702 3032 0 161056 0
Current children cumulated CPU time: 25.38 s
Current children cumulated vsize: 658624 KiB
Current children cumulated memory: 636856 KiB

[startup+51.1063 s]
/proc/loadavg: 3.06 1.64 1.35 5/263 954364
/proc/meminfo: memFree=123108368/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=1802008 memory=1616068 CPUtime=50.77 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 458178 0 0 0 5010 67 0 0 20 0 3 0 181541808 1845256192 404017 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 450502 404017 2926 3032 0 439002 0
[pid=954279/tid=954361] ppid=954276 vsize=1802008 memory=11664 CPUtime=11.5 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 238092 0 0 0 1121 29 0 0 20 0 3 0 181545733 1845256192 404017 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=1802008 memory=11664 CPUtime=0 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 11 0 0 0 0 0 0 0 20 0 3 0 181545775 1845256192 404017 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 50.77 s
Current children cumulated vsize: 1802008 KiB
Current children cumulated memory: 1616068 KiB

[startup+102.3 s]
/proc/loadavg: 3.64 2.02 1.49 5/263 954372
/proc/meminfo: memFree=122695308/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2162376 memory=1976008 CPUtime=101.44 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 741816 0 0 0 10046 98 0 0 20 0 3 0 181541808 2214273024 494002 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 540594 494002 2942 3032 0 531946 0
[pid=954279/tid=954361] ppid=954276 vsize=2162376 memory=1976008 CPUtime=62.17 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 521701 0 0 0 6157 60 0 0 20 0 3 0 181545733 2214273024 494002 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2162376 memory=1976008 CPUtime=0 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 40 0 0 0 0 0 0 0 20 0 3 0 181545775 2214273024 494002 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 101.44 s
Current children cumulated vsize: 2162376 KiB
Current children cumulated memory: 1976008 KiB

[startup+162.3 s]
/proc/loadavg: 3.97 2.41 1.66 5/264 954385
/proc/meminfo: memFree=121584304/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2162376 memory=1982196 CPUtime=160.88 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 905914 0 0 0 15981 107 0 0 20 0 3 0 181541808 2214273024 495549 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 540594 495549 2942 3032 0 531946 0
[pid=954279/tid=954361] ppid=954276 vsize=2162376 memory=1982144 CPUtime=121.6 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 685785 0 0 0 12091 69 0 0 20 0 3 0 181545733 2214273024 495549 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2162376 memory=1982196 CPUtime=0 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 54 0 0 0 0 0 0 0 20 0 3 0 181545775 2214273024 495549 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 160.88 s
Current children cumulated vsize: 2162376 KiB
Current children cumulated memory: 1982196 KiB

[startup+222.3 s]
/proc/loadavg: 4.04 2.72 1.82 5/264 954397
/proc/meminfo: memFree=121475192/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2162376 memory=1982696 CPUtime=220.3 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 981255 0 0 0 21919 111 0 0 20 0 3 0 181541808 2214273024 495674 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 540594 495674 2942 3032 0 531946 0
[pid=954279/tid=954361] ppid=954276 vsize=2162376 memory=11664 CPUtime=181.02 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 761119 0 0 0 18029 73 0 0 20 0 3 0 181545733 2214273024 495674 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2162376 memory=12420 CPUtime=0 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 61 0 0 0 0 0 0 0 20 0 3 0 181545775 2214273024 495674 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 220.3 s
Current children cumulated vsize: 2162376 KiB
Current children cumulated memory: 1982696 KiB

[startup+282.3 s]
/proc/loadavg: 4.13 2.99 1.97 5/264 954408
/proc/meminfo: memFree=121433332/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2162376 memory=1986252 CPUtime=279.69 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 1105376 0 0 0 27851 118 0 0 20 0 3 0 181541808 2214273024 496563 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 540594 496563 2942 3032 0 531946 0
[pid=954279/tid=954361] ppid=954276 vsize=2162376 memory=1984876 CPUtime=240.42 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 885232 0 0 0 23962 80 0 0 20 0 3 0 181545733 2214273024 496563 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2162376 memory=11664 CPUtime=0 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 69 0 0 0 0 0 0 0 20 0 3 0 181545775 2214273024 496563 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 279.69 s
Current children cumulated vsize: 2162376 KiB
Current children cumulated memory: 1986252 KiB

[startup+342.3 s]
/proc/loadavg: 4.11 3.19 2.10 5/264 954420
/proc/meminfo: memFree=120768776/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2162376 memory=1986984 CPUtime=339.14 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 1212851 0 0 0 33790 124 0 0 20 0 3 0 181541808 2214273024 496746 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 540594 496746 2942 3032 0 531946 0

################
# More data... #
################

/proc/loadavg: 4.09 4.14 4.07 5/263 956169
/proc/meminfo: memFree=119147032/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3388.12 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2103528 0 0 0 338624 188 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=43436 CPUtime=3348.81 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1882697 0 0 0 334734 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=2322024 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 454 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3388.12 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3462.3 s]
/proc/loadavg: 4.15 4.14 4.08 5/263 956179
/proc/meminfo: memFree=119123472/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3447.96 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2106749 0 0 0 344608 188 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=43436 CPUtime=3408.65 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1885912 0 0 0 340718 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=2322024 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 460 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3447.96 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3522.3 s]
/proc/loadavg: 4.12 4.13 4.08 5/263 956190
/proc/meminfo: memFree=119119104/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3507.79 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2110386 0 0 0 350590 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3468.47 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1889543 0 0 0 346700 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=2322024 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 466 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3507.79 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3582.3 s]
/proc/loadavg: 4.09 4.12 4.08 5/262 956200
/proc/meminfo: memFree=119109288/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3567.6 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2113505 0 0 0 356571 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=11664 CPUtime=3528.27 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1892656 0 0 0 352680 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=26000 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 472 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3567.6 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3601.87 s]
# the end of solver process 954279 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3585.17 s, system=1.94612 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.09 4.12 4.08 5/262 956200
/proc/meminfo: memFree=119109308/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3569.3 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2113511 0 0 0 356741 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=6720669843785531243 CPUtime=3529.97 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1892660 0 0 0 352850 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=-7305250529052680831 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 474 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3569.3 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3590.4 s]
/proc/loadavg: 4.08 4.12 4.08 5/262 956201
/proc/meminfo: memFree=119109212/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3575.67 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2114092 0 0 0 357378 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3536.35 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1893238 0 0 0 353488 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=2322024 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 477 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3575.67 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3596.8 s]
/proc/loadavg: 4.15 4.13 4.08 5/262 956201
/proc/meminfo: memFree=119109212/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3582.05 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2114449 0 0 0 358016 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=11664 CPUtime=3542.72 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1893594 0 0 0 354125 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=43436 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3582.05 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3600 s]*
/proc/loadavg: 4.15 4.13 4.08 5/262 956203
/proc/meminfo: memFree=119109140/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3585.24 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2114449 0 0 0 358335 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=6720669843785531243 CPUtime=3545.92 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1893594 0 0 0 354445 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=-7305250529052680831 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3585.24 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3600.8 s]
/proc/loadavg: 4.15 4.13 4.08 5/262 956203
/proc/meminfo: memFree=119109140/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2490056 memory=2322024 CPUtime=3586.03 cores=0,2
/proc/954279/stat : 954279 (fscip) S 954276 954279 954227 0 -1 1077936128 2114449 0 0 0 358414 189 0 0 20 0 3 0 181541808 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 622514 580506 2990 3032 0 611125 0
[pid=954279/tid=954361] ppid=954276 vsize=2490056 memory=39476 CPUtime=3546.71 cores=0,2
/proc/954279/task/954361/stat : 954361 (fscip) R 954276 954279 954227 0 -1 4194368 1893594 0 0 0 354524 147 0 0 20 0 3 0 181545733 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
[pid=954279/tid=954362] ppid=954276 vsize=2490056 memory=26000 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 3 0 181545775 2549817344 580506 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3586.03 s
Current children cumulated vsize: 2490056 KiB
Current children cumulated memory: 2322024 KiB

[startup+3601.6 s]
/proc/loadavg: 4.14 4.13 4.08 5/260 956203
/proc/meminfo: memFree=119528496/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2348056 memory=2204972 CPUtime=3586.83 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 2122625 0 0 0 358493 190 0 0 20 0 2 0 181541808 2404409344 551243 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 587014 551243 2990 3032 0 578145 0
[pid=954279/tid=954362] ppid=954276 vsize=2348056 memory=32192 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 2 0 181545775 2404409344 551243 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3586.83 s
Current children cumulated vsize: 2348056 KiB
Current children cumulated memory: 2204972 KiB

[startup+3601.8 s]
/proc/loadavg: 4.14 4.13 4.08 5/260 956203
/proc/meminfo: memFree=119528496/131524600 swapFree=131071996/131071996
[pid=954279] ppid=954276 vsize=2174352 memory=2031400 CPUtime=3587.03 cores=0,2
/proc/954279/stat : 954279 (fscip) R 954276 954279 954227 0 -1 4194304 2125905 0 0 0 358512 191 0 0 20 0 2 0 181541808 2226536448 507850 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
/proc/954279/statm: 543588 507850 2990 3032 0 534719 0
[pid=954279/tid=954362] ppid=954276 vsize=2174352 memory=2322024 CPUtime=0.04 cores=0,2
/proc/954279/task/954362/stat : 954362 (fscip) S 954276 954279 954227 0 -1 1077936192 478 0 0 0 1 3 0 0 20 0 2 0 181545775 2226536448 507850 134679101440 4194304 16613245 140723830506432 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 52944896 140723830514708 140723830514824 140723830514824 140723830521840 0
Current children cumulated CPU time: 3587.03 s
Current children cumulated vsize: 2174352 KiB
Current children cumulated memory: 2031400 KiB

Child status: 0

Real time (s): 3601.87
CPU time (s): 3587.11
CPU user time (s): 3585.17
CPU system time (s): 1.94612
CPU usage (%): 99.5902
Max. virtual memory (cumulated for all children) (KiB): 2490056
Max. memory (cumulated for all children) (KiB): 2322024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3585.17
system time used= 1.94612
maximum resident set size= 2322024
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2131359
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3657
involuntary context switches= 28179


# summary of solver processes directly reported to runsolver:
#   pid: 954279
#   total CPU time (s): 3587.11
#   total CPU user time (s): 3585.17
#   total CPU system time (s): 1.94612

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.36321 second user time and 14.8618 second system time

The end

Launcher Data 

Begin job on nodeC026 at 2024-07-18 11:09:29
IDJOB=4441490
IDBENCH=147714
IDSOLVER=3064
FILE ID=nodeC026/4441490-1721293756
RUNJOBID= nodeC026-1721293769-954237
SLURM_JOB_ID= 7542600
Free space on /tmp= 890032 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB06/DEC-LIN/web/uclid_pb_benchmarks/normalized-ooo.ex.mem.LdValue.ucl.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4441490-1721293756/watcher-4441490-1721293756 -o /tmp/evaluation-result-4441490-1721293756/solver-4441490-1721293756 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC026-1721293769-954237 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4441490-1721293756.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= ab585d5a9f1265a4903b33e81faedd32
RANDOM SEED=1658214032

nodeC026.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.172
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.852
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3645.576
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.741
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3640.370
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3630.442
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3659.086
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3667.084
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        129057236 kB
MemAvailable:   129712992 kB
Buffers:          498372 kB
Cached:           993996 kB
SwapCached:            0 kB
Active:           979148 kB
Inactive:         877040 kB
Active(anon):       1452 kB
Inactive(anon):   399760 kB
Active(file):     977696 kB
Inactive(file):   477280 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            118424 kB
Writeback:            28 kB
AnonPages:        360268 kB
Mapped:           116000 kB
Shmem:             37720 kB
KReclaimable:      81208 kB
Slab:             192224 kB
SReclaimable:      81208 kB
SUnreclaim:       111016 kB
KernelStack:        3904 kB
PageTables:        10268 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     653072 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            67808 kB
HardwareCorrupted:     0 kB
AnonHugePages:    210944 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      260820 kB
DirectMap2M:    27824128 kB
DirectMap1G:    108003328 kB

Free space on /tmp at the end= 889948 MiB
End job on nodeC026 at 2024-07-18 12:09:31