Trace number 4446770

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3591.16 3600.28

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K193.opb
MD5SUMa57909b893e448cbfc1c45d11e8afcf3
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark62.0014
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables22967
Total number of constraints23355
Number of constraints which are clauses23162
Number of constraints which are cardinality constraints (but not clauses)193
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint193
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 194
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.10/0.14	c Default LC presolving (default).
0.10/0.14	c ** Before presolving: virtualMemUsedAtLc = 133711458, getVmSize() = 113336320, SCIPgetMemUsed() = 81730430, SCIPgetMemTotal() = 89076142, SCIPgetMemExternEstim() = 44635316
0.10/0.14	c ** set memory limit for presolving in LC to 8.79605e+12 for SCIP **
64.12/64.33	c ** Estimated virtualMemUsedAtSolver = 279045315, getVmSize() = 408244224, SCIPgetMemUsed() = 284662273, SCIPgetMemTotal() = 373932657, SCIPgetMemExternEstim() = 44635316
64.12/64.33	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
64.12/64.33	c Original Problem   :
64.12/64.33	c   Problem name     : instance-4446770-1721342178
64.12/64.33	c   Variables        : 22967 (22967 binary, 0 integer, 0 implicit integer, 0 continuous)
64.12/64.33	c   Constraints      : 23355
64.12/64.33	c   Objective sense  : minimize
64.12/64.33	c Presolved Problem  :
64.12/64.33	c   Variables        : 21404 (21404 binary, 0 integer, 0 implicit integer, 0 continuous)
64.12/64.33	c   Constraints      : 21711
64.12/64.33	c Constraints        : Number
64.12/64.33	c   setppc           : 2634 
64.12/64.33	c   orbitope         : 1 
64.12/64.33	c   logicor          : 19076 
64.12/64.33	c ** Instance transfer method used: 0
64.12/64.38	c ** ParaScipInstance copy increased the number of variables. **
64.22/64.44	c LC is working with racing ramp-up and with rebuilding tree after racing.
64.22/64.44	c                                Nodes    Active                                            
64.22/64.44	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3590.87/3600.05	c      3600              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3590.97/3600.17	c SCIP Status        : c solving was interrupted [hard time limit reached]
3590.97/3600.17	c Total Time         : 3600.1800
3590.97/3600.17	c   solving          : 3600.1800
3590.97/3600.17	c   presolving       : 64.1828 (included in solving)
3590.97/3600.17	c B&B Tree           :
3590.97/3600.17	c   nodes (total)    : 1
3590.97/3600.17	c Solution           :
3590.97/3600.17	c   Solutions found  : 0
3590.97/3600.17	c   Primal Bound     :          -
3590.97/3600.17	c   Dual Bound       :          -
3590.97/3600.17	c Gap                :          -
3591.07/3600.27	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61677 MiB free)
  memory of node 1: 64510 MiB (61092 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446770-1721342178/watcher-4446770-1721342178 -o /tmp/evaluation-result-4446770-1721342178/solver-4446770-1721342178 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721342191-1000736 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446770-1721342178.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1000794, runsolver pid=1000782
Current StackSize limit: 8192 KiB


[startup+0.100091 s]*
/proc/loadavg: 4.25 4.22 4.24 7/256 1000800
/proc/meminfo: memFree=125461204/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=87576 memory=77316 CPUtime=0.1 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 17113 0 0 0 8 2 0 0 20 0 1 0 186385190 89677824 19329 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 21894 19329 2542 3032 0 18294 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 87576 KiB
Current children cumulated memory: 77316 KiB

[startup+0.206885 s]*
/proc/loadavg: 4.25 4.22 4.24 7/256 1000800
/proc/meminfo: memFree=125357304/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=119704 memory=105744 CPUtime=0.2 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 24149 0 0 0 17 3 0 0 20 0 1 0 186385190 122576896 26436 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 29926 26436 2590 3032 0 26326 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 119704 KiB
Current children cumulated memory: 105744 KiB

[startup+0.30637 s]*
/proc/loadavg: 4.25 4.22 4.24 7/256 1000800
/proc/meminfo: memFree=125267872/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=150696 memory=136856 CPUtime=0.3 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 32730 0 0 0 25 5 0 0 20 0 1 0 186385190 154312704 34214 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 37674 34214 2638 3032 0 34074 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 150696 KiB
Current children cumulated memory: 136856 KiB

[startup+0.700239 s]
/proc/loadavg: 4.25 4.22 4.24 7/256 1000800
/proc/meminfo: memFree=125273096/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=140364 memory=126764 CPUtime=0.69 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 32733 0 0 0 64 5 0 0 20 0 1 0 186385190 143732736 31691 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 35091 31691 2686 3032 0 31491 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 140364 KiB
Current children cumulated memory: 126764 KiB

[startup+1.50023 s]
/proc/loadavg: 4.23 4.22 4.24 6/256 1000800
/proc/meminfo: memFree=125199112/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=195416 memory=179084 CPUtime=1.48 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 43793 0 0 0 142 6 0 0 20 0 1 0 186385190 200105984 44771 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 48854 44771 2734 3032 0 45254 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 195416 KiB
Current children cumulated memory: 179084 KiB

[startup+3.10644 s]
/proc/loadavg: 4.23 4.22 4.24 6/256 1000800
/proc/meminfo: memFree=125061916/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=211144 memory=194468 CPUtime=3.09 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 47874 0 0 0 302 7 0 0 20 0 1 0 186385190 216211456 48617 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 52786 48617 2734 3032 0 49186 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 211144 KiB
Current children cumulated memory: 194468 KiB

[startup+6.30022 s]
/proc/loadavg: 4.29 4.23 4.25 6/256 1000802
/proc/meminfo: memFree=125058080/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=211144 memory=194468 CPUtime=6.27 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 47878 0 0 0 620 7 0 0 20 0 1 0 186385190 216211456 48617 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 52786 48617 2734 3032 0 49186 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 211144 KiB
Current children cumulated memory: 194468 KiB

[startup+12.7002 s]
/proc/loadavg: 4.27 4.23 4.25 6/256 1000802
/proc/meminfo: memFree=125026308/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=220144 memory=203540 CPUtime=12.66 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 49685 0 0 0 1258 8 0 0 20 0 1 0 186385190 225427456 50885 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 55036 50885 2734 3032 0 51436 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 220144 KiB
Current children cumulated memory: 203540 KiB

[startup+25.5002 s]
/proc/loadavg: 4.22 4.22 4.24 6/258 1000807
/proc/meminfo: memFree=124770152/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=221708 memory=205084 CPUtime=25.43 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 50076 0 0 0 2535 8 0 0 20 0 1 0 186385190 227028992 51271 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 55427 51271 2734 3032 0 51827 0
Current children cumulated CPU time: 25.43 s
Current children cumulated vsize: 221708 KiB
Current children cumulated memory: 205084 KiB

[startup+51.1064 s]
/proc/loadavg: 4.20 4.21 4.24 7/262 1000814
/proc/meminfo: memFree=124226028/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=222752 memory=206108 CPUtime=50.96 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 50343 0 0 0 5088 8 0 0 20 0 1 0 186385190 228098048 51527 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 55688 51527 2734 3032 0 52088 0
Current children cumulated CPU time: 50.96 s
Current children cumulated vsize: 222752 KiB
Current children cumulated memory: 206108 KiB

[startup+102.3 s]
/proc/loadavg: 4.24 4.22 4.24 6/264 1000824
/proc/meminfo: memFree=123712656/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=712576 memory=572708 CPUtime=102.01 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 225330 0 0 0 10175 26 0 0 20 0 3 0 186385190 729677824 143177 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 178144 143177 2926 3032 0 166151 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=712576 memory=207156 CPUtime=37.8 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 139413 0 0 0 3768 12 0 0 20 0 3 0 186391624 729677824 143177 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=712576 memory=572640 CPUtime=0 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 43 0 0 0 0 0 0 0 20 0 3 0 186391635 729677824 143177 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 102.01 s
Current children cumulated vsize: 712576 KiB
Current children cumulated memory: 572708 KiB

[startup+162.3 s]
/proc/loadavg: 4.13 4.20 4.23 7/264 1000835
/proc/meminfo: memFree=123627924/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=712576 memory=575140 CPUtime=161.86 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 243044 0 0 0 16159 27 0 0 20 0 3 0 186385190 729677824 143785 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 178144 143785 2926 3032 0 167062 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=712576 memory=-7952647673509797760 CPUtime=97.64 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 157106 0 0 0 9751 13 0 0 20 0 3 0 186391624 729677824 143785 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=712576 memory=575140 CPUtime=0 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 64 0 0 0 0 0 0 0 20 0 3 0 186391635 729677824 143785 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 161.86 s
Current children cumulated vsize: 712576 KiB
Current children cumulated memory: 575140 KiB

[startup+222.3 s]
/proc/loadavg: 4.14 4.19 4.22 6/264 1000845
/proc/meminfo: memFree=123520020/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=712576 memory=575748 CPUtime=221.7 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 256900 0 0 0 22142 28 0 0 20 0 3 0 186385190 729677824 143937 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 178144 143937 2926 3032 0 167062 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=712576 memory=575176 CPUtime=157.49 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 170948 0 0 0 15735 14 0 0 20 0 3 0 186391624 729677824 143937 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=712576 memory=575176 CPUtime=0 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 78 0 0 0 0 0 0 0 20 0 3 0 186391635 729677824 143937 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 221.7 s
Current children cumulated vsize: 712576 KiB
Current children cumulated memory: 575748 KiB

[startup+282.3 s]
/proc/loadavg: 4.10 4.17 4.21 6/266 1000860
/proc/meminfo: memFree=123492416/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=712576 memory=578064 CPUtime=281.55 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 264811 0 0 0 28126 29 0 0 20 0 3 0 186385190 729677824 144516 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 178144 144516 2926 3032 0 167571 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=712576 memory=575972 CPUtime=217.34 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 178852 0 0 0 21719 15 0 0 20 0 3 0 186391624 729677824 144516 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=712576 memory=575976 CPUtime=0 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 85 0 0 0 0 0 0 0 20 0 3 0 186391635 729677824 144516 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 281.55 s
Current children cumulated vsize: 712576 KiB
Current children cumulated memory: 578064 KiB

[startup+342.3 s]
/proc/loadavg: 4.17 4.18 4.21 7/264 1000870
/proc/meminfo: memFree=123382172/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=719692 memory=584628 CPUtime=341.4 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 272044 0 0 0 34110 30 0 0 20 0 3 0 186385190 736964608 146157 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 179923 146157 2926 3032 0 169519 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=719692 memory=575972 CPUtime=277.19 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 186078 0 0 0 27703 16 0 0 20 0 3 0 186391624 736964608 146157 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=719692 memory=575976 CPUtime=0 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 92 0 0 0 0 0 0 0 20 0 3 0 186391635 736964608 146157 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0

################
# More data... #
################

[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3393.77 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 702800 0 0 0 339310 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=44076 CPUtime=3329.52 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 616428 0 0 0 332902 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=885108 CPUtime=0.02 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 498 0 0 0 0 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3393.77 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3462.3 s]
/proc/loadavg: 4.10 4.11 4.09 7/266 1002634
/proc/meminfo: memFree=122576844/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3453.59 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703210 0 0 0 345292 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=44076 CPUtime=3389.34 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 616831 0 0 0 338884 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=44076 CPUtime=0.02 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 505 0 0 0 0 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3453.59 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3522.3 s]
/proc/loadavg: 4.08 4.10 4.09 7/266 1002644
/proc/meminfo: memFree=122576532/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3513.41 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703441 0 0 0 351274 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=44076 CPUtime=3449.16 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617054 0 0 0 344866 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=885108 CPUtime=0.02 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 513 0 0 0 0 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3513.41 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3582.3 s]
/proc/loadavg: 4.19 4.13 4.10 7/262 1002654
/proc/meminfo: memFree=122576260/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3573.22 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703670 0 0 0 357255 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=11588 CPUtime=3508.97 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617274 0 0 0 350847 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=885108 CPUtime=0.02 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 522 0 0 0 0 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3573.22 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3600.28 s]
# the end of solver process 1000794 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3590.48 s, system=0.687138 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.19 4.13 4.10 6/262 1002656
/proc/meminfo: memFree=122576148/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3574.92 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703670 0 0 0 357425 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=4300551089738474 CPUtime=3510.67 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617274 0 0 0 351017 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=-9187040390457425350 CPUtime=0.02 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 522 0 0 0 0 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3574.92 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3590.4 s]
/proc/loadavg: 4.17 4.13 4.10 5/262 1002656
/proc/meminfo: memFree=122576196/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3581.3 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703671 0 0 0 358063 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=885108 CPUtime=3517.05 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617275 0 0 0 351655 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=885108 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 522 0 0 0 1 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3581.3 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3596.8 s]
/proc/loadavg: 4.16 4.12 4.10 6/262 1002657
/proc/meminfo: memFree=122576152/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3587.68 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703870 0 0 0 358701 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=885108 CPUtime=3523.43 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617473 0 0 0 352293 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=-7952647673509797760 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 523 0 0 0 1 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3587.68 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3598.4 s]
/proc/loadavg: 4.15 4.12 4.09 6/262 1002657
/proc/meminfo: memFree=122576168/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3589.27 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703870 0 0 0 358860 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=12508 CPUtime=3525.02 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617473 0 0 0 352452 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=12508 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 523 0 0 0 1 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3589.27 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3599.2 s]
/proc/loadavg: 4.15 4.12 4.09 7/262 1002657
/proc/meminfo: memFree=122576176/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3590.07 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 703870 0 0 0 358940 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=-6881359242293251692 CPUtime=3525.82 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617473 0 0 0 352532 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=-9187040390457425350 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 523 0 0 0 1 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3590.07 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3600 s]*
/proc/loadavg: 4.15 4.12 4.09 5/262 1002657
/proc/meminfo: memFree=122576144/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=983772 memory=885108 CPUtime=3590.87 cores=4,6
/proc/1000794/stat : 1000794 (fscip) S 1000782 1000794 1000725 0 -1 1077936128 704383 0 0 0 359020 67 0 0 20 0 3 0 186385190 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 245943 221277 3262 3032 0 230622 0
[pid=1000794/tid=1000819] ppid=1000782 vsize=983772 memory=-6881359242293251692 CPUtime=3526.62 cores=4,6
/proc/1000794/task/1000819/stat : 1000819 (fscip) R 1000782 1000794 1000725 0 -1 4194368 617986 0 0 0 352612 50 0 0 20 0 3 0 186391624 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=983772 memory=-9187040390457425350 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 523 0 0 0 1 2 0 0 20 0 3 0 186391635 1007382528 221277 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3590.87 s
Current children cumulated vsize: 983772 KiB
Current children cumulated memory: 885108 KiB

[startup+3600.2 s]
/proc/loadavg: 4.15 4.12 4.09 5/262 1002657
/proc/meminfo: memFree=122576144/131524600 swapFree=131071996/131071996
[pid=1000794] ppid=1000782 vsize=909524 memory=811200 CPUtime=3591.07 cores=4,6
/proc/1000794/stat : 1000794 (fscip) R 1000782 1000794 1000725 0 -1 4194304 708288 0 0 0 359040 67 0 0 20 0 2 0 186385190 931352576 202800 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
/proc/1000794/statm: 227381 202800 3310 3032 0 212060 0
[pid=1000794/tid=1000820] ppid=1000782 vsize=909524 memory=100 CPUtime=0.03 cores=4,6
/proc/1000794/task/1000820/stat : 1000820 (fscip) S 1000782 1000794 1000725 0 -1 1077936192 523 0 0 0 1 2 0 0 20 0 2 0 186391635 931352576 202800 134679101440 4194304 16613245 140725396793520 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 51453952 140725396800531 140725396800647 140725396800647 140725396807664 0
Current children cumulated CPU time: 3591.07 s
Current children cumulated vsize: 909524 KiB
Current children cumulated memory: 811200 KiB

Child status: 0

Real time (s): 3600.28
CPU time (s): 3591.16
CPU user time (s): 3590.48
CPU system time (s): 0.687138
CPU usage (%): 99.7467
Max. virtual memory (cumulated for all children) (KiB): 983772
Max. memory (cumulated for all children) (KiB): 885108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3590.48
system time used= 0.687138
maximum resident set size= 885108
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 711120
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3560
involuntary context switches= 1472


# summary of solver processes directly reported to runsolver:
#   pid: 1000794
#   total CPU time (s): 3591.16
#   total CPU user time (s): 3590.48
#   total CPU system time (s): 0.687138

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.9683 second user time and 20.5851 second system time

The end

Launcher Data 

Begin job on nodeC029 at 2024-07-19 00:36:31
IDJOB=4446770
IDBENCH=158306
IDSOLVER=3064
FILE ID=nodeC029/4446770-1721342178
RUNJOBID= nodeC029-1721342191-1000736
SLURM_JOB_ID= 7542739
Free space on /tmp= 890064 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K193.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446770-1721342178/watcher-4446770-1721342178 -o /tmp/evaluation-result-4446770-1721342178/solver-4446770-1721342178 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721342191-1000736 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446770-1721342178.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= a57909b893e448cbfc1c45d11e8afcf3
RANDOM SEED=500959017

nodeC029.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3660.725
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3602.525
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3760.688
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3702.596
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3793.244
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3660.737
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3607.729
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3845.257
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125718412 kB
MemAvailable:   129684160 kB
Buffers:          494476 kB
Cached:          4262564 kB
SwapCached:            0 kB
Active:           954476 kB
Inactive:        4138464 kB
Active(anon):       1360 kB
Inactive(anon):   372256 kB
Active(file):     953116 kB
Inactive(file):  3766208 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:            117728 kB
Writeback:             0 kB
AnonPages:        335984 kB
Mapped:           105960 kB
Shmem:             37720 kB
KReclaimable:     172140 kB
Slab:             293440 kB
SReclaimable:     172140 kB
SUnreclaim:       121300 kB
KernelStack:        3728 kB
PageTables:         9508 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:     678668 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            68576 kB
HardwareCorrupted:     0 kB
AnonHugePages:    219136 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      281300 kB
DirectMap2M:    36192256 kB
DirectMap1G:    99614720 kB

Free space on /tmp at the end= 889952 MiB
End job on nodeC029 at 2024-07-19 01:36:31