Trace number 4464492

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3589.42 3599.68

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K179.opb
MD5SUM84aa92d361920570c4f42a7fa8308fed
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark73.5881
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21301
Total number of constraints21661
Number of constraints which are clauses21482
Number of constraints which are cardinality constraints (but not clauses)179
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint179
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 180
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.13	c Default LC presolving (default).
0.09/0.13	c ** Before presolving: virtualMemUsedAtLc = 123397645, getVmSize() = 106037248, SCIPgetMemUsed() = 76006862, SCIPgetMemTotal() = 82001118, SCIPgetMemExternEstim() = 41396527
0.09/0.13	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
63.81/64.05	c ** Estimated virtualMemUsedAtSolver = 261855688, getVmSize() = 384606208, SCIPgetMemUsed() = 266800638, SCIPgetMemTotal() = 351387006, SCIPgetMemExternEstim() = 41396527
63.81/64.05	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
63.81/64.05	c Original Problem   :
63.81/64.05	c   Problem name     : instance-4464492-1722385791
63.81/64.05	c   Variables        : 21301 (21301 binary, 0 integer, 0 implicit integer, 0 continuous)
63.81/64.05	c   Constraints      : 21661
63.81/64.05	c   Objective sense  : minimize
63.81/64.05	c Presolved Problem  :
63.81/64.05	c   Variables        : 19742 (19742 binary, 0 integer, 0 implicit integer, 0 continuous)
63.81/64.05	c   Constraints      : 20032
63.81/64.05	c Constraints        : Number
63.81/64.05	c   knapsack         : 1 
63.81/64.05	c   setppc           : 2434 
63.81/64.05	c   orbitope         : 1 
63.81/64.05	c   logicor          : 17596 
63.81/64.05	c ** Instance transfer method used: 0
63.91/64.10	c ** ParaScipInstance copy increased the number of variables. **
63.91/64.16	c LC is working with racing ramp-up and with rebuilding tree after racing.
63.91/64.16	c                                Nodes    Active                                            
63.91/64.16	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1665.58/1671.21	c      1671              2           1         1                -           0.0000          -
1693.11/1698.86	c      1699              5           4         1                -           0.0000          -
1722.14/1727.93	c      1728              7           6         1                -           0.0000          -
1753.66/1759.59	c      1760              8           7         1                -           0.0000          -
1767.32/1773.21	c      1773              9           8         1                -           0.0000          -
1789.16/1795.15	c      1795             10           9         1                -           0.0000          -
1796.94/1802.94	c      1803             11          10         1                -           0.0000          -
1805.51/1811.52	c      1812             13          10         1                -           0.0000          -
1826.37/1832.48	c      1832             14          11         1                -           0.0000          -
1834.35/1840.42	c      1840             15          12         1                -           0.0000          -
2217.68/2224.79	c      2225             17          12         1                -           0.0000          -
2336.39/2343.78	c      2344             18          13         1                -           0.0000          -
2377.69/2385.12	c      2385             19          14         1                -           0.0000          -
2408.21/2415.78	c      2416             22          13         1                -           0.0000          -
2645.90/2654.05	c      2654             23          14         1                -           0.0000          -
2657.27/2665.41	c      2665             24          15         1                -           0.0000          -
2887.41/2896.11	c      2896             25          16         1                -           0.0000          -
2915.74/2924.59	c      2925             26          17         1                -           0.0000          -
3589.13/3599.49	c      3599             26          17         0                -           0.0000          -
3589.33/3599.60	c SCIP Status        : c solving was interrupted [hard time limit reached]
3589.33/3599.60	c Total Time         : 3599.6000
3589.33/3599.60	c   solving          : 3599.6000
3589.33/3599.60	c   presolving       : 63.9236 (included in solving)
3589.33/3599.60	c B&B Tree           :
3589.33/3599.60	c   nodes (total)    : 1
3589.33/3599.60	c Solution           :
3589.33/3599.60	c   Solutions found  : 0
3589.33/3599.60	c   Primal Bound     :          -
3589.33/3599.60	c   Dual Bound       : +0.00000000000000e+00
3589.33/3599.60	c Gap                :          -
3589.33/3599.68	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (51649 MiB free)
  memory of node 1: 64510 MiB (61526 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464492-1722385791/watcher-4464492-1722385791 -o /tmp/evaluation-result-4464492-1722385791/solver-4464492-1722385791 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27905 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464492-1722385791.opb -qsol -t 3600 -sth 1 

running on 2 cores: 1,3

CPU governors:
  performance: 1 3

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=32311, runsolver pid=32306

[startup+0.101017 s]*
/proc/loadavg: 4.00 4.08 4.11 4/254 32328
/proc/meminfo: memFree=115856288/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=86168 memory=75964 CPUtime=0.09 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 16761 0 0 0 7 2 0 0 20 0 1 0 5177045 88236032 18991 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 21542 18991 2539 3035 0 17938 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 86168 KiB
Current children cumulated memory: 75964 KiB

[startup+0.205293 s]*
/proc/loadavg: 4.00 4.08 4.11 5/254 32331
/proc/meminfo: memFree=115804480/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=116692 memory=98224 CPUtime=0.2 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 22293 0 0 0 17 3 0 0 20 0 1 0 5177045 119492608 24556 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 29173 24556 2598 3035 0 25569 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 116692 KiB
Current children cumulated memory: 98224 KiB

[startup+0.305455 s]*
/proc/loadavg: 4.00 4.08 4.11 5/260 32341
/proc/meminfo: memFree=115737868/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=139868 memory=126036 CPUtime=0.29 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 30808 0 0 0 25 4 0 0 20 0 1 0 5177045 143224832 31509 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 34967 31509 2662 3035 0 31363 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 139868 KiB
Current children cumulated memory: 126036 KiB

[startup+0.700243 s]
/proc/loadavg: 4.00 4.08 4.11 5/260 32341
/proc/meminfo: memFree=115667048/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=130308 memory=117072 CPUtime=0.68 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 30917 0 0 0 64 4 0 0 20 0 1 0 5177045 133435392 29268 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 32577 29268 2710 3035 0 28973 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 130308 KiB
Current children cumulated memory: 117072 KiB

[startup+1.50024 s]
/proc/loadavg: 4.00 4.08 4.11 5/260 32341
/proc/meminfo: memFree=115643960/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=191112 memory=172240 CPUtime=1.48 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 44270 0 0 0 141 7 0 0 20 0 1 0 5177045 195698688 43060 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 47778 43060 2774 3035 0 44174 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 191112 KiB
Current children cumulated memory: 172240 KiB

[startup+3.10545 s]
/proc/loadavg: 4.00 4.08 4.11 5/260 32341
/proc/meminfo: memFree=115534996/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=200460 memory=181468 CPUtime=3.08 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 46604 0 0 0 301 7 0 0 20 0 1 0 5177045 205271040 45367 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 50115 45367 2774 3035 0 46511 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 200460 KiB
Current children cumulated memory: 181468 KiB

[startup+6.30023 s]
/proc/loadavg: 4.00 4.08 4.10 5/260 32341
/proc/meminfo: memFree=115534236/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=200620 memory=181728 CPUtime=6.27 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 46649 0 0 0 619 8 0 0 20 0 1 0 5177045 205434880 45432 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 50155 45432 2774 3035 0 46551 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 200620 KiB
Current children cumulated memory: 181728 KiB

[startup+12.7002 s]
/proc/loadavg: 4.00 4.07 4.10 5/260 32343
/proc/meminfo: memFree=115515888/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=209812 memory=190944 CPUtime=12.65 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 49010 0 0 0 1257 8 0 0 20 0 1 0 5177045 214847488 47736 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 52453 47736 2774 3035 0 48849 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 209812 KiB
Current children cumulated memory: 190944 KiB

[startup+25.5002 s]
/proc/loadavg: 4.08 4.09 4.11 5/260 32344
/proc/meminfo: memFree=115513108/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=210524 memory=191440 CPUtime=25.41 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 49167 0 0 0 2533 8 0 0 20 0 1 0 5177045 215576576 47860 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 52631 47860 2774 3035 0 49027 0
Current children cumulated CPU time: 25.41 s
Current children cumulated vsize: 210524 KiB
Current children cumulated memory: 191440 KiB

[startup+51.1055 s]
/proc/loadavg: 4.05 4.08 4.10 5/262 32408
/proc/meminfo: memFree=115508712/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=212492 memory=193536 CPUtime=50.95 cores=1,3
/proc/32311/stat : 32311 (fscip) R 32306 32311 27893 0 -1 4194304 49663 0 0 0 5086 9 0 0 20 0 1 0 5177045 217591808 48384 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 53123 48384 2774 3035 0 49519 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 212492 KiB
Current children cumulated memory: 193536 KiB

[startup+102.3 s]
/proc/loadavg: 4.07 4.08 4.10 5/266 32422
/proc/meminfo: memFree=114798868/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=687356 memory=533596 CPUtime=101.98 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 209819 0 0 0 10174 24 0 0 20 0 3 0 5177045 703852544 133399 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 171839 133399 2966 3035 0 156438 0
[pid=32311/tid=32414] ppid=32306 vsize=687356 memory=532860 CPUtime=38.07 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 126775 0 0 0 3796 11 0 0 20 0 3 0 5183451 703852544 133399 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=687356 memory=531100 CPUtime=0 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 41 0 0 0 0 0 0 0 20 0 3 0 5183461 703852544 133399 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 687356 KiB
Current children cumulated memory: 533596 KiB

[startup+162.3 s]
/proc/loadavg: 4.11 4.09 4.10 5/266 32432
/proc/meminfo: memFree=114794084/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=687356 memory=534904 CPUtime=161.82 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 228395 0 0 0 16156 26 0 0 20 0 3 0 5177045 703852544 133726 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 171839 133726 2966 3035 0 156899 0
[pid=32311/tid=32414] ppid=32306 vsize=687356 memory=534848 CPUtime=97.89 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 145330 0 0 0 9777 12 0 0 20 0 3 0 5183451 703852544 133726 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=687356 memory=534848 CPUtime=0 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 62 0 0 0 0 0 0 0 20 0 3 0 5183461 703852544 133726 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 161.82 s
Current children cumulated vsize: 687356 KiB
Current children cumulated memory: 534904 KiB

[startup+222.3 s]
/proc/loadavg: 4.09 4.09 4.09 5/266 32442
/proc/meminfo: memFree=114768484/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=687356 memory=535268 CPUtime=221.62 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 241177 0 0 0 22135 27 0 0 20 0 3 0 5177045 703852544 133817 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 171839 133817 2966 3035 0 157055 0
[pid=32311/tid=32414] ppid=32306 vsize=687356 memory=535264 CPUtime=157.69 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 158098 0 0 0 15756 13 0 0 20 0 3 0 5183451 703852544 133817 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=687356 memory=11712 CPUtime=0 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 76 0 0 0 0 0 0 0 20 0 3 0 5183461 703852544 133817 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 221.62 s
Current children cumulated vsize: 687356 KiB
Current children cumulated memory: 535268 KiB

[startup+282.3 s]
/proc/loadavg: 4.07 4.08 4.09 5/266 32454
/proc/meminfo: memFree=114659176/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=687356 memory=537088 CPUtime=281.4 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 248907 0 0 0 28112 28 0 0 20 0 3 0 5177045 703852544 134272 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 171839 134272 2966 3035 0 157372 0
[pid=32311/tid=32414] ppid=32306 vsize=687356 memory=535420 CPUtime=217.47 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 165821 0 0 0 21733 14 0 0 20 0 3 0 5183451 703852544 134272 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=687356 memory=537088 CPUtime=0 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 83 0 0 0 0 0 0 0 20 0 3 0 5183461 703852544 134272 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 281.4 s
Current children cumulated vsize: 687356 KiB
Current children cumulated memory: 537088 KiB

[startup+342.3 s]
/proc/loadavg: 4.12 4.10 4.09 5/266 32465
/proc/meminfo: memFree=114565464/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=744628 memory=616596 CPUtime=341.19 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 277263 0 0 0 34087 32 0 0 20 0 3 0 5177045 762499072 154149 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 186157 154149 2982 3035 0 177342 0
[pid=32311/tid=32414] ppid=32306 vsize=744628 memory=535420 CPUtime=277.27 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 194170 0 0 0 27709 18 0 0 20 0 3 0 5183451 762499072 154149 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=744628 memory=538180 CPUtime=0 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 90 0 0 0 0 0 0 0 20 0 3 0 5183461 762499072 154149 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0

################
# More data... #
################

/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=830356 CPUtime=3328.51 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 808106 0 0 0 332793 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=11712 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 508 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3392.46 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3462.3 s]
/proc/loadavg: 4.05 4.11 4.14 6/263 34399
/proc/meminfo: memFree=119638760/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3452.33 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 892311 0 0 0 345160 73 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=13204 CPUtime=3388.37 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 808562 0 0 0 338779 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=7686721470264483783 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 516 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3452.33 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3522.3 s]
/proc/loadavg: 3.97 4.10 4.14 5/254 34442
/proc/meminfo: memFree=120283924/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3512.2 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893036 0 0 0 351146 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=830356 CPUtime=3448.24 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809278 0 0 0 344766 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=11712 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 525 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3512.2 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3582.3 s]
/proc/loadavg: 3.41 3.91 4.07 5/256 34622
/proc/meminfo: memFree=120283192/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3572.07 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893443 0 0 0 357133 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=13204 CPUtime=3508.1 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809675 0 0 0 350752 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=830356 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 535 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3572.07 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3599.68 s]
# the end of solver process 32311 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3588.67 s, system=0.747634 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 3.41 3.91 4.07 5/256 34622
/proc/meminfo: memFree=120283200/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3573.77 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893447 0 0 0 357303 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=-7235432492932619644 CPUtime=3509.8 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809679 0 0 0 350922 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=4211033448875978395 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 535 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3573.77 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3590.4 s]
/proc/loadavg: 3.38 3.89 4.06 5/256 34624
/proc/meminfo: memFree=120283172/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3580.15 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893447 0 0 0 357941 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=830356 CPUtime=3516.19 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809679 0 0 0 351561 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=16920 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 535 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3580.15 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3593.6 s]
/proc/loadavg: 3.35 3.88 4.06 5/256 34624
/proc/meminfo: memFree=120282744/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3583.34 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893447 0 0 0 358260 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=830356 CPUtime=3519.38 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809679 0 0 0 351880 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=1932 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 535 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3583.34 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3596.8 s]
/proc/loadavg: 3.32 3.86 4.05 5/256 34624
/proc/meminfo: memFree=120282744/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3586.54 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893520 0 0 0 358580 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=280322315328560 CPUtime=3522.57 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809751 0 0 0 352199 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=830356 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 536 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3586.54 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3598.4 s]
/proc/loadavg: 3.32 3.86 4.05 5/256 34624
/proc/meminfo: memFree=120282744/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3588.13 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893520 0 0 0 358739 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=830356 CPUtime=3524.17 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809751 0 0 0 352359 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=830356 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 536 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3588.13 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3599.2 s]
/proc/loadavg: 3.32 3.86 4.05 4/247 34655
/proc/meminfo: memFree=121211716/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=947912 memory=830356 CPUtime=3588.93 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 893520 0 0 0 358819 74 0 0 20 0 3 0 5177045 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 236978 207589 3030 3035 0 218191 0
[pid=32311/tid=32414] ppid=32306 vsize=947912 memory=-4050210904893801872 CPUtime=3524.97 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 809751 0 0 0 352439 58 0 0 20 0 3 0 5183451 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=947912 memory=12772 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 536 0 0 0 1 2 0 0 20 0 3 0 5183461 970661888 207589 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3588.93 s
Current children cumulated vsize: 947912 KiB
Current children cumulated memory: 830356 KiB

[startup+3599.6 s]
/proc/loadavg: 3.32 3.86 4.05 4/247 34655
/proc/meminfo: memFree=121211716/131524600 swapFree=131071996/131071996
[pid=32311] ppid=32306 vsize=885664 memory=769068 CPUtime=3589.33 cores=1,3
/proc/32311/stat : 32311 (fscip) S 32306 32311 27893 0 -1 1077936128 894319 0 0 0 358859 74 0 0 20 0 3 0 5177045 906919936 192267 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
/proc/32311/statm: 221416 192267 3030 3035 0 202629 0
[pid=32311/tid=32414] ppid=32306 vsize=885664 memory=1984 CPUtime=3525.36 cores=1,3
/proc/32311/task/32414/stat : 32414 (fscip) R 32306 32311 27893 0 -1 4194368 810536 0 0 0 352478 58 0 0 20 0 3 0 5183451 906919936 192267 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
[pid=32311/tid=32415] ppid=32306 vsize=885664 memory=-7451886750023114880 CPUtime=0.03 cores=1,3
/proc/32311/task/32415/stat : 32415 (fscip) S 32306 32311 27893 0 -1 1077936192 536 0 0 0 1 2 0 0 20 0 3 0 5183461 906919936 192267 134679101440 4194304 16623229 140720440214160 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 56107008 140720440218646 140720440218762 140720440218762 140720440225776 0
Current children cumulated CPU time: 3589.33 s
Current children cumulated vsize: 885664 KiB
Current children cumulated memory: 769068 KiB

Child status: 0

Real time (s): 3599.68
CPU time (s): 3589.42
CPU user time (s): 3588.67
CPU system time (s): 0.747634
CPU usage (%): 99.7148
Max. virtual memory (cumulated for all children) (KiB): 947912
Max. memory (cumulated for all children) (KiB): 830356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3588.67
system time used= 0.747634
maximum resident set size= 830356
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 898089
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3607
involuntary context switches= 3125


# summary of solver processes directly reported to runsolver:
#   pid: 32311
#   total CPU time (s): 3589.42
#   total CPU user time (s): 3588.67
#   total CPU system time (s): 0.747634

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.78521 second user time and 15.9002 second system time

The end

Launcher Data 

Begin job on nodeC020 at 2024-07-31 02:29:51
IDJOB=4464492
IDBENCH=158301
IDSOLVER=3092
FILE ID=nodeC020/4464492-1722385791
RUNJOBID= nodeC020-1722378594-27905
SLURM_JOB_ID= 8249843
Free space on /tmp= 889920 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K179.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464492-1722385791/watcher-4464492-1722385791 -o /tmp/evaluation-result-4464492-1722385791/solver-4464492-1722385791 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27905 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464492-1722385791.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 84aa92d361920570c4f42a7fa8308fed
RANDOM SEED=1367756045

nodeC020.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.619
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3674.774
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3669.879
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3629.639
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3669.838
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.222
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.486
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3635.245
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        115891696 kB
MemAvailable:   123699356 kB
Buffers:          105172 kB
Cached:          8516064 kB
SwapCached:            0 kB
Active:           360832 kB
Inactive:       14741968 kB
Active(anon):       1592 kB
Inactive(anon):  6501304 kB
Active(file):     359240 kB
Inactive(file):  8240664 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29972 kB
Writeback:            12 kB
AnonPages:       6478196 kB
Mapped:           112848 kB
Shmem:             21336 kB
KReclaimable:      94804 kB
Slab:             177168 kB
SReclaimable:      94804 kB
SUnreclaim:        82364 kB
KernelStack:        4104 kB
PageTables:        21728 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    5116276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9888 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2879488 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      193236 kB
DirectMap2M:    10065920 kB
DirectMap1G:    125829120 kB

Free space on /tmp at the end= 890028 MiB
End job on nodeC020 at 2024-07-31 03:29:51