Trace number 4464482

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3578.08 3598.15

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K134.opb
MD5SUM963edb3c79c326322e0bda3e585d3232
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables15946
Total number of constraints16216
Number of constraints which are clauses16082
Number of constraints which are cardinality constraints (but not clauses)134
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint134
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 135
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.11	c Default LC presolving (default).
0.09/0.11	c ** Before presolving: virtualMemUsedAtLc = 95806094, getVmSize() = 88567808, SCIPgetMemUsed() = 57549961, SCIPgetMemTotal() = 64819961, SCIPgetMemExternEstim() = 30986133
0.09/0.11	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
36.16/36.37	c ** Estimated virtualMemUsedAtSolver = 194979475, getVmSize() = 293183488, SCIPgetMemUsed() = 195209736, SCIPgetMemTotal() = 261483080, SCIPgetMemExternEstim() = 30986133
36.16/36.37	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
36.16/36.37	c Original Problem   :
36.16/36.37	c   Problem name     : instance-4464482-1722384604
36.16/36.37	c   Variables        : 15946 (15946 binary, 0 integer, 0 implicit integer, 0 continuous)
36.16/36.37	c   Constraints      : 16216
36.16/36.37	c   Objective sense  : minimize
36.16/36.37	c Presolved Problem  :
36.16/36.37	c   Variables        : 14439 (14439 binary, 0 integer, 0 implicit integer, 0 continuous)
36.16/36.37	c   Constraints      : 14687
36.16/36.37	c Constraints        : Number
36.16/36.37	c   knapsack         : 1 
36.16/36.37	c   setppc           : 1806 
36.16/36.37	c   orbitope         : 1 
36.16/36.37	c   logicor          : 12879 
36.16/36.37	c ** Instance transfer method used: 0
36.25/36.41	c ** ParaScipInstance copy increased the number of variables. **
36.25/36.45	c LC is working with racing ramp-up and with rebuilding tree after racing.
36.25/36.45	c                                Nodes    Active                                            
36.25/36.45	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
686.74/693.30	c       693              2           1         1                -           0.0000          -
707.04/713.88	c       714              5           4         1                -           0.0000          -
712.59/719.44	c       719              6           5         1                -           0.0000          -
731.69/738.78	c       739              7           6         1                -           0.0000          -
962.55/971.88	c       972              8           7         1                -           0.0000          -
1043.92/1053.93	c      1054              9           8         1                -           0.0000          -
1203.91/1215.52	c      1216             10           9         1                -           0.0000          -
1229.52/1241.42	c      1241             11          10         1                -           0.0000          -
1377.54/1390.71	c      1391             12          11         1                -           0.0000          -
1572.47/1586.30	c      1586             13          12         1                -           0.0000          -
2735.32/2752.79	c      2753             14          13         1                -           0.0000          -
2791.74/2809.32	c      2809             15          14         1                -           0.0000          -
2810.49/2828.16	c      2828             16          15         1                -           0.0000          -
2818.96/2836.64	c      2837             17          16         1                -           0.0000          -
2859.73/2877.54	c      2878             21          20         1                -           0.0000          -
2881.86/2899.71	c      2900             22          21         1                -           0.0000          -
2901.00/2918.97	c      2919             24          23         1                -           0.0000          -
2915.75/2933.77	c      2934             25          24         1                -           0.0000          -
2933.00/2951.03	c      2951             26          25         1                -           0.0000          -
2947.55/2965.67	c      2966             27          26         1                -           0.0000          -
2963.30/2981.46	c      2981             28          27         1                -           0.0000          -
3238.64/3257.65	c      3258             31          26         1                -           0.0000          -
3265.27/3284.36	c      3284             32          29         1                -           0.0000          -
3382.42/3401.85	c      3402             33          28         1                -           0.0000          -
3394.68/3414.11	c      3414             34          29         1                -           0.0000          -
3401.05/3420.51	c      3421             35          30         1                -           0.0000          -
3422.17/3441.73	c      3442             38          31         1                -           0.0000          -
3430.14/3449.71	c      3450             39          30         1                -           0.0000          -
3539.56/3559.58	c      3560             42          29         1                -           0.0000          -
3555.90/3575.93	c      3576             45          32         1                -           0.0000          -
3564.47/3584.54	c      3585             46          31         1                -           0.0000          -
3573.43/3593.52	c      3594             48          31         1                -           0.0000          -
3577.92/3598.08	c SCIP Status        : c solving was interrupted [hard time limit reached]
3577.92/3598.08	c Total Time         : 3598.0800
3577.92/3598.08	c   solving          : 3598.0800
3577.92/3598.08	c   presolving       : 36.2589 (included in solving)
3577.92/3598.08	c B&B Tree           :
3577.92/3598.08	c   nodes (total)    : 1
3577.92/3598.08	c Solution           :
3577.92/3598.08	c   Solutions found  : 0
3577.92/3598.08	c   Primal Bound     :          -
3577.92/3598.08	c   Dual Bound       : +0.00000000000000e+00
3577.92/3598.08	c Gap                :          -
3578.02/3598.15	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (52160 MiB free)
  memory of node 1: 64510 MiB (60610 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464482-1722384604/watcher-4464482-1722384604 -o /tmp/evaluation-result-4464482-1722384604/solver-4464482-1722384604 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27903 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464482-1722384604.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=31466, runsolver pid=31463

[startup+0.100904 s]*
/proc/loadavg: 4.11 4.17 4.17 6/261 31467
/proc/meminfo: memFree=115416292/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=82096 memory=71344 CPUtime=0.09 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 15599 0 0 0 7 2 0 0 20 0 1 0 5058267 84066304 17836 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 20524 17836 2539 3035 0 16920 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 82096 KiB
Current children cumulated memory: 71344 KiB

[startup+0.205902 s]*
/proc/loadavg: 4.11 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115396048/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=109372 memory=95824 CPUtime=0.2 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 21155 0 0 0 17 3 0 0 20 0 1 0 5058267 111996928 23956 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 27343 23956 2646 3035 0 23739 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 109372 KiB
Current children cumulated memory: 95824 KiB

[startup+0.305762 s]*
/proc/loadavg: 4.11 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115386440/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=113424 memory=100344 CPUtime=0.29 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 24065 0 0 0 26 3 0 0 20 0 1 0 5058267 116146176 25086 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 28356 25086 2662 3035 0 24752 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 113424 KiB
Current children cumulated memory: 100344 KiB

[startup+0.700227 s]
/proc/loadavg: 4.11 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115392220/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=122480 memory=108872 CPUtime=0.69 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 28432 0 0 0 65 4 0 0 20 0 1 0 5058267 125419520 27218 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 30620 27218 2758 3035 0 27016 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 122480 KiB
Current children cumulated memory: 108872 KiB

[startup+1.50022 s]
/proc/loadavg: 4.11 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115356048/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=158160 memory=141732 CPUtime=1.48 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 34790 0 0 0 143 5 0 0 20 0 1 0 5058267 161955840 35433 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 39540 35433 2774 3035 0 35936 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 158160 KiB
Current children cumulated memory: 141732 KiB

[startup+3.10579 s]
/proc/loadavg: 4.10 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115344368/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=159040 memory=142524 CPUtime=3.08 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 34989 0 0 0 303 5 0 0 20 0 1 0 5058267 162856960 35631 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 39760 35631 2774 3035 0 36156 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 159040 KiB
Current children cumulated memory: 142524 KiB

[startup+6.30022 s]
/proc/loadavg: 4.10 4.17 4.17 5/261 31467
/proc/meminfo: memFree=115343248/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=160120 memory=143832 CPUtime=6.26 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 35290 0 0 0 621 5 0 0 20 0 1 0 5058267 163962880 35958 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 40030 35958 2774 3035 0 36426 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 160120 KiB
Current children cumulated memory: 143832 KiB

[startup+12.7002 s]
/proc/loadavg: 4.09 4.17 4.17 5/261 31469
/proc/meminfo: memFree=115337396/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=165744 memory=148932 CPUtime=12.64 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 36644 0 0 0 1258 6 0 0 20 0 1 0 5058267 169721856 37233 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 41436 37233 2774 3035 0 37832 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 165744 KiB
Current children cumulated memory: 148932 KiB

[startup+25.5002 s]
/proc/loadavg: 4.14 4.18 4.17 5/261 31470
/proc/meminfo: memFree=115336416/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=165744 memory=149192 CPUtime=25.39 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 36678 0 0 0 2533 6 0 0 20 0 1 0 5058267 169721856 37298 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 41436 37298 2774 3035 0 37832 0
Current children cumulated CPU time: 25.39 s
Current children cumulated vsize: 165744 KiB
Current children cumulated memory: 149192 KiB

[startup+51.1059 s]
/proc/loadavg: 4.17 4.18 4.18 5/265 31484
/proc/meminfo: memFree=115085456/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=522160 memory=399352 CPUtime=50.82 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 138881 0 0 0 5065 17 0 0 20 0 3 0 5058267 534691840 99838 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 130540 99838 2950 3035 0 117058 0
[pid=31466/tid=31473] ppid=31463 vsize=522160 memory=397260 CPUtime=14.54 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 77762 0 0 0 1447 7 0 0 20 0 3 0 5061904 534691840 99838 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=522160 memory=0 CPUtime=0 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 31 0 0 0 0 0 0 0 20 0 3 0 5061913 534691840 99838 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 50.82 s
Current children cumulated vsize: 522160 KiB
Current children cumulated memory: 399352 KiB

[startup+102.301 s]
/proc/loadavg: 4.15 4.17 4.17 5/265 31493
/proc/meminfo: memFree=115075204/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=522160 memory=405304 CPUtime=101.51 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 176185 0 0 0 10131 20 0 0 20 0 3 0 5058267 534691840 101326 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 130540 101326 2966 3035 0 118417 0
[pid=31466/tid=31473] ppid=31463 vsize=522160 memory=404392 CPUtime=65.23 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 115031 0 0 0 6513 10 0 0 20 0 3 0 5061904 534691840 101326 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=522160 memory=11712 CPUtime=0 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 66 0 0 0 0 0 0 0 20 0 3 0 5061913 534691840 101326 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 101.51 s
Current children cumulated vsize: 522160 KiB
Current children cumulated memory: 405304 KiB

[startup+162.301 s]
/proc/loadavg: 4.15 4.16 4.17 5/264 31503
/proc/meminfo: memFree=115037652/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=522160 memory=407028 CPUtime=160.92 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 190188 0 0 0 16071 21 0 0 20 0 3 0 5058267 534691840 101757 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 130540 101757 2966 3035 0 118946 0
[pid=31466/tid=31473] ppid=31463 vsize=522160 memory=406228 CPUtime=124.64 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 129016 0 0 0 12453 11 0 0 20 0 3 0 5061904 534691840 101757 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=522160 memory=406736 CPUtime=0 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 84 0 0 0 0 0 0 0 20 0 3 0 5061913 534691840 101757 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 160.92 s
Current children cumulated vsize: 522160 KiB
Current children cumulated memory: 407028 KiB

[startup+222.301 s]
/proc/loadavg: 4.10 4.15 4.17 5/264 31514
/proc/meminfo: memFree=114987228/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=552944 memory=457212 CPUtime=220.33 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 232558 0 0 0 22009 24 0 0 20 0 3 0 5058267 566214656 114303 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 138236 114303 2982 3035 0 131932 0
[pid=31466/tid=31473] ppid=31463 vsize=552944 memory=407472 CPUtime=184.05 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 171377 0 0 0 18391 14 0 0 20 0 3 0 5061904 566214656 114303 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=552944 memory=407472 CPUtime=0 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 93 0 0 0 0 0 0 0 20 0 3 0 5061913 566214656 114303 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 220.33 s
Current children cumulated vsize: 552944 KiB
Current children cumulated memory: 457212 KiB

[startup+282.301 s]
/proc/loadavg: 4.13 4.15 4.17 5/264 31525
/proc/meminfo: memFree=114961588/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=623256 memory=473684 CPUtime=279.73 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 247084 0 0 0 27948 25 0 0 20 0 3 0 5058267 638214144 118421 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 155814 118421 2982 3035 0 137188 0
[pid=31466/tid=31473] ppid=31463 vsize=623256 memory=461372 CPUtime=243.45 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 185896 0 0 0 24330 15 0 0 20 0 3 0 5061904 638214144 118421 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=623256 memory=473684 CPUtime=0 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 100 0 0 0 0 0 0 0 20 0 3 0 5061913 638214144 118421 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 279.73 s
Current children cumulated vsize: 623256 KiB
Current children cumulated memory: 473684 KiB

[startup+342.301 s]
/proc/loadavg: 4.19 4.16 4.17 5/264 31536
/proc/meminfo: memFree=114952344/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=628148 memory=481508 CPUtime=339.15 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 292864 0 0 0 33886 29 0 0 20 0 3 0 5058267 643223552 120377 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 157037 120377 2982 3035 0 139476 0

################
# More data... #
################

[pid=31466] ppid=31463 vsize=761288 memory=652872 CPUtime=3442.7 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 902982 0 0 0 344189 81 0 0 20 0 3 0 5058267 779558912 163218 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163218 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652872 CPUtime=3406.38 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 841128 0 0 0 340569 69 0 0 20 0 3 0 5061904 779558912 163218 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=652872 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 450 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163218 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3442.7 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652872 KiB

[startup+3522.3 s]
/proc/loadavg: 4.15 4.20 4.18 5/265 33762
/proc/meminfo: memFree=119659956/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3502.48 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 905437 0 0 0 350167 81 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652884 CPUtime=3466.17 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 843577 0 0 0 346548 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=11712 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 456 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3502.48 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3582.3 s]
/proc/loadavg: 4.21 4.21 4.18 5/265 33772
/proc/meminfo: memFree=119643344/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3562.27 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 907667 0 0 0 356145 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652884 CPUtime=3525.95 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 845767 0 0 0 352526 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=1932 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3562.27 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3598.15 s]
# the end of solver process 31466 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3577.25 s, system=0.834396 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.19 4.20 4.18 5/265 33772
/proc/meminfo: memFree=119643320/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3563.97 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 907688 0 0 0 356315 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=-7235432492932619644 CPUtime=3527.64 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 845788 0 0 0 352695 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=4499544200492773019 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3563.97 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3590.4 s]
/proc/loadavg: 4.18 4.20 4.18 5/265 33774
/proc/meminfo: memFree=119640848/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3570.34 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 907717 0 0 0 356952 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652884 CPUtime=3534.02 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 845817 0 0 0 353333 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=4638778398333157483 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3570.34 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3593.6 s]
/proc/loadavg: 4.18 4.20 4.18 5/265 33774
/proc/meminfo: memFree=119640824/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3573.53 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 907720 0 0 0 357271 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652884 CPUtime=3537.2 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 845820 0 0 0 353651 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=652884 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3573.53 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3595.2 s]
/proc/loadavg: 4.16 4.20 4.18 5/265 33774
/proc/meminfo: memFree=119640796/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3575.13 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 908252 0 0 0 357431 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=-7380110630961898362 CPUtime=3538.8 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 846352 0 0 0 353811 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=1984 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3575.13 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3596.8 s]
/proc/loadavg: 4.16 4.20 4.18 5/265 33774
/proc/meminfo: memFree=119640796/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3576.72 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 908254 0 0 0 357590 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=652884 CPUtime=3540.39 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 846354 0 0 0 353970 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=11712 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3576.72 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3597.6 s]
/proc/loadavg: 4.16 4.20 4.18 5/265 33774
/proc/meminfo: memFree=119640780/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3577.52 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 908254 0 0 0 357670 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=12772 CPUtime=3541.19 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 846354 0 0 0 354050 69 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=1932 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3577.52 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3598 s]*
/proc/loadavg: 4.16 4.20 4.18 5/265 33775
/proc/meminfo: memFree=119640760/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=761288 memory=652884 CPUtime=3577.92 cores=0,2
/proc/31466/stat : 31466 (fscip) S 31463 31466 27893 0 -1 1077936128 908418 0 0 0 357710 82 0 0 20 0 3 0 5058267 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 190322 163221 3366 3035 0 170590 0
[pid=31466/tid=31473] ppid=31463 vsize=761288 memory=-7235432492932619644 CPUtime=3541.6 cores=0,2
/proc/31466/task/31473/stat : 31473 (fscip) R 31463 31466 27893 0 -1 4194368 846514 0 0 0 354090 70 0 0 20 0 3 0 5061904 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
[pid=31466/tid=31478] ppid=31463 vsize=761288 memory=-4050210904893800847 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 3 0 5061913 779558912 163221 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3577.92 s
Current children cumulated vsize: 761288 KiB
Current children cumulated memory: 652884 KiB

[startup+3598.11 s]
/proc/loadavg: 4.16 4.20 4.18 5/265 33775
/proc/meminfo: memFree=119640760/131524600 swapFree=131071996/131071996
[pid=31466] ppid=31463 vsize=656564 memory=610908 CPUtime=3578.02 cores=0,2
/proc/31466/stat : 31466 (fscip) R 31463 31466 27893 0 -1 4194304 910419 0 0 0 357720 82 0 0 20 0 2 0 5058267 672321536 152727 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
/proc/31466/statm: 164141 152727 3366 3035 0 160080 0
[pid=31466/tid=31478] ppid=31463 vsize=656564 memory=652884 CPUtime=0.03 cores=0,2
/proc/31466/task/31478/stat : 31478 (fscip) S 31463 31466 27893 0 -1 1077936192 462 0 0 0 1 2 0 0 20 0 2 0 5061913 672321536 152727 134679101440 4194304 16623229 140727717713312 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 26390528 140727717717014 140727717717130 140727717717130 140727717724144 0
Current children cumulated CPU time: 3578.02 s
Current children cumulated vsize: 656564 KiB
Current children cumulated memory: 610908 KiB

Child status: 0

Real time (s): 3598.15
CPU time (s): 3578.08
CPU user time (s): 3577.25
CPU system time (s): 0.834396
CPU usage (%): 99.4421
Max. virtual memory (cumulated for all children) (KiB): 761288
Max. memory (cumulated for all children) (KiB): 652884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3577.25
system time used= 0.834396
maximum resident set size= 652884
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 910974
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3675
involuntary context switches= 31796


# summary of solver processes directly reported to runsolver:
#   pid: 31466
#   total CPU time (s): 3578.08
#   total CPU user time (s): 3577.25
#   total CPU system time (s): 0.834396

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.02741 second user time and 16.3751 second system time

The end

Launcher Data 

Begin job on nodeC020 at 2024-07-31 02:10:04
IDJOB=4464482
IDBENCH=158262
IDSOLVER=3092
FILE ID=nodeC020/4464482-1722384604
RUNJOBID= nodeC020-1722378594-27903
SLURM_JOB_ID= 8249843
Free space on /tmp= 889920 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K134.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464482-1722384604/watcher-4464482-1722384604 -o /tmp/evaluation-result-4464482-1722384604/solver-4464482-1722384604 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27903 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464482-1722384604.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 963edb3c79c326322e0bda3e585d3232
RANDOM SEED=1765878430

nodeC020.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3667.082
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.907
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3663.072
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.609
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.491
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3686.943
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3601.633
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.627
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        115477536 kB
MemAvailable:   123267736 kB
Buffers:          102952 kB
Cached:          8501056 kB
SwapCached:            0 kB
Active:           344804 kB
Inactive:       15171904 kB
Active(anon):       1576 kB
Inactive(anon):  6932492 kB
Active(file):     343228 kB
Inactive(file):  8239412 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29312 kB
Writeback:            12 kB
AnonPages:       6910512 kB
Mapped:           124844 kB
Shmem:             21336 kB
KReclaimable:      94412 kB
Slab:             176808 kB
SReclaimable:      94412 kB
SUnreclaim:        82396 kB
KernelStack:        4176 kB
PageTables:        22604 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    5028616 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9824 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1961984 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      193236 kB
DirectMap2M:    10065920 kB
DirectMap1G:    125829120 kB

Free space on /tmp at the end= 889968 MiB
End job on nodeC020 at 2024-07-31 03:10:02