Trace number 4464486

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3589.04 3598.69

General information on the benchmark

NamePB24/normalized-PB12/DEC-LIN/
sroussel/ShortestPathNG/normalized-NG_K150.opb
MD5SUMde861f201885d7430b03c8868c66597b
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables17850
Total number of constraints18152
Number of constraints which are clauses18002
Number of constraints which are cardinality constraints (but not clauses)150
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint150
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 151
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.10/0.19	c Default LC presolving (default).
0.10/0.19	c ** Before presolving: virtualMemUsedAtLc = 106103660, getVmSize() = 95100928, SCIPgetMemUsed() = 64118301, SCIPgetMemTotal() = 71416053, SCIPgetMemExternEstim() = 34687607
0.10/0.19	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
33.87/34.03	c ** Estimated virtualMemUsedAtSolver = 220273966, getVmSize() = 327684096, SCIPgetMemUsed() = 220776311, SCIPgetMemTotal() = 295723343, SCIPgetMemExternEstim() = 34687607
33.87/34.03	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
33.87/34.03	c Original Problem   :
33.87/34.03	c   Problem name     : instance-4464486-1722385792
33.87/34.03	c   Variables        : 17850 (17850 binary, 0 integer, 0 implicit integer, 0 continuous)
33.87/34.03	c   Constraints      : 18152
33.87/34.03	c   Objective sense  : minimize
33.87/34.03	c Presolved Problem  :
33.87/34.03	c   Variables        : 16327 (16327 binary, 0 integer, 0 implicit integer, 0 continuous)
33.87/34.03	c   Constraints      : 16591
33.87/34.03	c Constraints        : Number
33.87/34.03	c   knapsack         : 1 
33.87/34.03	c   setppc           : 2031 
33.87/34.03	c   orbitope         : 1 
33.87/34.03	c   logicor          : 14558 
33.87/34.03	c ** Instance transfer method used: 0
33.87/34.07	c ** ParaScipInstance copy increased the number of variables. **
33.98/34.16	c LC is working with racing ramp-up and with rebuilding tree after racing.
33.98/34.16	c                                Nodes    Active                                            
33.98/34.16	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1081.30/1084.23	c      1084              2           1         1                -           0.0000          -
1099.56/1102.58	c      1103              3           2         1                -           0.0000          -
1108.05/1111.03	c      1111              4           3         1                -           0.0000          -
1128.58/1131.66	c      1132              5           4         1                -           0.0000          -
1150.53/1153.68	c      1154              6           5         1                -           0.0000          -
1173.78/1176.95	c      1177              8           7         1                -           0.0000          -
1532.18/1536.13	c      1536             10           9         1                -           0.0000          -
1547.82/1551.81	c      1552             11          10         1                -           0.0000          -
1644.09/1648.34	c      1648             12          11         1                -           0.0000          -
1848.53/1853.32	c      1853             13          12         1                -           0.0000          -
2008.16/2013.40	c      2013             14          13         1                -           0.0000          -
2233.56/2239.49	c      2240             15          14         1                -           0.0000          -
3588.74/3598.47	c      3598             15          14         0                -           0.0000          -
3588.85/3598.57	c SCIP Status        : c solving was interrupted [hard time limit reached]
3588.85/3598.57	c Total Time         : 3598.5700
3588.85/3598.57	c   solving          : 3598.5700
3588.85/3598.57	c   presolving       : 33.8407 (included in solving)
3588.85/3598.57	c B&B Tree           :
3588.85/3598.57	c   nodes (total)    : 1
3588.85/3598.57	c Solution           :
3588.85/3598.57	c   Solutions found  : 0
3588.85/3598.57	c   Primal Bound     :          -
3588.85/3598.57	c   Dual Bound       : +0.00000000000000e+00
3588.85/3598.57	c Gap                :          -
3588.95/3598.68	s UNKNOWN

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (60779 MiB free)
  memory of node 1: 64473 MiB (57371 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464486-1722385792/watcher-4464486-1722385792 -o /tmp/evaluation-result-4464486-1722385792/solver-4464486-1722385792 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC006-1722378594-30829 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464486-1722385792.opb -qsol -t 3600 -sth 1 

running on 2 cores: 1,3

CPU governors:
  performance: 1 3

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=35057, runsolver pid=35054

[startup+0.100599 s]*
/proc/loadavg: 4.11 4.11 4.12 5/244 35068
/proc/meminfo: memFree=120960216/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=49188 memory=37736 CPUtime=0.1 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 7306 0 0 0 8 2 0 0 20 0 1 0 5175764 50368512 9434 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 12297 9434 2347 3035 0 8693 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 49188 KiB
Current children cumulated memory: 37736 KiB

[startup+0.213236 s]*
/proc/loadavg: 4.11 4.11 4.12 5/244 35068
/proc/meminfo: memFree=120912796/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=98592 memory=85304 CPUtime=0.21 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 19043 0 0 0 18 3 0 0 20 0 1 0 5175764 100958208 21326 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 24648 21326 2598 3035 0 21044 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 98592 KiB
Current children cumulated memory: 85304 KiB

[startup+0.313365 s]*
/proc/loadavg: 4.11 4.11 4.12 5/250 35078
/proc/meminfo: memFree=120891724/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=122296 memory=107784 CPUtime=0.31 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 24679 0 0 0 27 4 0 0 20 0 1 0 5175764 125231104 26946 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 30574 26946 2646 3035 0 26970 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 122296 KiB
Current children cumulated memory: 107784 KiB

[startup+0.700337 s]
/proc/loadavg: 4.11 4.11 4.12 5/250 35078
/proc/meminfo: memFree=120850620/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=123192 memory=109832 CPUtime=0.68 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 27726 0 0 0 63 5 0 0 20 0 1 0 5175764 126148608 27458 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 30798 27458 2662 3035 0 27194 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 123192 KiB
Current children cumulated memory: 109832 KiB

[startup+1.50034 s]
/proc/loadavg: 4.11 4.11 4.12 5/250 35078
/proc/meminfo: memFree=120813912/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=165772 memory=149980 CPUtime=1.48 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 39071 0 0 0 141 7 0 0 20 0 1 0 5175764 169750528 37495 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 41443 37495 2774 3035 0 37839 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 165772 KiB
Current children cumulated memory: 149980 KiB

[startup+3.11304 s]
/proc/loadavg: 4.10 4.11 4.12 5/248 35172
/proc/meminfo: memFree=121822824/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=176968 memory=161324 CPUtime=3.09 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 41864 0 0 0 301 8 0 0 20 0 1 0 5175764 181215232 40331 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 44242 40331 2774 3035 0 40638 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 176968 KiB
Current children cumulated memory: 161324 KiB

[startup+6.3003 s]
/proc/loadavg: 4.10 4.11 4.12 5/250 35272
/proc/meminfo: memFree=121610476/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=178232 memory=162636 CPUtime=6.26 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 42182 0 0 0 618 8 0 0 20 0 1 0 5175764 182509568 40659 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 44558 40659 2774 3035 0 40954 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 178232 KiB
Current children cumulated memory: 162636 KiB

[startup+12.7003 s]
/proc/loadavg: 4.09 4.11 4.12 5/253 35331
/proc/meminfo: memFree=121348908/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=183080 memory=167192 CPUtime=12.64 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 43416 0 0 0 1255 9 0 0 20 0 1 0 5175764 187473920 41798 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 45770 41798 2774 3035 0 42166 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 183080 KiB
Current children cumulated memory: 167192 KiB

[startup+25.5003 s]
/proc/loadavg: 4.15 4.12 4.12 6/251 35332
/proc/meminfo: memFree=121317860/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=184484 memory=168556 CPUtime=25.39 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 43954 0 0 0 2530 9 0 0 20 0 1 0 5175764 188911616 42139 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 46121 42139 2774 3035 0 42517 0
Current children cumulated CPU time: 25.39 s
Current children cumulated vsize: 184484 KiB
Current children cumulated memory: 168556 KiB

[startup+51.1129 s]
/proc/loadavg: 4.10 4.11 4.11 6/253 35339
/proc/meminfo: memFree=120949044/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=560516 memory=446980 CPUtime=50.91 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 155325 0 0 0 5065 26 0 0 20 0 3 0 5175764 573968384 111745 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 140129 111745 2950 3035 0 130935 0
[pid=35057/tid=35335] ppid=35054 vsize=560516 memory=444420 CPUtime=16.97 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 83480 0 0 0 1685 12 0 0 20 0 3 0 5179167 573968384 111745 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=560516 memory=444444 CPUtime=0 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 33 0 0 0 0 0 0 0 20 0 3 0 5179180 573968384 111745 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 50.91 s
Current children cumulated vsize: 560516 KiB
Current children cumulated memory: 446980 KiB

[startup+102.3 s]
/proc/loadavg: 4.09 4.11 4.11 5/252 35347
/proc/meminfo: memFree=120866104/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=560516 memory=457012 CPUtime=101.95 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 197931 0 0 0 10166 29 0 0 20 0 3 0 5175764 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 140129 114253 2966 3035 0 133204 0
[pid=35057/tid=35335] ppid=35054 vsize=560516 memory=456572 CPUtime=68.01 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 126055 0 0 0 6785 16 0 0 20 0 3 0 5179167 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=560516 memory=456416 CPUtime=0 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 64 0 0 0 0 0 0 0 20 0 3 0 5179180 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 101.95 s
Current children cumulated vsize: 560516 KiB
Current children cumulated memory: 457012 KiB

[startup+162.3 s]
/proc/loadavg: 4.20 4.13 4.12 5/252 35358
/proc/meminfo: memFree=120840976/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=560516 memory=457012 CPUtime=161.78 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 208289 0 0 0 16148 30 0 0 20 0 3 0 5175764 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 140129 114253 2966 3035 0 133204 0
[pid=35057/tid=35335] ppid=35054 vsize=560516 memory=457012 CPUtime=127.84 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 136395 0 0 0 12768 16 0 0 20 0 3 0 5179167 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=560516 memory=457012 CPUtime=0 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 82 0 0 0 0 0 0 0 20 0 3 0 5179180 573968384 114253 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 161.78 s
Current children cumulated vsize: 560516 KiB
Current children cumulated memory: 457012 KiB

[startup+222.3 s]
/proc/loadavg: 4.12 4.12 4.11 5/250 35368
/proc/meminfo: memFree=120750104/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=665520 memory=523480 CPUtime=221.63 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 244028 0 0 0 22130 33 0 0 20 0 3 0 5175764 681492480 130870 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 166380 130870 2982 3035 0 149325 0
[pid=35057/tid=35335] ppid=35054 vsize=665520 memory=514524 CPUtime=187.68 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 172125 0 0 0 18749 19 0 0 20 0 3 0 5179167 681492480 130870 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=665520 memory=1804 CPUtime=0 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 91 0 0 0 0 0 0 0 20 0 3 0 5179180 681492480 130870 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 221.63 s
Current children cumulated vsize: 665520 KiB
Current children cumulated memory: 523480 KiB

[startup+282.3 s]
/proc/loadavg: 4.08 4.11 4.10 5/250 35378
/proc/meminfo: memFree=120684204/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=669760 memory=561464 CPUtime=281.47 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 298724 0 0 0 28111 36 0 0 20 0 3 0 5175764 685834240 140366 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 167440 140366 2982 3035 0 154289 0
[pid=35057/tid=35335] ppid=35054 vsize=669760 memory=541940 CPUtime=247.53 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 226815 0 0 0 24731 22 0 0 20 0 3 0 5179167 685834240 140366 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=669760 memory=554656 CPUtime=0 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 97 0 0 0 0 0 0 0 20 0 3 0 5179180 685834240 140366 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 281.47 s
Current children cumulated vsize: 669760 KiB
Current children cumulated memory: 561464 KiB

[startup+342.3 s]
/proc/loadavg: 4.13 4.12 4.10 5/249 35389
/proc/meminfo: memFree=120641888/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=669760 memory=579204 CPUtime=341.32 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 302623 0 0 0 34095 37 0 0 20 0 3 0 5175764 685834240 144801 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 167440 144801 2982 3035 0 156176 0

################
# More data... #
################

[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3393.19 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 546796 0 0 0 339256 63 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=-7667215107206767227 CPUtime=3359.2 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 474550 0 0 0 335874 46 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=707768 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 359 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3393.19 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3462.3 s]
/proc/loadavg: 4.17 4.28 4.20 5/251 36924
/proc/meminfo: memFree=119254384/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3453.03 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 547982 0 0 0 345239 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=-7667215107206767227 CPUtime=3419.03 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 475731 0 0 0 341857 46 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=707768 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 364 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3453.03 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3522.3 s]
/proc/loadavg: 4.16 4.26 4.19 5/252 37105
/proc/meminfo: memFree=119249968/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3512.86 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 549144 0 0 0 351222 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=14936 CPUtime=3478.85 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 476888 0 0 0 347839 46 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=707768 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 369 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3512.86 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3582.3 s]
/proc/loadavg: 4.11 4.22 4.18 5/252 37116
/proc/meminfo: memFree=119238984/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3572.69 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550368 0 0 0 357205 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=12036 CPUtime=3538.69 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478107 0 0 0 353822 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=707768 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 374 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3572.69 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3598.69 s]
# the end of solver process 35057 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3588.38 s, system=0.661207 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.10 4.22 4.18 5/252 37116
/proc/meminfo: memFree=119238620/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3574.39 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550369 0 0 0 357375 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=7686721470247706567 CPUtime=3540.4 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478108 0 0 0 353993 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=4137571778489380505 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 374 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3574.39 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3590.4 s]
/proc/loadavg: 4.09 4.21 4.18 5/252 37118
/proc/meminfo: memFree=119238032/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3580.76 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550430 0 0 0 358012 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=707768 CPUtime=3546.77 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478166 0 0 0 354630 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=4137571778489380505 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3580.76 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3593.6 s]
/proc/loadavg: 4.09 4.21 4.18 5/252 37118
/proc/meminfo: memFree=119237804/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3583.95 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550432 0 0 0 358331 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=707768 CPUtime=3549.96 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478168 0 0 0 354949 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=707768 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3583.95 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3596.8 s]
/proc/loadavg: 4.08 4.21 4.18 5/252 37119
/proc/meminfo: memFree=119237804/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3587.14 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550439 0 0 0 358650 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=707768 CPUtime=3553.15 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478175 0 0 0 355268 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=14936 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3587.14 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3597.6 s]
/proc/loadavg: 4.08 4.21 4.18 5/252 37119
/proc/meminfo: memFree=119237524/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3587.94 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550439 0 0 0 358730 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=4137571778489380505 CPUtime=3553.94 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478175 0 0 0 355347 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=2316 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3587.94 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3598.4 s]
/proc/loadavg: 4.08 4.21 4.18 5/252 37119
/proc/meminfo: memFree=119237552/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=800832 memory=707768 CPUtime=3588.74 cores=1,3
/proc/35057/stat : 35057 (fscip) S 35054 35057 30817 0 -1 1077936128 550439 0 0 0 358810 64 0 0 20 0 3 0 5175764 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 200208 176942 3334 3035 0 184248 0
[pid=35057/tid=35335] ppid=35054 vsize=800832 memory=14936 CPUtime=3554.74 cores=1,3
/proc/35057/task/35335/stat : 35335 (fscip) R 35054 35057 30817 0 -1 4194368 478175 0 0 0 355427 47 0 0 20 0 3 0 5179167 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 -1 1 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
[pid=35057/tid=35336] ppid=35054 vsize=800832 memory=14936 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 3 0 5179180 820051968 176942 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3588.74 s
Current children cumulated vsize: 800832 KiB
Current children cumulated memory: 707768 KiB

[startup+3598.6 s]
/proc/loadavg: 4.08 4.21 4.18 5/252 37119
/proc/meminfo: memFree=119237552/131655788 swapFree=131071996/131071996
[pid=35057] ppid=35054 vsize=757448 memory=664400 CPUtime=3588.95 cores=1,3
/proc/35057/stat : 35057 (fscip) R 35054 35057 30817 0 -1 4194304 551864 0 0 0 358830 65 0 0 20 0 2 0 5175764 775626752 166100 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 0 0 0 17 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
/proc/35057/statm: 189362 166100 3334 3035 0 173402 0
[pid=35057/tid=35336] ppid=35054 vsize=757448 memory=38548 CPUtime=0.04 cores=1,3
/proc/35057/task/35336/stat : 35336 (fscip) S 35054 35057 30817 0 -1 1077936192 377 0 0 0 1 3 0 0 20 0 2 0 5179180 775626752 166100 134679101440 4194304 16623229 140731320007376 0 0 0 0 0 2 1 0 0 -1 3 0 0 0 0 0 18838560 18947056 39776256 140731320009750 140731320009866 140731320009866 140731320016880 0
Current children cumulated CPU time: 3588.95 s
Current children cumulated vsize: 757448 KiB
Current children cumulated memory: 664400 KiB

Child status: 0

Real time (s): 3598.69
CPU time (s): 3589.04
CPU user time (s): 3588.38
CPU system time (s): 0.661207
CPU usage (%): 99.7319
Max. virtual memory (cumulated for all children) (KiB): 800832
Max. memory (cumulated for all children) (KiB): 707768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3588.38
system time used= 0.661207
maximum resident set size= 707768
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 552286
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3635
involuntary context switches= 1550


# summary of solver processes directly reported to runsolver:
#   pid: 35057
#   total CPU time (s): 3589.04
#   total CPU user time (s): 3588.38
#   total CPU system time (s): 0.661207

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 17.7027 second user time and 34.8007 second system time

The end

Launcher Data

Begin job on nodeC006 at 2024-07-31 02:29:53
IDJOB=4464486
IDBENCH=158322
IDSOLVER=3092
FILE ID=nodeC006/4464486-1722385792
RUNJOBID= nodeC006-1722378594-30829
SLURM_JOB_ID= 8249836
Free space on /tmp= 723696 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB12/DEC-LIN/sroussel/ShortestPathNG/normalized-NG_K150.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464486-1722385792/watcher-4464486-1722385792 -o /tmp/evaluation-result-4464486-1722385792/solver-4464486-1722385792 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC006-1722378594-30829 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464486-1722385792.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= de861f201885d7430b03c8868c66597b
RANDOM SEED=1367756045

nodeC006.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3491.738
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3491.738
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.173
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.174
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3662.143
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3660.263
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.188
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.263
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        120987292 kB
MemAvailable:   128760312 kB
Buffers:          105488 kB
Cached:          8435756 kB
SwapCached:            0 kB
Active:           291968 kB
Inactive:        9795496 kB
Active(anon):       1460 kB
Inactive(anon):  1566396 kB
Active(file):     290508 kB
Inactive(file):  8229100 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29192 kB
Writeback:             4 kB
AnonPages:       1546472 kB
Mapped:           114716 kB
Shmem:             21320 kB
KReclaimable:     187220 kB
Slab:             274200 kB
SReclaimable:     187220 kB
SUnreclaim:        86980 kB
KernelStack:        4028 kB
PageTables:        12128 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    1028652 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             7200 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1497088 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      232264 kB
DirectMap2M:    16449536 kB
DirectMap1G:    119537664 kB

Free space on /tmp at the end= 723696 MiB
End job on nodeC006 at 2024-07-31 03:29:51