Trace number 4452550

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02UNSAT 2226.41 2232.12

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/
dec/miplib2010/normalized-neos-506428.0.u.opb
MD5SUMbe38a350659e0c4d627f3ed91afb1797
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark574.907
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables42981
Total number of constraints129926
Number of constraints which are clauses129808
Number of constraints which are cardinality constraints (but not clauses)96
Number of constraints which are nor clauses,nor cardinality constraints22
Minimum length of a constraint2
Maximum length of a constraint1969
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 6515545
Number of bits of the biggest number in a constraint 23
Biggest sum of numbers in a constraint 500000069
Number of bits of the biggest sum of numbers29
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.50/0.52	c Default LC presolving (default).
0.50/0.52	c ** Before presolving: virtualMemUsedAtLc = 424490623, getVmSize() = 293433344, SCIPgetMemUsed() = 231438017, SCIPgetMemTotal() = 261833113, SCIPgetMemExternEstim() = 162657510
0.50/0.52	c ** set memory limit for presolving in LC to 8.79597e+12 for SCIP **
60.24/60.45	c ** Estimated virtualMemUsedAtSolver = 443460330, getVmSize() = 587329536, SCIPgetMemUsed() = 315258402, SCIPgetMemTotal() = 502532986, SCIPgetMemExternEstim() = 162657510
60.24/60.45	c ** set memory limit for solvers to 4.39803e+12 for each SCIP **
60.24/60.45	c Original Problem   :
60.24/60.45	c   Problem name     : instance-4452550-1721432610
60.24/60.45	c   Variables        : 42981 (42981 binary, 0 integer, 0 implicit integer, 0 continuous)
60.24/60.45	c   Constraints      : 129926
60.24/60.45	c   Objective sense  : minimize
60.24/60.45	c Presolved Problem  :
60.24/60.45	c   Variables        : 40630 (40630 binary, 0 integer, 0 implicit integer, 0 continuous)
60.24/60.45	c   Constraints      : 46101
60.24/60.45	c Constraints        : Number
60.24/60.45	c   knapsack         : 23 
60.24/60.45	c   setppc           : 7536 
60.24/60.45	c   and              : 38539 
60.24/60.45	c   linear           : 3 
60.24/60.45	c ** Instance transfer method used: 0
60.34/60.54	c ** ParaScipInstance copy increased the number of variables. **
60.44/60.65	c LC is working with racing ramp-up and with rebuilding tree after racing.
60.44/60.65	c                                Nodes    Active                                            
60.44/60.65	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
347.37/348.33	c       348              2           0         1                -           0.0000          -
1474.31/1478.49	c      1478              3           1         1                -           0.0000          -
1489.78/1493.97	c      1494              5           3         1                -           0.0000          -
1500.96/1505.14	c      1505              6           4         1                -           0.0000          -
1519.21/1523.41	c      1523              7           5         1                -           0.0000          -
1527.30/1531.59	c      1532              8           6         1                -           0.0000          -
1536.48/1540.71	c      1541              9           7         1                -           0.0000          -
1544.16/1548.48	c      1548             14           6         1                -           0.0000          -
1633.98/1638.47	c      1638             15           7         1                -           0.0000          -
1642.46/1646.95	c      1647             16           6         1                -           0.0000          -
1649.05/1653.58	c      1654             24          10         1                -           0.0000          -
1661.02/1665.53	c      1666             29           7         1                -           0.0000          -
1667.41/1671.95	c      1672             30           6         1                -           0.0000          -
1673.50/1678.08	c      1678             32           8         1                -           0.0000          -
1686.47/1691.01	c      1691             33           9         1                -           0.0000          -
1693.35/1697.98	c      1698             35          11         1                -           0.0000          -
1700.23/1704.87	c      1705             38          10         1                -           0.0000          -
1705.92/1710.59	c      1711             43          13         1                -           0.0000          -
1711.41/1716.03	c      1716             45          13         1                -           0.0000          -
1731.26/1735.97	c      1736             47          15         1                -           0.0000          -
1744.33/1749.04	c      1749             49          17         1                -           0.0000          -
1750.02/1754.72	c      1755             51          19         1                -           0.0000          -
1757.20/1761.90	c      1762             56          22         1                -           0.0000          -
1763.98/1768.77	c      1769             63          23         1                -           0.0000          -
1779.96/1784.73	c      1785             73          23         1                -           0.0000          -
1785.64/1790.49	c      1790             77          21         1                -           0.0000          -
1791.43/1796.27	c      1796             90          22         1                -           0.0000          -
1803.31/1808.13	c      1808             94          20         1                -           0.0000          -
1895.11/1900.12	c      1900             97          21         1                -           0.0000          -
1900.28/1905.30	c      1905            104          22         1                -           0.0000          -
1907.07/1912.10	c      1912            110          18         1                -           0.0000          -
1920.24/1925.36	c      1925            113          19         1                -           0.0000          -
1925.83/1930.93	c      1931            118          16         1                -           0.0000          -
1930.92/1936.03	c      1936            128          14         1                -           0.0000          -
1936.91/1942.00	c      1942            136          12         1                -           0.0000          -
1943.29/1948.42	c      1948            146          10         1                -           0.0000          -
1950.17/1955.36	c      1955            153          11         1                -           0.0000          -
1988.59/1993.85	c      1994            154          12         1                -           0.0000          -
1994.29/1999.58	c      2000            157           9         1                -           0.0000          -
1999.87/2005.10	c      2005            161           9         1                -           0.0000          -
2016.84/2022.19	c      2022            165           9         1                -           0.0000          -
2022.92/2028.28	c      2028            174           6         1                -           0.0000          -
2028.01/2033.39	c      2033            185           7         1                -           0.0000          -
2033.49/2038.82	c      2039            193           3         1                -           0.0000          -
2040.18/2045.50	c      2046            194           4         1                -           0.0000          -
2046.87/2052.27	c      2052            197           3         1                -           0.0000          -
2053.46/2058.88	c      2059            201           5         1                -           0.0000          -
2058.64/2064.01	c      2064            203           5         1                -           0.0000          -
2066.42/2071.85	c      2072            204           4         1                -           0.0000          -
2074.20/2079.69	c      2080            205           3         1                -           0.0000          -
2079.30/2084.70	c      2085            208           4         1                -           0.0000          -
2162.33/2167.99	c      2168            209           5         1                -           0.0000          -
2168.02/2173.68	c      2174            212           6         1                -           0.0000          -
2178.99/2184.64	c      2185            223           5         1                -           0.0000          -
2184.07/2189.76	c      2190            229           5         1                -           0.0000          -
2193.86/2199.58	c      2200            237           1         1                -           0.0000          -
2201.35/2207.08	c      2207            241           1         1                -           0.0000          -
2207.53/2213.25	c      2213            245           1         1                -           0.0000          -
2219.10/2224.80	c      2225            246           2         1                -           0.0000          -
2224.59/2230.35	c      2230            255           1         1                -           0.0000          -
2225.40/2231.14	c      2231            256           0         0                -           0.0000          -
2226.08/2231.83	c      2232            256           0         0                -           0.0000          -
2226.08/2231.83	c SCIP Status        : c problem is solved [infeasible]
2226.08/2231.83	c Total Time         : 2231.8300
2226.08/2231.83	c   solving          : 2231.8300
2226.08/2231.83	c   presolving       : 59.9339 (included in solving)
2226.08/2231.83	c B&B Tree           :
2226.08/2231.83	c   nodes (total)    : 256
2226.08/2231.83	c Solution           :
2226.08/2231.83	c   Solutions found  : 0
2226.08/2231.83	c   Primal Bound     :          -
2226.08/2231.83	c   Dual Bound       :          -
2226.08/2231.83	c Gap                :          -
2226.29/2232.10	s UNSATISFIABLE

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (61583 MiB free)
  memory of node 1: 64473 MiB (61378 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452550-1721432610/watcher-4452550-1721432610 -o /tmp/evaluation-result-4452550-1721432610/solver-4452550-1721432610 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC023-1721423005-1028661 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4452550-1721432610.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1035235, runsolver pid=1035232
Current StackSize limit: 8192 KiB


[startup+0.100094 s]*
/proc/loadavg: 4.08 4.11 4.09 5/264 1035236
/proc/meminfo: memFree=125850680/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=85132 memory=72928 CPUtime=0.09 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 16122 0 0 0 8 1 0 0 20 0 1 0 195425994 87175168 18232 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 21283 18232 2318 3032 0 17683 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 85132 KiB
Current children cumulated memory: 72928 KiB

[startup+0.20581 s]*
/proc/loadavg: 4.08 4.11 4.09 5/264 1035236
/proc/meminfo: memFree=125821616/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=114648 memory=102660 CPUtime=0.2 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 23610 0 0 0 17 3 0 0 20 0 1 0 195425994 117399552 25665 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 28662 25665 2318 3032 0 25062 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 114648 KiB
Current children cumulated memory: 102660 KiB

[startup+0.305782 s]*
/proc/loadavg: 4.08 4.11 4.09 5/264 1035236
/proc/meminfo: memFree=125760940/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=177024 memory=165528 CPUtime=0.3 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 39780 0 0 0 25 5 0 0 20 0 1 0 195425994 181272576 41382 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 44256 41382 2542 3032 0 40656 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 177024 KiB
Current children cumulated memory: 165528 KiB

[startup+0.700233 s]
/proc/loadavg: 4.08 4.11 4.09 5/264 1035236
/proc/meminfo: memFree=125659664/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=303732 memory=285624 CPUtime=0.69 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 69731 0 0 0 60 9 0 0 20 0 1 0 195425994 311021568 71406 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 75933 71406 2606 3032 0 72333 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 303732 KiB
Current children cumulated memory: 285624 KiB

[startup+1.50024 s]
/proc/loadavg: 4.16 4.12 4.09 5/264 1035236
/proc/meminfo: memFree=125596344/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=406660 memory=386644 CPUtime=1.48 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 88409 0 0 0 136 12 0 0 20 0 1 0 195425994 416419840 96661 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 101665 96661 2654 3032 0 98065 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 406660 KiB
Current children cumulated memory: 386644 KiB

[startup+3.1058 s]
/proc/loadavg: 4.16 4.12 4.09 6/264 1035238
/proc/meminfo: memFree=125535748/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=406660 memory=386936 CPUtime=3.09 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 88439 0 0 0 296 13 0 0 20 0 1 0 195425994 416419840 96734 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 101665 96734 2686 3032 0 98065 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 406660 KiB
Current children cumulated memory: 386936 KiB

[startup+6.30022 s]
/proc/loadavg: 4.14 4.12 4.09 5/264 1035238
/proc/meminfo: memFree=125504828/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=439352 memory=421108 CPUtime=6.28 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 103891 0 0 0 613 15 0 0 20 0 1 0 195425994 449896448 105277 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 109838 105277 2734 3032 0 106238 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 439352 KiB
Current children cumulated memory: 421108 KiB

[startup+12.7002 s]
/proc/loadavg: 4.13 4.12 4.09 5/264 1035238
/proc/meminfo: memFree=125482556/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=458308 memory=439912 CPUtime=12.66 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 108208 0 0 0 1250 16 0 0 20 0 1 0 195425994 469307392 109978 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 114577 109978 2734 3032 0 110977 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 458308 KiB
Current children cumulated memory: 439912 KiB

[startup+25.5002 s]
/proc/loadavg: 4.11 4.11 4.09 5/264 1035241
/proc/meminfo: memFree=125482340/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=458308 memory=439912 CPUtime=25.42 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 108230 0 0 0 2526 16 0 0 20 0 1 0 195425994 469307392 109978 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 114577 109978 2734 3032 0 110977 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 458308 KiB
Current children cumulated memory: 439912 KiB

[startup+51.1059 s]
/proc/loadavg: 4.14 4.12 4.09 5/264 1035245
/proc/meminfo: memFree=125482376/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=458308 memory=440008 CPUtime=50.97 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 108263 0 0 0 5080 17 0 0 20 0 1 0 195425994 469307392 110002 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 114577 110002 2734 3032 0 110977 0
Current children cumulated CPU time: 50.97 s
Current children cumulated vsize: 458308 KiB
Current children cumulated memory: 440008 KiB

[startup+102.3 s]
/proc/loadavg: 4.13 4.11 4.09 5/263 1035256
/proc/meminfo: memFree=125150636/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=874704 memory=770388 CPUtime=101.98 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 361783 0 0 0 10161 37 0 0 20 0 3 0 195425994 895696896 192597 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 218676 192597 2782 3032 0 214673 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=874704 memory=770388 CPUtime=41.58 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 235752 0 0 0 4141 17 0 0 20 0 3 0 195432040 895696896 192597 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=874704 memory=770388 CPUtime=0 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 44 0 0 0 0 0 0 0 20 0 3 0 195432059 895696896 192597 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 101.98 s
Current children cumulated vsize: 874704 KiB
Current children cumulated memory: 770388 KiB

[startup+162.3 s]
/proc/loadavg: 4.05 4.09 4.09 5/263 1035266
/proc/meminfo: memFree=125150348/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=874704 memory=770392 CPUtime=161.85 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 454128 0 0 0 16141 44 0 0 20 0 3 0 195425994 895696896 192598 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 218676 192598 2782 3032 0 214673 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=874704 memory=770388 CPUtime=101.45 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 328078 0 0 0 10121 24 0 0 20 0 3 0 195432040 895696896 192598 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=874704 memory=770388 CPUtime=0 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 63 0 0 0 0 0 0 0 20 0 3 0 195432059 895696896 192598 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 161.85 s
Current children cumulated vsize: 874704 KiB
Current children cumulated memory: 770392 KiB

[startup+222.3 s]
/proc/loadavg: 4.12 4.10 4.09 5/263 1035276
/proc/meminfo: memFree=125148380/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=940240 memory=771420 CPUtime=221.7 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 516469 0 0 0 22122 48 0 0 20 0 3 0 195425994 962805760 192855 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 235060 192855 2782 3032 0 214962 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=940240 memory=771420 CPUtime=161.3 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 390407 0 0 0 16102 28 0 0 20 0 3 0 195432040 962805760 192855 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=940240 memory=771420 CPUtime=0 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 75 0 0 0 0 0 0 0 20 0 3 0 195432059 962805760 192855 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 221.7 s
Current children cumulated vsize: 940240 KiB
Current children cumulated memory: 771420 KiB

[startup+282.3 s]
/proc/loadavg: 4.10 4.10 4.09 5/263 1035287
/proc/meminfo: memFree=124763096/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1335328 memory=1155776 CPUtime=281.55 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 666452 0 0 0 28087 68 0 0 20 0 3 0 195425994 1367375872 288944 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 333832 288944 2926 3032 0 323164 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1335328 memory=1155716 CPUtime=221.15 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 540386 0 0 0 22067 48 0 0 20 0 3 0 195432040 1367375872 288944 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1335328 memory=1155748 CPUtime=0 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 79 0 0 0 0 0 0 0 20 0 3 0 195432059 1367375872 288944 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 281.55 s
Current children cumulated vsize: 1335328 KiB
Current children cumulated memory: 1155776 KiB

[startup+342.3 s]
/proc/loadavg: 4.08 4.09 4.09 5/262 1035297
/proc/meminfo: memFree=124649588/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1400864 memory=1268244 CPUtime=341.39 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 760007 0 0 0 34062 77 0 0 20 0 3 0 195425994 1434484736 317061 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 350216 317061 2926 3032 0 343040 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1400864 memory=1155716 CPUtime=280.98 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 633935 0 0 0 28042 56 0 0 20 0 3 0 195432040 1434484736 317061 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1400864 memory=1158096 CPUtime=0 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 85 0 0 0 0 0 0 0 20 0 3 0 195432059 1434484736 317061 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0

################
# More data... #
################

[pid=1035235/tid=1035250] ppid=1035232 vsize=1745848 memory=1536236 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 263 0 0 0 1 1 0 0 20 0 3 0 195432059 1787748352 384349 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2017.03 s
Current children cumulated vsize: 1745848 KiB
Current children cumulated memory: 1537396 KiB

[startup+2082.3 s]
/proc/loadavg: 1.13 1.36 2.44 2/236 1036276
/proc/meminfo: memFree=126056688/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1560428 CPUtime=2076.91 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 1947712 0 0 0 207496 195 0 0 20 0 3 0 195425994 1860603904 390107 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 390107 2974 3032 0 436297 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=46416 CPUtime=2016.47 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1821241 0 0 0 201474 173 0 0 20 0 3 0 195432040 1860603904 390107 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=1560304 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 270 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 390107 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2076.91 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1560428 KiB

[startup+2142.3 s]
/proc/loadavg: 1.04 1.29 2.34 2/236 1036286
/proc/meminfo: memFree=126056172/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1560480 CPUtime=2136.78 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 1954251 0 0 0 213483 195 0 0 20 0 3 0 195425994 1860603904 390120 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 390120 2974 3032 0 436297 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=12952 CPUtime=2076.35 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1827774 0 0 0 207461 174 0 0 20 0 3 0 195432040 1860603904 390120 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=11648 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 276 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 390120 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2136.78 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1560480 KiB

[startup+2202.3 s]
/proc/loadavg: 1.12 1.27 2.27 2/239 1036302
/proc/meminfo: memFree=126044032/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1572224 CPUtime=2196.65 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 1980683 0 0 0 219468 197 0 0 20 0 3 0 195425994 1860603904 393056 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 393056 2974 3032 0 441545 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=1570000 CPUtime=2136.21 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1854164 0 0 0 213446 175 0 0 20 0 3 0 195432040 1860603904 393056 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=1560848 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 393056 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2196.65 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1572224 KiB

[startup+2232.12 s]
# the end of solver process 1035235 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=2224.38 s, system=2.02757 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2214.4 s]
/proc/loadavg: 1.10 1.26 2.25 2/239 1036306
/proc/meminfo: memFree=126041832/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1574456 CPUtime=2208.72 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 1991682 0 0 0 220675 197 0 0 20 0 3 0 195425994 1860603904 393614 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 393614 2974 3032 0 441973 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=1570888 CPUtime=2148.29 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1865155 0 0 0 214653 176 0 0 20 0 3 0 195432040 1860603904 393614 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=12952 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 393614 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2208.72 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1574456 KiB

[startup+2220.8 s]
/proc/loadavg: 1.10 1.26 2.25 2/239 1036306
/proc/meminfo: memFree=126041156/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1574812 CPUtime=2215.11 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 1991824 0 0 0 221314 197 0 0 20 0 3 0 195425994 1860603904 393703 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 393703 2974 3032 0 441973 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=46416 CPUtime=2154.68 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1865297 0 0 0 215292 176 0 0 20 0 3 0 195432040 1860603904 393703 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=1574812 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 393703 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2215.11 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1574812 KiB

[startup+2227.2 s]
/proc/loadavg: 1.08 1.25 2.23 2/239 1036307
/proc/meminfo: memFree=126032732/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1584084 CPUtime=2221.49 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 2001618 0 0 0 221951 198 0 0 20 0 3 0 195425994 1860603904 396021 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 396021 2974 3032 0 447461 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=1570672 CPUtime=2161.06 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1875091 0 0 0 215929 177 0 0 20 0 3 0 195432040 1860603904 396021 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=12952 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 396021 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2221.49 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1584084 KiB

[startup+2230.4 s]
/proc/loadavg: 1.08 1.25 2.23 2/239 1036308
/proc/meminfo: memFree=126030380/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1585672 CPUtime=2224.69 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 2002825 0 0 0 222270 199 0 0 20 0 3 0 195425994 1860603904 396418 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 396418 2974 3032 0 447544 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=1399094034239938618 CPUtime=2164.25 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1876298 0 0 0 216248 177 0 0 20 0 3 0 195432040 1860603904 396418 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=46416 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 396418 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2224.69 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1585672 KiB

[startup+2231.2 s]
/proc/loadavg: 1.08 1.25 2.23 2/239 1036308
/proc/meminfo: memFree=126030016/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1586040 CPUtime=2225.49 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 2004542 0 0 0 222350 199 0 0 20 0 3 0 195425994 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 396510 2974 3032 0 447556 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=1585672 CPUtime=2165.06 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1878016 0 0 0 216328 178 0 0 20 0 3 0 195432040 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=12952 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2225.49 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1586040 KiB

[startup+2231.6 s]
/proc/loadavg: 1.08 1.25 2.23 2/239 1036308
/proc/meminfo: memFree=126030016/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1816996 memory=1586040 CPUtime=2225.89 cores=4,6
/proc/1035235/stat : 1035235 (fscip) S 1035232 1035235 1028650 0 -1 1077936128 2012792 0 0 0 222390 199 0 0 20 0 3 0 195425994 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 454249 396510 2974 3032 0 447556 0
[pid=1035235/tid=1035249] ppid=1035232 vsize=1816996 memory=46416 CPUtime=2165.46 cores=4,6
/proc/1035235/task/1035249/stat : 1035249 (fscip) R 1035232 1035235 1028650 0 -1 4194368 1886264 0 0 0 216368 178 0 0 20 0 3 0 195432040 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
[pid=1035235/tid=1035250] ppid=1035232 vsize=1816996 memory=12952 CPUtime=0.02 cores=4,6
/proc/1035235/task/1035250/stat : 1035250 (fscip) S 1035232 1035235 1028650 0 -1 1077936192 283 0 0 0 1 1 0 0 20 0 3 0 195432059 1860603904 396510 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
Current children cumulated CPU time: 2225.89 s
Current children cumulated vsize: 1816996 KiB
Current children cumulated memory: 1586040 KiB

[startup+2232 s]*
/proc/loadavg: 1.07 1.24 2.22 2/237 1036308
/proc/meminfo: memFree=126184288/131524600 swapFree=131070704/131071996
[pid=1035235] ppid=1035232 vsize=1553796 memory=1429864 CPUtime=2226.29 cores=4,6
/proc/1035235/stat : 1035235 (fscip) R 1035232 1035235 1028650 0 -1 4194304 2019030 0 0 0 222429 200 0 0 20 0 1 0 195425994 1591087104 357466 134679101440 4194304 16613245 140732344087120 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 48402432 140732344091667 140732344091783 140732344091783 140732344098800 0
/proc/1035235/statm: 388449 357466 2974 3032 0 381924 0
Current children cumulated CPU time: 2226.29 s
Current children cumulated vsize: 1553796 KiB
Current children cumulated memory: 1429864 KiB

[startup+2232.11 s]*
/proc/loadavg: 1.07 1.24 2.22 2/237 1036308
/proc/meminfo: memFree=126744744/131524600 swapFree=131070704/131071996
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 0

Real time (s): 2232.12
CPU time (s): 2226.41
CPU user time (s): 2224.38
CPU system time (s): 2.02757
CPU usage (%): 99.7441
Max. virtual memory (cumulated for all children) (KiB): 1816996
Max. memory (cumulated for all children) (KiB): 1586040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2224.38
system time used= 2.02757
maximum resident set size= 1586100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2028050
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2550
involuntary context switches= 1672


# summary of solver processes directly reported to runsolver:
#   pid: 1035235
#   total CPU time (s): 2226.41
#   total CPU user time (s): 2224.38
#   total CPU system time (s): 2.02757

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.64887 second user time and 9.79458 second system time

The end

Launcher Data

Begin job on nodeC023 at 2024-07-20 01:43:43
IDJOB=4452550
IDBENCH=164450
IDSOLVER=3064
FILE ID=nodeC023/4452550-1721432610
RUNJOBID= nodeC023-1721423005-1028661
SLURM_JOB_ID= 7545608
Free space on /tmp= 889996 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/MIPLIB01/dec/miplib2010/normalized-neos-506428.0.u.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452550-1721432610/watcher-4452550-1721432610 -o /tmp/evaluation-result-4452550-1721432610/solver-4452550-1721432610 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC023-1721423005-1028661 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4452550-1721432610.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= be38a350659e0c4d627f3ed91afb1797
RANDOM SEED=1172143863

nodeC023.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3662.283
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.723
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.291
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.864
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3642.840
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.761
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.357
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.850
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125914176 kB
MemAvailable:   128131984 kB
Buffers:          570004 kB
Cached:          2484020 kB
SwapCached:           80 kB
Active:          1200348 kB
Inactive:        3838716 kB
Active(anon):       1580 kB
Inactive(anon):  2029192 kB
Active(file):    1198768 kB
Inactive(file):  1809524 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131070704 kB
Dirty:             32260 kB
Writeback:            20 kB
AnonPages:       1982856 kB
Mapped:           144520 kB
Shmem:             45728 kB
KReclaimable:      98676 kB
Slab:             192592 kB
SReclaimable:      98676 kB
SUnreclaim:        93916 kB
KernelStack:        4208 kB
PageTables:        13100 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1513004 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            33760 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1605632 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      316116 kB
DirectMap2M:    38254592 kB
DirectMap1G:    97517568 kB

Free space on /tmp at the end= 890052 MiB
End job on nodeC023 at 2024-07-20 02:20:55