Trace number 4446020

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02? 3587.75 3604.02

General information on the benchmark

NamePB24/normalized-PB11/DEC-LIN/
lopes/normalized-133.opb
MD5SUMbf76f01107fc6e0f0d7316d8818a221b
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables48253
Total number of constraints1119563
Number of constraints which are clauses1005877
Number of constraints which are cardinality constraints (but not clauses)3541
Number of constraints which are nor clauses,nor cardinality constraints110145
Minimum length of a constraint1
Maximum length of a constraint690
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 691
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
3.76/3.83	c Default LC presolving (default).
3.76/3.85	c ** Before presolving: virtualMemUsedAtLc = 2714012009, getVmSize() = 1621868544, SCIPgetMemUsed() = 1440523921, SCIPgetMemTotal() = 1519477161, SCIPgetMemExternEstim() = 1194534848
3.76/3.85	c ** set memory limit for presolving in LC to 8.79528e+12 for SCIP **
35.46/35.85	c ** Estimated virtualMemUsedAtSolver = 3256120729, getVmSize() = 3974262784, SCIPgetMemUsed() = 2379108814, SCIPgetMemTotal() = 3689646246, SCIPgetMemExternEstim() = 1194534848
35.46/35.85	c ** set memory limit for solvers to 4.39795e+12 for each SCIP **
35.46/35.85	c Original Problem   :
35.46/35.85	c   Problem name     : instance-4446020-1721324842
35.46/35.85	c   Variables        : 48253 (48253 binary, 0 integer, 0 implicit integer, 0 continuous)
35.46/35.85	c   Constraints      : 1119563
35.46/35.85	c   Objective sense  : minimize
35.46/35.85	c Presolved Problem  :
35.46/35.85	c   Variables        : 47387 (47387 binary, 0 integer, 0 implicit integer, 0 continuous)
35.46/35.85	c   Constraints      : 1082039
35.46/35.85	c Constraints        : Number
35.46/35.85	c   knapsack         : 111893 
35.46/35.85	c   setppc           : 227931 
35.46/35.85	c   linear           : 1 
35.46/35.85	c   logicor          : 742214 
35.46/35.85	c ** Instance transfer method used: 0
37.35/37.70	c ** ParaScipInstance copy does not increase the number of variables. **
38.75/39.11	c LC is working with racing ramp-up and with rebuilding tree after racing.
38.75/39.11	c                                Nodes    Active                                            
38.75/39.11	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
3583.75/3600.01	c      3600              0           1         0                --179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368.0000          -
3586.24/3602.55	c SCIP Status        : c solving was interrupted [hard time limit reached]
3586.24/3602.55	c Total Time         : 3602.5500
3586.24/3602.55	c   solving          : 3602.5500
3586.24/3602.55	c   presolving       : 32.0002 (included in solving)
3586.24/3602.55	c B&B Tree           :
3586.24/3602.55	c   nodes (total)    : 1
3586.24/3602.55	c Solution           :
3586.24/3602.55	c   Solutions found  : 0
3586.24/3602.55	c   Primal Bound     :          -
3586.24/3602.55	c   Dual Bound       :          -
3586.24/3602.55	c Gap                :          -
3587.63/3603.97	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63968 MiB (61301 MiB free)
  memory of node 1: 64473 MiB (60222 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446020-1721324842/watcher-4446020-1721324842 -o /tmp/evaluation-result-4446020-1721324842/solver-4446020-1721324842 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1721317650-1007724 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4446020-1721324842.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1012585, runsolver pid=1012582

[startup+0.100416 s]*
/proc/loadavg: 4.08 4.15 4.16 5/261 1012586
/proc/meminfo: memFree=124437588/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=55748 memory=43704 CPUtime=0.09 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 8873 0 0 0 8 1 0 0 20 0 1 0 184652297 57085952 10926 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 13937 10926 2318 3032 0 10337 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 55748 KiB
Current children cumulated memory: 43704 KiB

[startup+0.205477 s]*
/proc/loadavg: 4.08 4.15 4.16 5/261 1012586
/proc/meminfo: memFree=124433216/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=86528 memory=74024 CPUtime=0.19 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 16394 0 0 0 18 1 0 0 20 0 1 0 184652297 88604672 18506 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 21632 18506 2318 3032 0 18032 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 86528 KiB
Current children cumulated memory: 74024 KiB

[startup+0.305457 s]*
/proc/loadavg: 4.08 4.15 4.16 5/261 1012586
/proc/meminfo: memFree=124427076/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=117068 memory=104536 CPUtime=0.3 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 24029 0 0 0 27 3 0 0 20 0 1 0 184652297 119877632 26134 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 29267 26134 2318 3032 0 25667 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 117068 KiB
Current children cumulated memory: 104536 KiB

[startup+0.700233 s]
/proc/loadavg: 4.08 4.15 4.16 5/261 1012586
/proc/meminfo: memFree=124426632/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=228060 memory=215392 CPUtime=0.68 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 51268 0 0 0 62 6 0 0 20 0 1 0 184652297 233533440 53848 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 57015 53848 2318 3032 0 53415 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 228060 KiB
Current children cumulated memory: 215392 KiB

[startup+1.50022 s]
/proc/loadavg: 4.08 4.15 4.16 5/261 1012586
/proc/meminfo: memFree=124420624/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=453240 memory=440604 CPUtime=1.48 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 105489 0 0 0 133 15 0 0 20 0 1 0 184652297 464117760 110151 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 113310 110151 2318 3032 0 109710 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 453240 KiB
Current children cumulated memory: 440604 KiB

[startup+3.10642 s]
/proc/loadavg: 4.07 4.14 4.15 5/257 1012678
/proc/meminfo: memFree=125858616/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=1161984 memory=1148516 CPUtime=3.07 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 261122 0 0 0 267 40 0 0 20 0 1 0 184652297 1189871616 287129 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 290496 287129 2542 3032 0 286896 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 1161984 KiB
Current children cumulated memory: 1148516 KiB

[startup+6.3004 s]
/proc/loadavg: 4.07 4.14 4.15 5/257 1012678
/proc/meminfo: memFree=124810784/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=2010400 memory=1941936 CPUtime=6.24 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 368015 0 0 0 560 64 0 0 20 0 1 0 184652297 2058649600 485484 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 502600 485484 2622 3032 0 499000 0
Current children cumulated CPU time: 6.24 s
Current children cumulated vsize: 2010400 KiB
Current children cumulated memory: 1941936 KiB

[startup+12.7004 s]
/proc/loadavg: 4.06 4.14 4.15 5/259 1012682
/proc/meminfo: memFree=124085064/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=1949244 memory=1906380 CPUtime=12.56 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 416578 0 0 0 1161 95 0 0 20 0 1 0 184652297 1996025856 476595 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 487311 476595 2686 3032 0 483711 0
Current children cumulated CPU time: 12.56 s
Current children cumulated vsize: 1949244 KiB
Current children cumulated memory: 1906380 KiB

[startup+25.5004 s]
/proc/loadavg: 4.05 4.13 4.15 5/261 1012685
/proc/meminfo: memFree=121310072/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=2366472 memory=2326796 CPUtime=25.25 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 510571 0 0 0 2414 111 0 0 20 0 1 0 184652297 2423267328 581699 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 591618 581699 2734 3032 0 588018 0
Current children cumulated CPU time: 25.25 s
Current children cumulated vsize: 2366472 KiB
Current children cumulated memory: 2326796 KiB

[startup+51.1055 s]
/proc/loadavg: 4.10 4.14 4.15 5/263 1012692
/proc/meminfo: memFree=117593844/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=6302348 memory=5991572 CPUtime=50.71 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1377430 0 0 0 4794 277 0 0 20 0 3 0 184652297 6453604352 1497893 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 1575587 1497893 2782 3032 0 1552298 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=6302348 memory=5991140 CPUtime=13.35 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 711723 0 0 0 1223 112 0 0 20 0 3 0 184655882 6453604352 1497893 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=6302348 memory=5504936 CPUtime=0 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 1 0 0 0 0 0 0 0 20 0 3 0 184656209 6453604352 1497893 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 50.71 s
Current children cumulated vsize: 6302348 KiB
Current children cumulated memory: 5991572 KiB

[startup+102.3 s]
/proc/loadavg: 4.10 4.13 4.15 5/263 1012701
/proc/meminfo: memFree=115226672/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=101.71 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1677930 0 0 0 9818 353 0 0 20 0 3 0 184652297 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2189618 2076918 2926 3032 0 2166085 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=8758472 memory=2326796 CPUtime=64.34 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 1012211 0 0 0 6246 188 0 0 20 0 3 0 184655882 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=8758472 memory=11396 CPUtime=0 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 13 0 0 0 0 0 0 0 20 0 3 0 184656209 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 101.71 s
Current children cumulated vsize: 8758472 KiB
Current children cumulated memory: 8307672 KiB

[startup+162.3 s]
/proc/loadavg: 4.08 4.12 4.14 5/265 1012715
/proc/meminfo: memFree=115221344/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=161.47 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1711168 0 0 0 15785 362 0 0 20 0 3 0 184652297 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2189618 2076918 2926 3032 0 2166085 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=124.11 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 1045437 0 0 0 12214 197 0 0 20 0 3 0 184655882 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=0 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 25 0 0 0 0 0 0 0 20 0 3 0 184656209 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 161.47 s
Current children cumulated vsize: 8758472 KiB
Current children cumulated memory: 8307672 KiB

[startup+222.3 s]
/proc/loadavg: 4.06 4.11 4.14 5/265 1012726
/proc/meminfo: memFree=115011436/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=221.21 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1741727 0 0 0 21750 371 0 0 20 0 3 0 184652297 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2189618 2076918 2926 3032 0 2166085 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=183.85 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 1075984 0 0 0 18179 206 0 0 20 0 3 0 184655882 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=8758472 memory=11396 CPUtime=0 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 37 0 0 0 0 0 0 0 20 0 3 0 184656209 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 221.21 s
Current children cumulated vsize: 8758472 KiB
Current children cumulated memory: 8307672 KiB

[startup+282.3 s]
/proc/loadavg: 4.07 4.10 4.13 5/265 1012738
/proc/meminfo: memFree=115010504/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=280.94 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1772358 0 0 0 27714 380 0 0 20 0 3 0 184652297 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2189618 2076918 2926 3032 0 2166085 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=8758472 memory=43840 CPUtime=243.57 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 1106603 0 0 0 24142 215 0 0 20 0 3 0 184655882 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=8758472 memory=8307672 CPUtime=0 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 49 0 0 0 0 0 0 0 20 0 3 0 184656209 8968675328 2076918 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 280.94 s
Current children cumulated vsize: 8758472 KiB
Current children cumulated memory: 8307672 KiB

[startup+342.3 s]
/proc/loadavg: 4.22 4.13 4.14 5/265 1012749
/proc/meminfo: memFree=115004344/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=8758472 memory=8308088 CPUtime=340.68 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 1805301 0 0 0 33678 390 0 0 20 0 3 0 184652297 8968675328 2077022 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2189618 2077022 2926 3032 0 2166085 0

################
# More data... #
################

/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3500410 0 0 0 332026 689 0 0 20 0 3 0 184652297 9735135232 2134414 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2134414 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=8537656 CPUtime=3289.73 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2834288 0 0 0 328453 520 0 0 20 0 3 0 184655882 9735135232 2134414 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=2212 CPUtime=0.04 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 416 0 0 0 1 3 0 0 20 0 3 0 184656209 9735135232 2134414 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3327.15 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8537656 KiB

[startup+3402.3 s]
/proc/loadavg: 4.62 4.28 4.16 5/266 1014551
/proc/meminfo: memFree=112051044/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8538484 CPUtime=3386.89 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3504985 0 0 0 337998 691 0 0 20 0 3 0 184652297 9735135232 2134621 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2134621 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=2212 CPUtime=3349.48 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2838856 0 0 0 334426 522 0 0 20 0 3 0 184655882 9735135232 2134621 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=8538484 CPUtime=0.04 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 423 0 0 0 1 3 0 0 20 0 3 0 184656209 9735135232 2134621 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3386.89 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8538484 KiB

[startup+3462.3 s]
/proc/loadavg: 4.32 4.25 4.16 5/266 1014561
/proc/meminfo: memFree=112047524/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8540744 CPUtime=3446.64 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3509865 0 0 0 343972 692 0 0 20 0 3 0 184652297 9735135232 2135186 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2135186 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=2212 CPUtime=3409.23 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2843731 0 0 0 340399 524 0 0 20 0 3 0 184655882 9735135232 2135186 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=8538484 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 428 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2135186 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3446.64 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8540744 KiB

[startup+3522.3 s]
/proc/loadavg: 4.19 4.22 4.16 5/263 1014571
/proc/meminfo: memFree=112046232/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8541456 CPUtime=3506.39 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3515422 0 0 0 349945 694 0 0 20 0 3 0 184652297 9735135232 2135364 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2135364 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=43840 CPUtime=3468.97 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2849280 0 0 0 346372 525 0 0 20 0 3 0 184655882 9735135232 2135364 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=11396 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 436 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2135364 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3506.39 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8541456 KiB

[startup+3582.3 s]
/proc/loadavg: 4.13 4.20 4.15 5/263 1014583
/proc/meminfo: memFree=112041044/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=3566.13 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3520755 0 0 0 355917 696 0 0 20 0 3 0 184652297 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2136371 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=43840 CPUtime=3528.71 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2854608 0 0 0 352344 527 0 0 20 0 3 0 184655882 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 441 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3566.13 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8545484 KiB

[startup+3604.02 s]
# the end of solver process 1012585 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3580.5 s, system=7.25053 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.13 4.20 4.15 5/263 1014583
/proc/meminfo: memFree=112041044/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=3567.83 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3520776 0 0 0 356087 696 0 0 20 0 3 0 184652297 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2136371 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=-7096686500032844137 CPUtime=3530.41 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2854627 0 0 0 352514 527 0 0 20 0 3 0 184655882 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=-6933350163988323775 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 443 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3567.83 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8545484 KiB

[startup+3596.8 s]
/proc/loadavg: 4.11 4.19 4.15 5/263 1014586
/proc/meminfo: memFree=112040992/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=3580.56 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3520979 0 0 0 357360 696 0 0 20 0 3 0 184652297 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2136371 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=11396 CPUtime=3543.15 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2854829 0 0 0 353787 528 0 0 20 0 3 0 184655882 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 444 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3580.56 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8545484 KiB

[startup+3600 s]*
/proc/loadavg: 4.10 4.18 4.15 5/263 1014587
/proc/meminfo: memFree=112040992/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=3583.75 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3521978 0 0 0 357679 696 0 0 20 0 3 0 184652297 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2136371 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=-7096686500032844137 CPUtime=3546.34 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2856199 0 0 0 354106 528 0 0 20 0 3 0 184655882 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=-6933350163988323775 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 444 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3583.75 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8545484 KiB

[startup+3601.6 s]
/proc/loadavg: 4.10 4.18 4.15 5/263 1014587
/proc/meminfo: memFree=112040812/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=9506968 memory=8545484 CPUtime=3585.34 cores=0,2
/proc/1012585/stat : 1012585 (fscip) S 1012582 1012585 1007714 0 -1 1077936128 3596231 0 0 0 357834 700 0 0 20 0 3 0 184652297 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 2376742 2136371 2926 3032 0 2356452 0
[pid=1012585/tid=1012688] ppid=1012582 vsize=9506968 memory=11396 CPUtime=3547.92 cores=0,2
/proc/1012585/task/1012688/stat : 1012688 (fscip) R 1012582 1012585 1007714 0 -1 4194368 2930062 0 0 0 354261 531 0 0 20 0 3 0 184655882 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
[pid=1012585/tid=1012691] ppid=1012582 vsize=9506968 memory=43840 CPUtime=0.05 cores=0,2
/proc/1012585/task/1012691/stat : 1012691 (fscip) S 1012582 1012585 1007714 0 -1 1077936192 444 0 0 0 1 4 0 0 20 0 3 0 184656209 9735135232 2136371 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
Current children cumulated CPU time: 3585.34 s
Current children cumulated vsize: 9506968 KiB
Current children cumulated memory: 8545484 KiB

[startup+3603.2 s]
/proc/loadavg: 4.09 4.18 4.15 4/255 1014601
/proc/meminfo: memFree=116408608/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=6882516 memory=6581424 CPUtime=3586.93 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 3751780 0 0 0 357985 708 0 0 20 0 1 0 184652297 7047696384 1645356 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 1720629 1645356 2974 3032 0 1684371 0
Current children cumulated CPU time: 3586.93 s
Current children cumulated vsize: 6882516 KiB
Current children cumulated memory: 6581424 KiB

[startup+3603.6 s]
/proc/loadavg: 4.09 4.18 4.15 4/255 1014601
/proc/meminfo: memFree=116408608/131524600 swapFree=131071996/131071996
[pid=1012585] ppid=1012582 vsize=6718144 memory=6417720 CPUtime=3587.33 cores=0,2
/proc/1012585/stat : 1012585 (fscip) R 1012582 1012585 1007714 0 -1 4194304 3795149 0 0 0 358022 711 0 0 20 0 1 0 184652297 6879379456 1604430 134679101440 4194304 16613245 140735798565088 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18822208 18930672 41725952 140735798572051 140735798572167 140735798572167 140735798579184 0
/proc/1012585/statm: 1679536 1604430 2974 3032 0 1643278 0
Current children cumulated CPU time: 3587.33 s
Current children cumulated vsize: 6718144 KiB
Current children cumulated memory: 6417720 KiB

[startup+3604 s]*
/proc/loadavg: 4.09 4.18 4.15 3/243 1014649
/proc/meminfo: memFree=125365548/131524600 swapFree=131071996/131071996
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 0

Real time (s): 3604.02
CPU time (s): 3587.75
CPU user time (s): 3580.5
CPU system time (s): 7.25053
CPU usage (%): 99.5487
Max. virtual memory (cumulated for all children) (KiB): 9506968
Max. memory (cumulated for all children) (KiB): 8545484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3580.5
system time used= 7.25053
maximum resident set size= 8608520
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3889450
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3729
involuntary context switches= 25354


# summary of solver processes directly reported to runsolver:
#   pid: 1012585
#   total CPU time (s): 3587.75
#   total CPU user time (s): 3580.5
#   total CPU system time (s): 7.25053

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.46671 second user time and 16.0002 second system time

The end

Launcher Data 

Begin job on nodeC030 at 2024-07-18 19:47:35
IDJOB=4446020
IDBENCH=155423
IDSOLVER=3064
FILE ID=nodeC030/4446020-1721324842
RUNJOBID= nodeC030-1721317650-1007724
SLURM_JOB_ID= 7542666
Free space on /tmp= 889948 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB11/DEC-LIN/lopes/normalized-133.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4446020-1721324842/watcher-4446020-1721324842 -o /tmp/evaluation-result-4446020-1721324842/solver-4446020-1721324842 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC030-1721317650-1007724 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4446020-1721324842.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= bf76f01107fc6e0f0d7316d8818a221b
RANDOM SEED=1229768869

nodeC030.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3680.922
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3687.064
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3655.639
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.865
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3678.721
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3687.054
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.704
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6999.28
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3599.714
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7005.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        124436380 kB
MemAvailable:   125683424 kB
Buffers:          481344 kB
Cached:          1594728 kB
SwapCached:            0 kB
Active:          1111920 kB
Inactive:        5342492 kB
Active(anon):       1548 kB
Inactive(anon):  4414596 kB
Active(file):    1110372 kB
Inactive(file):   927896 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             78180 kB
Writeback:             0 kB
AnonPages:       4359524 kB
Mapped:           141752 kB
Shmem:             37720 kB
KReclaimable:      97200 kB
Slab:             209624 kB
SReclaimable:      97200 kB
SUnreclaim:       112424 kB
KernelStack:        4192 kB
PageTables:        18012 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    2358872 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            70016 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2856960 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      234196 kB
DirectMap2M:    18413568 kB
DirectMap1G:    117440512 kB

Free space on /tmp at the end= 889972 MiB
End job on nodeC030 at 2024-07-18 20:47:39