Trace number 4464630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30? 3589.21 3598.41

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP135.shuf-3.opb
MD5SUMbaac7260ecc6f9812e76d8cbcf4d3b9b
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark9.93598
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables46580
Total number of constraints9317
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)4
Number of constraints which are nor clauses,nor cardinality constraints9313
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 10
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 30
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.31/0.37	c Default LC presolving (default).
0.31/0.37	c ** Before presolving: virtualMemUsedAtLc = 173776463, getVmSize() = 147513344, SCIPgetMemUsed() = 118223009, SCIPgetMemTotal() = 123273137, SCIPgetMemExternEstim() = 50503326
0.31/0.37	c ** set memory limit for presolving in LC to 8.79604e+12 for SCIP **
2.00/2.03	c ** Estimated virtualMemUsedAtSolver = 262793764, getVmSize() = 602492928, SCIPgetMemUsed() = 211639905, SCIPgetMemTotal() = 343687321, SCIPgetMemExternEstim() = 50503326
2.00/2.03	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
2.00/2.03	c Original Problem   :
2.00/2.03	c   Problem name     : instance-4464630-1722388215
2.00/2.03	c   Variables        : 46580 (46580 binary, 0 integer, 0 implicit integer, 0 continuous)
2.00/2.03	c   Constraints      : 9317
2.00/2.03	c   Objective sense  : minimize
2.00/2.03	c Presolved Problem  :
2.00/2.03	c   Variables        : 46580 (46580 binary, 0 integer, 0 implicit integer, 0 continuous)
2.00/2.03	c   Constraints      : 10166
2.00/2.03	c Constraints        : Number
2.00/2.03	c   knapsack         : 9317 
2.00/2.03	c   setppc           : 849 
2.00/2.03	c ** Instance transfer method used: 0
2.00/2.10	c ** ParaScipInstance copy does not increase the number of variables. **
2.19/2.25	c LC is working with racing ramp-up and with rebuilding tree after racing.
2.19/2.25	c                                Nodes    Active                                            
2.19/2.25	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
996.26/999.17	c       999              2           1         1                -           0.0000          -
2106.33/2112.01	c      2112              3           2         1                -           0.0000          -
3450.97/3459.93	c      3460              4           3         1                -           0.0000          -
3588.68/3598.00	c      3598              4           3         0                -           0.0000          -
3588.90/3598.15	c SCIP Status        : c solving was interrupted [hard time limit reached]
3588.90/3598.15	c Total Time         : 3598.1600
3588.90/3598.15	c   solving          : 3598.1600
3588.90/3598.15	c   presolving       : 1.6582 (included in solving)
3588.90/3598.15	c B&B Tree           :
3588.90/3598.15	c   nodes (total)    : 1
3588.90/3598.15	c Solution           :
3588.90/3598.15	c   Solutions found  : 0
3588.90/3598.15	c   Primal Bound     :          -
3588.90/3598.15	c   Dual Bound       : +0.00000000000000e+00
3588.90/3598.15	c Gap                :          -
3589.18/3598.40	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (51813 MiB free)
  memory of node 1: 64473 MiB (60376 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464630-1722388215/watcher-4464630-1722388215 -o /tmp/evaluation-result-4464630-1722388215/solver-4464630-1722388215 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC003-1722378594-29037 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464630-1722388215.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=35009, runsolver pid=35006
Current StackSize limit: 8192 KiB


[startup+0.100091 s]*
/proc/loadavg: 4.11 4.15 4.15 5/252 35010
/proc/meminfo: memFree=114843208/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=63824 memory=51880 CPUtime=0.1 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 10886 0 0 0 8 2 0 0 20 0 1 0 5192960 65355776 12970 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 15956 12970 2347 3035 0 12352 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 63824 KiB
Current children cumulated memory: 51880 KiB

[startup+0.212657 s]*
/proc/loadavg: 4.11 4.15 4.15 5/252 35010
/proc/meminfo: memFree=114815616/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=92268 memory=81516 CPUtime=0.22 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 18203 0 0 0 17 5 0 0 20 0 1 0 5192960 94482432 20379 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 23067 20379 2539 3035 0 19463 0
Current children cumulated CPU time: 0.22 s
Current children cumulated vsize: 92268 KiB
Current children cumulated memory: 81516 KiB

[startup+0.312001 s]*
/proc/loadavg: 4.11 4.15 4.15 5/252 35010
/proc/meminfo: memFree=114772468/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=130868 memory=119004 CPUtime=0.31 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 27536 0 0 0 24 7 0 0 20 0 1 0 5192960 134008832 29751 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 32717 29751 2539 3035 0 29113 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 130868 KiB
Current children cumulated memory: 119004 KiB

[startup+0.700367 s]
/proc/loadavg: 4.11 4.15 4.15 5/252 35010
/proc/meminfo: memFree=114744616/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=180456 memory=163060 CPUtime=0.69 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 46026 0 0 0 57 12 0 0 20 0 1 0 5192960 184786944 40765 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 45114 40765 2710 3035 0 41510 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 180456 KiB
Current children cumulated memory: 163060 KiB

[startup+1.50031 s]
/proc/loadavg: 4.10 4.15 4.15 5/252 35010
/proc/meminfo: memFree=114676060/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=236064 memory=217080 CPUtime=1.48 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 59452 0 0 0 134 14 0 0 20 0 1 0 5192960 241729536 54270 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 59016 54270 2758 3035 0 55412 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 236064 KiB
Current children cumulated memory: 217080 KiB

[startup+3.10902 s]
/proc/loadavg: 4.10 4.15 4.15 5/254 35012
/proc/meminfo: memFree=114184700/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=866908 memory=706684 CPUtime=3.08 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 180931 0 0 0 268 40 0 0 20 0 3 0 5192960 887713792 176671 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 216727 176671 2790 3035 0 201309 0
[pid=35009/tid=35011] ppid=35006 vsize=866908 memory=644140 CPUtime=0.98 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 51342 0 0 0 84 14 0 0 20 0 3 0 5193163 887713792 176671 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=866908 memory=0 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 3 0 5193186 887713792 176671 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 866908 KiB
Current children cumulated memory: 706684 KiB

[startup+6.30033 s]
/proc/loadavg: 4.09 4.15 4.15 5/254 35012
/proc/meminfo: memFree=114098212/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=789616 CPUtime=6.25 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 206402 0 0 0 578 47 0 0 20 0 3 0 5192960 954822656 197404 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 197404 2934 3035 0 223448 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=0 CPUtime=4.15 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 76808 0 0 0 394 21 0 0 20 0 3 0 5193163 954822656 197404 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=279912 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 5 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 197404 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 6.25 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 789616 KiB

[startup+12.7004 s]
/proc/loadavg: 4.08 4.14 4.15 5/254 35013
/proc/meminfo: memFree=114085940/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=791884 CPUtime=12.64 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 211818 0 0 0 1216 48 0 0 20 0 3 0 5192960 954822656 197971 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 197971 2934 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=791824 CPUtime=10.54 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 82213 0 0 0 1032 22 0 0 20 0 3 0 5193163 954822656 197971 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=791416 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 16 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 197971 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 12.64 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 791884 KiB

[startup+25.5004 s]
/proc/loadavg: 4.15 4.16 4.15 5/254 35111
/proc/meminfo: memFree=114717708/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=791916 CPUtime=25.4 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 221585 0 0 0 2491 49 0 0 20 0 3 0 5192960 954822656 197979 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 197979 2934 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=791916 CPUtime=23.3 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 91966 0 0 0 2307 23 0 0 20 0 3 0 5193163 954822656 197979 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=791916 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 30 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 197979 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 791916 KiB

[startup+51.1131 s]
/proc/loadavg: 4.04 4.13 4.14 5/254 35163
/proc/meminfo: memFree=114042500/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=793144 CPUtime=50.95 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 236583 0 0 0 5045 50 0 0 20 0 3 0 5192960 954822656 198286 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 198286 3238 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=12132 CPUtime=48.84 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 106948 0 0 0 4861 23 0 0 20 0 3 0 5193163 954822656 198286 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=1274 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 46 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 198286 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 50.95 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 793144 KiB

[startup+102.3 s]
/proc/loadavg: 4.10 4.12 4.14 5/254 35172
/proc/meminfo: memFree=114006588/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=793148 CPUtime=101.99 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 250586 0 0 0 10148 51 0 0 20 0 3 0 5192960 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 198287 3238 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=12576 CPUtime=99.88 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 120930 0 0 0 9964 24 0 0 20 0 3 0 5193163 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=-5155629115556457349 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 67 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 101.99 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 793148 KiB

[startup+162.3 s]
/proc/loadavg: 4.13 4.13 4.14 5/254 35183
/proc/meminfo: memFree=113964004/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=793148 CPUtime=161.78 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 261008 0 0 0 16127 51 0 0 20 0 3 0 5192960 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 198287 3238 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=793148 CPUtime=159.68 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 131340 0 0 0 15943 25 0 0 20 0 3 0 5193163 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=793148 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 79 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 161.78 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 793148 KiB

[startup+222.3 s]
/proc/loadavg: 4.09 4.12 4.13 5/254 35193
/proc/meminfo: memFree=113924052/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=793148 CPUtime=221.58 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 266493 0 0 0 22106 52 0 0 20 0 3 0 5192960 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 198287 3238 3035 0 223946 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=12132 CPUtime=219.47 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 136816 0 0 0 21922 25 0 0 20 0 3 0 5193163 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=793148 CPUtime=0 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 88 0 0 0 0 0 0 0 20 0 3 0 5193186 954822656 198287 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 221.58 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 793148 KiB

[startup+282.3 s]
/proc/loadavg: 4.23 4.14 4.14 5/253 35205
/proc/meminfo: memFree=113877536/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=794512 CPUtime=281.36 cores=4,6

################
# More data... #
################

[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3393.53 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 334974 0 0 0 339291 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=33104 CPUtime=3391.37 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 204768 0 0 0 339107 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=822400 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 586 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3393.53 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3462.3 s]
/proc/loadavg: 2.14 2.11 2.33 3/231 37063
/proc/meminfo: memFree=117567452/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3453.36 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335511 0 0 0 345274 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=33104 CPUtime=3451.2 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205282 0 0 0 345090 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=822400 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 596 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3453.36 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3522.3 s]
/proc/loadavg: 2.11 2.10 2.31 3/231 37073
/proc/meminfo: memFree=117566756/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3513.24 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335674 0 0 0 351262 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=822400 CPUtime=3511.08 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205439 0 0 0 351078 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=12132 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 602 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3513.24 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3582.3 s]
/proc/loadavg: 2.04 2.08 2.29 3/231 37084
/proc/meminfo: memFree=117566156/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3573.11 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335766 0 0 0 357249 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=822400 CPUtime=3570.95 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205523 0 0 0 357065 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=12132 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 610 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3573.11 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3598.41 s]
# the end of solver process 35009 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3588.55 s, system=0.654343 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 2.04 2.08 2.29 3/231 37084
/proc/meminfo: memFree=117566148/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3574.82 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335766 0 0 0 357420 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=-7595157513168839547 CPUtime=3572.66 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205523 0 0 0 357236 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=-4050210904893538445 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 610 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3574.82 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3590.4 s]
/proc/loadavg: 2.12 2.10 2.29 3/234 37091
/proc/meminfo: memFree=117565852/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3581.2 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335777 0 0 0 358058 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=822400 CPUtime=3579.03 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205530 0 0 0 357873 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=822400 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3581.2 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3593.6 s]
/proc/loadavg: 2.11 2.10 2.29 3/234 37091
/proc/meminfo: memFree=117565892/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3584.39 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335778 0 0 0 358377 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=822400 CPUtime=3582.23 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205531 0 0 0 358193 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=822400 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3584.39 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3596.8 s]
/proc/loadavg: 2.11 2.10 2.29 3/234 37091
/proc/meminfo: memFree=117565904/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3587.58 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335779 0 0 0 358696 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=12576 CPUtime=3585.42 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205532 0 0 0 358512 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=822400 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3587.58 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3597.6 s]
/proc/loadavg: 2.10 2.09 2.29 3/234 37091
/proc/meminfo: memFree=117565920/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3588.38 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335779 0 0 0 358776 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=16000 CPUtime=3586.22 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205532 0 0 0 358592 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=2296 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3588.38 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3598 s]*
/proc/loadavg: 2.10 2.09 2.29 3/234 37091
/proc/meminfo: memFree=117565912/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=932444 memory=822400 CPUtime=3588.79 cores=4,6
/proc/35009/stat : 35009 (fscip) S 35006 35009 29026 0 -1 1077936128 335875 0 0 0 358817 62 0 0 20 0 3 0 5192960 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 233111 205600 3238 3035 0 224816 0
[pid=35009/tid=35011] ppid=35006 vsize=932444 memory=-7595157513168839547 CPUtime=3586.63 cores=4,6
/proc/35009/task/35011/stat : 35011 (fscip) R 35006 35009 29026 0 -1 4194368 205614 0 0 0 358633 30 0 0 20 0 3 0 5193163 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
[pid=35009/tid=35012] ppid=35006 vsize=932444 memory=4713751055816093346 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 3 0 5193186 954822656 205600 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3588.79 s
Current children cumulated vsize: 932444 KiB
Current children cumulated memory: 822400 KiB

[startup+3598.4 s]
/proc/loadavg: 2.10 2.09 2.29 3/234 37091
/proc/meminfo: memFree=117565912/131655788 swapFree=131071216/131071996
[pid=35009] ppid=35006 vsize=834840 memory=710116 CPUtime=3589.18 cores=4,6
/proc/35009/stat : 35009 (fscip) R 35006 35009 29026 0 -1 4194304 341945 0 0 0 358854 64 0 0 20 0 2 0 5192960 854876160 177529 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
/proc/35009/statm: 208710 177529 3286 3035 0 200415 0
[pid=35009/tid=35012] ppid=35006 vsize=834840 memory=11968 CPUtime=0.05 cores=4,6
/proc/35009/task/35012/stat : 35012 (fscip) S 35006 35009 29026 0 -1 1077936192 614 0 0 0 1 4 0 0 20 0 2 0 5193186 854876160 177529 134679101440 4194304 16623229 140726201771776 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 45645824 140726201775126 140726201775242 140726201775242 140726201782256 0
Current children cumulated CPU time: 3589.18 s
Current children cumulated vsize: 834840 KiB
Current children cumulated memory: 710116 KiB

Child status: 0

Real time (s): 3598.41
CPU time (s): 3589.21
CPU user time (s): 3588.55
CPU system time (s): 0.654343
CPU usage (%): 99.7441
Max. virtual memory (cumulated for all children) (KiB): 932444
Max. memory (cumulated for all children) (KiB): 822400

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3588.55
system time used= 0.654343
maximum resident set size= 822400
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 342010
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3633
involuntary context switches= 1431


# summary of solver processes directly reported to runsolver:
#   pid: 35009
#   total CPU time (s): 3589.21
#   total CPU user time (s): 3588.55
#   total CPU system time (s): 0.654343

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 18.4049 second user time and 32.7445 second system time

The end

Launcher Data 

Begin job on nodeC003 at 2024-07-31 03:10:15
IDJOB=4464630
IDBENCH=165317
IDSOLVER=3092
FILE ID=nodeC003/4464630-1722388215
RUNJOBID= nodeC003-1722378594-29037
SLURM_JOB_ID= 8249833
Free space on /tmp= 723688 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP135.shuf-3.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464630-1722388215/watcher-4464630-1722388215 -o /tmp/evaluation-result-4464630-1722388215/solver-4464630-1722388215 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC003-1722378594-29037 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464630-1722388215.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= baac7260ecc6f9812e76d8cbcf4d3b9b
RANDOM SEED=292526229

nodeC003.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3663.786
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3663.161
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.231
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.265
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3491.341
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3666.969
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1199.131
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.233
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        114882388 kB
MemAvailable:   125739568 kB
Buffers:          102540 kB
Cached:         11573484 kB
SwapCached:           16 kB
Active:           286328 kB
Inactive:       16011224 kB
Active(anon):       1452 kB
Inactive(anon):  4641308 kB
Active(file):     284876 kB
Inactive(file): 11369916 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071216 kB
Dirty:             29768 kB
Writeback:            76 kB
AnonPages:       4619844 kB
Mapped:           126556 kB
Shmem:             21156 kB
KReclaimable:      85176 kB
Slab:             164040 kB
SReclaimable:      85176 kB
SUnreclaim:        78864 kB
KernelStack:        4032 kB
PageTables:        18148 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    3117836 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             7008 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2936832 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      295752 kB
DirectMap2M:    11143168 kB
DirectMap1G:    124780544 kB

Free space on /tmp at the end= 723724 MiB
End job on nodeC003 at 2024-07-31 04:10:14