Trace number 4464629

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-30UNSAT 1089.25 1093.28

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP115.shuf-1.opb
MD5SUMa3c218acab88c9e5abe907b008036492
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark8.83428
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables33930
Total number of constraints6787
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)12
Number of constraints which are nor clauses,nor cardinality constraints6775
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 9
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 29
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.09/0.13	c Default LC presolving (default).
0.09/0.13	c ** Before presolving: virtualMemUsedAtLc = 129192024, getVmSize() = 115658752, SCIPgetMemUsed() = 86906622, SCIPgetMemTotal() = 92410102, SCIPgetMemExternEstim() = 36781922
0.09/0.13	c ** set memory limit for presolving in LC to 8.79605e+12 for SCIP **
0.99/1.07	c ** Estimated virtualMemUsedAtSolver = 213223114, getVmSize() = 464027648, SCIPgetMemUsed() = 166457278, SCIPgetMemTotal() = 283052750, SCIPgetMemExternEstim() = 36781922
0.99/1.07	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
0.99/1.07	c Original Problem   :
0.99/1.07	c   Problem name     : instance-4464629-1722388202
0.99/1.07	c   Variables        : 33930 (33930 binary, 0 integer, 0 implicit integer, 0 continuous)
0.99/1.07	c   Constraints      : 6787
0.99/1.07	c   Objective sense  : minimize
0.99/1.07	c Presolved Problem  :
0.99/1.07	c   Variables        : 33930 (33930 binary, 0 integer, 0 implicit integer, 0 continuous)
0.99/1.07	c   Constraints      : 7731
0.99/1.07	c Constraints        : Number
0.99/1.07	c   knapsack         : 6787 
0.99/1.07	c   setppc           : 944 
0.99/1.07	c ** Instance transfer method used: 0
1.09/1.13	c ** ParaScipInstance copy does not increase the number of variables. **
1.09/1.19	c LC is working with racing ramp-up and with rebuilding tree after racing.
1.09/1.19	c                                Nodes    Active                                            
1.09/1.19	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
209.12/210.48	c       210              2           1         1                -           0.0000          -
931.83/935.48	c       935              3           2         1                -           0.0000          -
1088.96/1093.06	c      1093              3           0         0                -           0.0000          -
1088.96/1093.06	c      1093              3           0         0                -           0.0000          -
1089.06/1093.18	c      1093              3           0         0                -           0.0000          -
1089.06/1093.18	c SCIP Status        : c problem is solved [infeasible]
1089.06/1093.18	c Total Time         : 1093.1700
1089.06/1093.18	c   solving          : 1093.1700
1089.06/1093.18	c   presolving       : 0.9468 (included in solving)
1089.06/1093.18	c B&B Tree           :
1089.06/1093.18	c   nodes (total)    : 3
1089.06/1093.18	c Solution           :
1089.06/1093.18	c   Solutions found  : 0
1089.06/1093.18	c   Primal Bound     :          -
1089.06/1093.18	c   Dual Bound       :          -
1089.06/1093.18	c Gap                :          -
1089.16/1093.28	s UNSATISFIABLE

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (57590 MiB free)
  memory of node 1: 64510 MiB (59874 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464629-1722388202/watcher-4464629-1722388202 -o /tmp/evaluation-result-4464629-1722388202/solver-4464629-1722388202 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27903 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464629-1722388202.opb -qsol -t 3600 -sth 1 

running on 2 cores: 0,2

CPU governors:
  performance: 0 2

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=33820, runsolver pid=33817

[startup+0.100168 s]*
/proc/loadavg: 4.15 4.19 4.18 5/263 33821
/proc/meminfo: memFree=120203604/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=102924 memory=91128 CPUtime=0.09 cores=0,2
/proc/33820/stat : 33820 (fscip) R 33817 33820 27893 0 -1 4194304 20597 0 0 0 7 2 0 0 20 0 1 0 5418123 105394176 22782 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 25731 22782 2539 3035 0 22127 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 102924 KiB
Current children cumulated memory: 91128 KiB

[startup+0.205533 s]*
/proc/loadavg: 4.15 4.19 4.18 5/263 33821
/proc/meminfo: memFree=120171260/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=147360 memory=131436 CPUtime=0.19 cores=0,2
/proc/33820/stat : 33820 (fscip) R 33817 33820 27893 0 -1 4194304 29590 0 0 0 16 3 0 0 20 0 1 0 5418123 150896640 32859 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 36840 32859 2662 3035 0 33236 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 147360 KiB
Current children cumulated memory: 131436 KiB

[startup+0.305626 s]*
/proc/loadavg: 4.15 4.19 4.18 5/263 33821
/proc/meminfo: memFree=120141828/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=171740 memory=155960 CPUtime=0.29 cores=0,2
/proc/33820/stat : 33820 (fscip) R 33817 33820 27893 0 -1 4194304 42699 0 0 0 24 5 0 0 20 0 1 0 5418123 175861760 38990 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 42935 38990 2710 3035 0 39331 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 171740 KiB
Current children cumulated memory: 155960 KiB

[startup+0.700228 s]
/proc/loadavg: 4.15 4.19 4.18 5/263 33821
/proc/meminfo: memFree=120132140/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=233944 memory=164648 CPUtime=0.68 cores=0,2
/proc/33820/stat : 33820 (fscip) R 33817 33820 27893 0 -1 4194304 44870 0 0 0 62 6 0 0 20 0 1 0 5418123 239558656 41162 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 58486 41162 2758 3035 0 54882 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 233944 KiB
Current children cumulated memory: 164648 KiB

[startup+1.50115 s]
/proc/loadavg: 4.15 4.19 4.18 5/263 33821
/proc/meminfo: memFree=119909672/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=666152 memory=539432 CPUtime=1.48 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 141908 0 0 0 129 19 0 0 20 0 3 0 5418123 682139648 134858 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 166538 134858 2790 3035 0 153985 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 666152 KiB
Current children cumulated memory: 539432 KiB

[startup+3.10615 s]
/proc/loadavg: 4.15 4.19 4.18 5/265 33823
/proc/meminfo: memFree=119692664/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=601324 CPUtime=3.07 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 158180 0 0 0 285 22 0 0 20 0 3 0 5418123 749248512 150331 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 150331 2934 3035 0 170315 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=198340509722 CPUtime=1.95 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 58350 0 0 0 186 9 0 0 20 0 3 0 5418231 749248512 150331 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=0 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 3 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 150331 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 601324 KiB

[startup+6.30115 s]
/proc/loadavg: 4.22 4.21 4.18 5/265 33823
/proc/meminfo: memFree=119692184/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=601852 CPUtime=6.24 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 162152 0 0 0 601 23 0 0 20 0 3 0 5418123 749248512 150463 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 150463 2934 3035 0 170405 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=0 CPUtime=5.11 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 62315 0 0 0 502 9 0 0 20 0 3 0 5418231 749248512 150463 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=0 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 10 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 150463 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 6.24 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 601852 KiB

[startup+12.7011 s]
/proc/loadavg: 4.20 4.20 4.18 5/265 33825
/proc/meminfo: memFree=119691460/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=602332 CPUtime=12.58 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 169622 0 0 0 1235 23 0 0 20 0 3 0 5418123 749248512 150583 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 150583 2934 3035 0 170521 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=0 CPUtime=11.46 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 69775 0 0 0 1136 10 0 0 20 0 3 0 5418231 749248512 150583 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=602332 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 20 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 150583 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 12.58 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 602332 KiB

[startup+25.5012 s]
/proc/loadavg: 4.24 4.21 4.18 5/265 33826
/proc/meminfo: memFree=119690972/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=603908 CPUtime=25.27 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 177979 0 0 0 2503 24 0 0 20 0 3 0 5418123 749248512 150977 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 150977 3238 3035 0 170622 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=11712 CPUtime=24.14 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 78114 0 0 0 2404 10 0 0 20 0 3 0 5418231 749248512 150977 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=11712 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 38 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 150977 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 25.27 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 603908 KiB

[startup+51.1061 s]
/proc/loadavg: 4.15 4.19 4.18 5/266 33835
/proc/meminfo: memFree=119689908/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=604028 CPUtime=50.64 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 189164 0 0 0 5040 24 0 0 20 0 3 0 5418123 749248512 151007 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 151007 3238 3035 0 170628 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=604028 CPUtime=49.5 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 89285 0 0 0 4940 10 0 0 20 0 3 0 5418231 749248512 151007 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=604028 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 52 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 151007 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 50.64 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 604028 KiB

[startup+102.3 s]
/proc/loadavg: 4.18 4.19 4.18 5/266 33843
/proc/meminfo: memFree=119688144/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=605028 CPUtime=101.37 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 198773 0 0 0 10112 25 0 0 20 0 3 0 5418123 749248512 151257 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 151257 3238 3035 0 170886 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=605028 CPUtime=100.24 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 98877 0 0 0 10013 11 0 0 20 0 3 0 5418231 749248512 151257 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=605028 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 69 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 151257 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 101.37 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 605028 KiB

[startup+162.3 s]
/proc/loadavg: 4.17 4.19 4.18 5/265 33854
/proc/meminfo: memFree=119681244/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=605248 CPUtime=161.18 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 207500 0 0 0 16092 26 0 0 20 0 3 0 5418123 749248512 151312 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 151312 3238 3035 0 170942 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=605248 CPUtime=160.05 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 107590 0 0 0 15993 12 0 0 20 0 3 0 5418231 749248512 151312 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=11712 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 83 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 151312 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 161.18 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 605248 KiB

[startup+222.3 s]
/proc/loadavg: 4.26 4.20 4.18 5/263 33864
/proc/meminfo: memFree=119676924/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=605604 CPUtime=220.99 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 221667 0 0 0 22072 27 0 0 20 0 3 0 5418123 749248512 151401 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 151401 3238 3035 0 170959 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=605344 CPUtime=219.85 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 121712 0 0 0 21972 13 0 0 20 0 3 0 5418231 749248512 151401 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=605604 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 94 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 151401 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 220.99 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 605604 KiB

[startup+282.3 s]
/proc/loadavg: 4.13 4.17 4.18 5/263 33876
/proc/meminfo: memFree=119672004/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=605636 CPUtime=280.77 cores=0,2

################
# More data... #
################

[pid=33820] ppid=33817 vsize=731688 memory=626396 CPUtime=878.9 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 258571 0 0 0 87858 32 0 0 20 0 3 0 5418123 749248512 156599 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156599 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=1932 CPUtime=877.76 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 158524 0 0 0 87758 18 0 0 20 0 3 0 5418231 749248512 156599 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=626396 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 186 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156599 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 878.9 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626396 KiB

[startup+942.3 s]
/proc/loadavg: 4.19 4.14 4.16 5/263 34380
/proc/meminfo: memFree=119639692/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626400 CPUtime=938.71 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 260628 0 0 0 93839 32 0 0 20 0 3 0 5418123 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156600 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=626396 CPUtime=937.57 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 160559 0 0 0 93739 18 0 0 20 0 3 0 5418231 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=626400 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 195 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 938.71 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626400 KiB

[startup+1002.3 s]
/proc/loadavg: 4.12 4.13 4.15 5/263 34390
/proc/meminfo: memFree=119639316/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626400 CPUtime=998.53 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 261242 0 0 0 99821 32 0 0 20 0 3 0 5418123 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156600 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=626400 CPUtime=997.39 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 161164 0 0 0 99721 18 0 0 20 0 3 0 5418231 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=626400 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 204 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156600 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 998.53 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626400 KiB

[startup+1062.3 s]
/proc/loadavg: 4.12 4.12 4.15 5/263 34402
/proc/meminfo: memFree=119638388/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1058.35 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262885 0 0 0 105802 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=626404 CPUtime=1057.22 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162798 0 0 0 105703 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=626408 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 213 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1058.35 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1093.28 s]
# the end of solver process 33820 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=1088.9 s, system=0.345681 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1075.2 s]
/proc/loadavg: 4.25 4.15 4.15 5/263 34403
/proc/meminfo: memFree=119638324/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1071.21 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262890 0 0 0 107088 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=626404 CPUtime=1070.08 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162803 0 0 0 106989 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=-7091317304856764287 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 213 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1071.21 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1081.6 s]
/proc/loadavg: 4.23 4.14 4.15 5/263 34406
/proc/meminfo: memFree=119638108/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1077.59 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262900 0 0 0 107726 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=5492 CPUtime=1076.46 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162810 0 0 0 107627 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=13204 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1077.59 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1088 s]*
/proc/loadavg: 4.29 4.16 4.16 5/263 34406
/proc/meminfo: memFree=119638092/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1083.98 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262903 0 0 0 108365 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=2672 CPUtime=1082.84 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162813 0 0 0 108265 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=7686721470264483783 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1083.98 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1091.2 s]
/proc/loadavg: 4.27 4.16 4.16 5/263 34408
/proc/meminfo: memFree=119637956/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1087.16 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262903 0 0 0 108683 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=626412 CPUtime=1086.03 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162813 0 0 0 108584 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=12772 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1087.16 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1092 s]*
/proc/loadavg: 4.27 4.16 4.16 5/263 34408
/proc/meminfo: memFree=119637996/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1087.97 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262903 0 0 0 108764 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=-7091317304856764287 CPUtime=1086.83 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162813 0 0 0 108664 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=7686721470264483783 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1087.97 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1092.8 s]
/proc/loadavg: 4.27 4.16 4.16 5/263 34408
/proc/meminfo: memFree=119637996/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=626412 CPUtime=1088.76 cores=0,2
/proc/33820/stat : 33820 (fscip) S 33817 33820 27893 0 -1 1077936128 262903 0 0 0 108843 33 0 0 20 0 3 0 5418123 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 156603 3238 3035 0 171182 0
[pid=33820/tid=33822] ppid=33817 vsize=731688 memory=-7091317304856764287 CPUtime=1087.62 cores=0,2
/proc/33820/task/33822/stat : 33822 (fscip) R 33817 33820 27893 0 -1 4194368 162813 0 0 0 108743 19 0 0 20 0 3 0 5418231 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 -1 0 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=11712 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 3 0 5418242 749248512 156603 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1088.76 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 626412 KiB

[startup+1093.2 s]
/proc/loadavg: 4.27 4.16 4.16 5/263 34408
/proc/meminfo: memFree=119637964/131524600 swapFree=131071996/131071996
[pid=33820] ppid=33817 vsize=731688 memory=614184 CPUtime=1089.16 cores=0,2
/proc/33820/stat : 33820 (fscip) R 33817 33820 27893 0 -1 4194304 266457 0 0 0 108883 33 0 0 20 0 2 0 5418123 749248512 153546 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 0 0 0 17 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
/proc/33820/statm: 182922 153546 3302 3035 0 171197 0
[pid=33820/tid=33823] ppid=33817 vsize=731688 memory=18844 CPUtime=0 cores=0,2
/proc/33820/task/33823/stat : 33823 (fscip) S 33817 33820 27893 0 -1 1077936192 216 0 0 0 0 0 0 0 20 0 2 0 5418242 749248512 153546 134679101440 4194304 16623229 140735008456032 0 0 0 0 0 2 1 0 0 -1 2 0 0 0 0 0 18838560 18947056 55226368 140735008457750 140735008457866 140735008457866 140735008464880 0
Current children cumulated CPU time: 1089.16 s
Current children cumulated vsize: 731688 KiB
Current children cumulated memory: 614184 KiB

Child status: 0

Real time (s): 1093.28
CPU time (s): 1089.25
CPU user time (s): 1088.9
CPU system time (s): 0.345681
CPU usage (%): 99.6311
Max. virtual memory (cumulated for all children) (KiB): 731688
Max. memory (cumulated for all children) (KiB): 626680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1088.9
system time used= 0.345681
maximum resident set size= 626680
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 269052
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1123
involuntary context switches= 8052


# summary of solver processes directly reported to runsolver:
#   pid: 33820
#   total CPU time (s): 1089.25
#   total CPU user time (s): 1088.9
#   total CPU system time (s): 0.345681

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 2.03015 second user time and 5.11935 second system time

The end

Launcher Data

Begin job on nodeC020 at 2024-07-31 03:10:02
IDJOB=4464629
IDBENCH=165316
IDSOLVER=3092
FILE ID=nodeC020/4464629-1722388202
RUNJOBID= nodeC020-1722378594-27903
SLURM_JOB_ID= 8249843
Free space on /tmp= 889996 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP115.shuf-1.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464629-1722388202/watcher-4464629-1722388202 -o /tmp/evaluation-result-4464629-1722388202/solver-4464629-1722388202 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC020-1722378594-27903 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464629-1722388202.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= a3c218acab88c9e5abe907b008036492
RANDOM SEED=1390683433

nodeC020.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3668.073
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3685.337
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3660.116
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.537
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3664.760
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3685.408
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3602.939
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.336
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7007.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        120284460 kB
MemAvailable:   127944540 kB
Buffers:          109576 kB
Cached:          8365540 kB
SwapCached:            0 kB
Active:           272840 kB
Inactive:       10448036 kB
Active(anon):       1620 kB
Inactive(anon):  2265816 kB
Active(file):     271220 kB
Inactive(file):  8182220 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             29132 kB
Writeback:             0 kB
AnonPages:       2243788 kB
Mapped:           127604 kB
Shmem:             21336 kB
KReclaimable:      92572 kB
Slab:             174508 kB
SReclaimable:      92572 kB
SUnreclaim:        81936 kB
KernelStack:        4272 kB
PageTables:        13608 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1803420 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             9952 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1697792 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      193236 kB
DirectMap2M:    10065920 kB
DirectMap1G:    125829120 kB

Free space on /tmp at the end= 889968 MiB
End job on nodeC020 at 2024-07-31 03:28:16