Trace number 4452760

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
FiberSCIP 2024-07-02UNSAT 1091.66 1094.39

General information on the benchmark

NamePB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/
sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP115.shuf-1.opb
MD5SUMa3c218acab88c9e5abe907b008036492
Bench CategoryDEC-LIN (decision problem, linear constraints, no UNSAT certificate)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark8.83428
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables33930
Total number of constraints6787
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)12
Number of constraints which are nor clauses,nor cardinality constraints6775
Minimum length of a constraint5
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 9
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 29
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: cdb00f34-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.0] [GitHash: 32d2b99657]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.0         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: bdec2291]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.2.1         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.10/0.12	c Default LC presolving (default).
0.10/0.12	c ** Before presolving: virtualMemUsedAtLc = 129192024, getVmSize() = 115654656, SCIPgetMemUsed() = 86906542, SCIPgetMemTotal() = 92410102, SCIPgetMemExternEstim() = 36781922
0.10/0.12	c ** set memory limit for presolving in LC to 8.79605e+12 for SCIP **
0.99/1.10	c ** Estimated virtualMemUsedAtSolver = 213223114, getVmSize() = 464076800, SCIPgetMemUsed() = 166457198, SCIPgetMemTotal() = 283052750, SCIPgetMemExternEstim() = 36781922
0.99/1.10	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
0.99/1.10	c Original Problem   :
0.99/1.10	c   Problem name     : instance-4452760-1721446781
0.99/1.10	c   Variables        : 33930 (33930 binary, 0 integer, 0 implicit integer, 0 continuous)
0.99/1.10	c   Constraints      : 6787
0.99/1.10	c   Objective sense  : minimize
0.99/1.10	c Presolved Problem  :
0.99/1.10	c   Variables        : 33930 (33930 binary, 0 integer, 0 implicit integer, 0 continuous)
0.99/1.10	c   Constraints      : 7731
0.99/1.10	c Constraints        : Number
0.99/1.10	c   knapsack         : 6787 
0.99/1.10	c   setppc           : 944 
0.99/1.10	c ** Instance transfer method used: 0
1.09/1.15	c ** ParaScipInstance copy does not increase the number of variables. **
1.19/1.21	c LC is working with racing ramp-up and with rebuilding tree after racing.
1.19/1.21	c                                Nodes    Active                                            
1.19/1.21	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
209.45/210.07	c       210              2           1         1                -           0.0000          -
934.23/936.68	c       937              3           2         1                -           0.0000          -
1091.37/1094.16	c      1094              3           0         0                -           0.0000          -
1091.37/1094.16	c      1094              3           0         0                -           0.0000          -
1091.46/1094.29	c      1094              3           0         0                -           0.0000          -
1091.46/1094.29	c SCIP Status        : c problem is solved [infeasible]
1091.46/1094.29	c Total Time         : 1094.2800
1091.46/1094.29	c   solving          : 1094.2800
1091.46/1094.29	c   presolving       : 0.9722 (included in solving)
1091.46/1094.29	c B&B Tree           :
1091.46/1094.29	c   nodes (total)    : 3
1091.46/1094.29	c Solution           :
1091.46/1094.29	c   Solutions found  : 0
1091.46/1094.29	c   Primal Bound     :          -
1091.46/1094.29	c   Dual Bound       :          -
1091.46/1094.29	c Gap                :          -
1091.57/1094.38	s UNSATISFIABLE

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 63931 MiB (61057 MiB free)
  memory of node 1: 64510 MiB (61766 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452760-1721446781/watcher-4452760-1721446781 -o /tmp/evaluation-result-4452760-1721446781/solver-4452760-1721446781 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059845 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4452760-1721446781.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=1060068, runsolver pid=1060065
Current StackSize limit: 8192 KiB


[startup+0.100091 s]*
/proc/loadavg: 4.00 4.05 4.07 5/260 1060069
/proc/meminfo: memFree=125691768/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=103932 memory=92188 CPUtime=0.1 cores=4,6
/proc/1060068/stat : 1060068 (fscip) R 1060065 1060068 1059834 0 -1 4194304 20919 0 0 0 7 3 0 0 20 0 1 0 196845527 106426368 23047 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 25983 23047 2542 3032 0 22383 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 103932 KiB
Current children cumulated memory: 92188 KiB

[startup+0.205544 s]*
/proc/loadavg: 4.00 4.05 4.07 5/260 1060069
/proc/meminfo: memFree=125658000/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=141400 memory=125500 CPUtime=0.2 cores=4,6
/proc/1060068/stat : 1060068 (fscip) R 1060065 1060068 1059834 0 -1 4194304 30863 0 0 0 16 4 0 0 20 0 1 0 196845527 144793600 31375 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 35350 31375 2638 3032 0 31750 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 141400 KiB
Current children cumulated memory: 125500 KiB

[startup+0.305508 s]*
/proc/loadavg: 4.00 4.05 4.07 5/260 1060069
/proc/meminfo: memFree=125629972/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=171672 memory=155876 CPUtime=0.3 cores=4,6
/proc/1060068/stat : 1060068 (fscip) R 1060065 1060068 1059834 0 -1 4194304 43708 0 0 0 24 6 0 0 20 0 1 0 196845527 175792128 38969 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 42918 38969 2686 3032 0 39318 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 171672 KiB
Current children cumulated memory: 155876 KiB

[startup+0.700228 s]
/proc/loadavg: 4.00 4.05 4.07 5/260 1060069
/proc/meminfo: memFree=125620396/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=178936 memory=161780 CPUtime=0.69 cores=4,6
/proc/1060068/stat : 1060068 (fscip) R 1060065 1060068 1059834 0 -1 4194304 45175 0 0 0 63 6 0 0 20 0 1 0 196845527 183230464 40445 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 44734 40445 2734 3032 0 41134 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 178936 KiB
Current children cumulated memory: 161780 KiB

[startup+1.50042 s]
/proc/loadavg: 4.00 4.05 4.07 5/260 1060069
/proc/meminfo: memFree=125394736/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=666200 memory=541016 CPUtime=1.49 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 142840 0 0 0 129 20 0 0 20 0 3 0 196845527 682188800 135254 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 166550 135254 2782 3032 0 153654 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 666200 KiB
Current children cumulated memory: 541016 KiB

[startup+3.10535 s]
/proc/loadavg: 4.00 4.05 4.07 5/262 1060071
/proc/meminfo: memFree=125176476/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=604796 CPUtime=3.08 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 159602 0 0 0 286 22 0 0 20 0 3 0 196845527 749297664 151199 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151199 2894 3032 0 170379 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=198340509722 CPUtime=1.93 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 58973 0 0 0 185 8 0 0 20 0 3 0 196845637 749297664 151199 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=0 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 3 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151199 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 604796 KiB

[startup+6.3002 s]
/proc/loadavg: 4.00 4.05 4.07 5/262 1060071
/proc/meminfo: memFree=125176224/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=605024 CPUtime=6.27 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 163430 0 0 0 605 22 0 0 20 0 3 0 196845527 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151256 2894 3032 0 170415 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=0 CPUtime=5.11 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 62794 0 0 0 503 8 0 0 20 0 3 0 196845637 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=0 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 10 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 605024 KiB

[startup+12.7002 s]
/proc/loadavg: 4.00 4.05 4.07 5/262 1060073
/proc/meminfo: memFree=125175448/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=605024 CPUtime=12.65 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 170703 0 0 0 1243 22 0 0 20 0 3 0 196845527 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151256 2894 3032 0 170415 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=0 CPUtime=11.49 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 70057 0 0 0 1141 8 0 0 20 0 3 0 196845637 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=605024 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 20 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151256 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 12.65 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 605024 KiB

[startup+25.5002 s]
/proc/loadavg: 4.07 4.06 4.08 5/264 1060078
/proc/meminfo: memFree=125174060/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=606304 CPUtime=25.42 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 179233 0 0 0 2519 23 0 0 20 0 3 0 196845527 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151576 3214 3032 0 170415 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=11588 CPUtime=24.27 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 78573 0 0 0 2418 9 0 0 20 0 3 0 196845637 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=11588 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 34 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 606304 KiB

[startup+51.1054 s]
/proc/loadavg: 4.10 4.07 4.08 5/264 1060083
/proc/meminfo: memFree=125171676/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=606304 CPUtime=50.96 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 187070 0 0 0 5073 23 0 0 20 0 3 0 196845527 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151576 3214 3032 0 170415 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=11588 CPUtime=49.8 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 86396 0 0 0 4971 9 0 0 20 0 3 0 196845637 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=606304 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 48 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151576 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 50.96 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 606304 KiB

[startup+102.3 s]
/proc/loadavg: 4.09 4.07 4.08 5/263 1060093
/proc/meminfo: memFree=125159512/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=607636 CPUtime=102.02 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 196261 0 0 0 10178 24 0 0 20 0 3 0 196845527 749297664 151909 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 151909 3214 3032 0 170764 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=607636 CPUtime=100.87 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 95573 0 0 0 10077 10 0 0 20 0 3 0 196845637 749297664 151909 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=607636 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 62 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 151909 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 102.02 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 607636 KiB

[startup+162.3 s]
/proc/loadavg: 4.14 4.09 4.09 5/263 1060103
/proc/meminfo: memFree=125157724/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=608092 CPUtime=161.86 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 205470 0 0 0 16162 24 0 0 20 0 3 0 196845527 749297664 152023 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 152023 3214 3032 0 170862 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=-7520302109232031360 CPUtime=160.7 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 104768 0 0 0 16060 10 0 0 20 0 3 0 196845637 749297664 152023 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=608092 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 76 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 152023 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 161.86 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 608092 KiB

[startup+222.3 s]
/proc/loadavg: 4.05 4.07 4.08 5/263 1060114
/proc/meminfo: memFree=125155052/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=608352 CPUtime=221.71 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 219521 0 0 0 22146 25 0 0 20 0 3 0 196845527 749297664 152088 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 152088 3214 3032 0 170862 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=608092 CPUtime=220.55 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 118785 0 0 0 22044 11 0 0 20 0 3 0 196845637 749297664 152088 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=47212 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 83 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 152088 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 221.71 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 608352 KiB

[startup+282.3 s]
/proc/loadavg: 4.14 4.09 4.09 5/262 1060125
/proc/meminfo: memFree=125154420/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=608352 CPUtime=281.56 cores=4,6

################
# More data... #
################

[pid=1060068] ppid=1060065 vsize=731736 memory=621832 CPUtime=939.92 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272486 0 0 0 93963 29 0 0 20 0 3 0 196845527 749297664 155458 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 155458 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=11588 CPUtime=938.75 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171655 0 0 0 93861 14 0 0 20 0 3 0 196845637 749297664 155458 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=621832 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 167 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 155458 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 939.92 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 621832 KiB

[startup+1002.3 s]
/proc/loadavg: 4.17 4.16 4.11 5/262 1060640
/proc/meminfo: memFree=125104028/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=625944 CPUtime=999.78 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272620 0 0 0 99949 29 0 0 20 0 3 0 196845527 749297664 156486 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 156486 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=624292 CPUtime=998.61 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171782 0 0 0 99847 14 0 0 20 0 3 0 196845637 749297664 156486 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=624292 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 174 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 156486 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 999.78 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 625944 KiB

[startup+1062.3 s]
/proc/loadavg: 4.10 4.14 4.11 5/262 1060651
/proc/meminfo: memFree=125100764/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1059.64 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272803 0 0 0 105935 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=628876 CPUtime=1058.47 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171958 0 0 0 105833 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=11588 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 181 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1059.64 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1094.39 s]
# the end of solver process 1060068 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=1091.36 s, system=0.300116 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1075.2 s]
/proc/loadavg: 4.08 4.13 4.11 5/262 1060652
/proc/meminfo: memFree=125100708/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1072.51 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272807 0 0 0 107222 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=47212 CPUtime=1071.34 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171962 0 0 0 107120 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=628876 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 181 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1072.51 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1088 s]*
/proc/loadavg: 4.06 4.13 4.10 5/262 1060655
/proc/meminfo: memFree=125100600/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1085.28 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272820 0 0 0 108499 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=-7385755803455624556 CPUtime=1084.11 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171971 0 0 0 108397 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=-9187040403442925504 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1085.28 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1091.2 s]
/proc/loadavg: 4.06 4.12 4.10 5/264 1060826
/proc/meminfo: memFree=125099984/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1088.47 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272820 0 0 0 108818 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=628876 CPUtime=1087.3 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171971 0 0 0 108716 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=11588 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1088.47 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1092.8 s]
/proc/loadavg: 4.06 4.12 4.10 5/264 1060826
/proc/meminfo: memFree=125099984/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1090.07 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272820 0 0 0 108978 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=-7385755803455624556 CPUtime=1088.9 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171971 0 0 0 108876 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=628876 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1090.07 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1093.6 s]
/proc/loadavg: 4.06 4.12 4.10 5/264 1060826
/proc/meminfo: memFree=125100012/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1090.87 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272820 0 0 0 109058 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=12508 CPUtime=1089.7 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171971 0 0 0 108956 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=5536 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1090.87 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1094 s]*
/proc/loadavg: 4.13 4.14 4.11 5/264 1060826
/proc/meminfo: memFree=125100012/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628876 CPUtime=1091.27 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 272820 0 0 0 109098 29 0 0 20 0 3 0 196845527 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157219 3214 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=-7385755803455624556 CPUtime=1090.1 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 171971 0 0 0 108996 14 0 0 20 0 3 0 196845637 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=-9187040394869637056 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157219 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1091.27 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628876 KiB

[startup+1094.2 s]
/proc/loadavg: 4.13 4.14 4.11 5/264 1060826
/proc/meminfo: memFree=125100012/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=628940 CPUtime=1091.46 cores=4,6
/proc/1060068/stat : 1060068 (fscip) S 1060065 1060068 1059834 0 -1 1077936128 273653 0 0 0 109117 29 0 0 20 0 3 0 196845527 749297664 157235 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 157235 3230 3032 0 171019 0
[pid=1060068/tid=1060070] ppid=1060065 vsize=731736 memory=14761 CPUtime=1090.29 cores=4,6
/proc/1060068/task/1060070/stat : 1060070 (fscip) R 1060065 1060068 1059834 0 -1 4194368 172790 0 0 0 109015 14 0 0 20 0 3 0 196845637 749297664 157235 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=4457 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 3 0 196845649 749297664 157235 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1091.46 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 628940 KiB

[startup+1094.3 s]
/proc/loadavg: 4.13 4.14 4.11 5/264 1060826
/proc/meminfo: memFree=125100012/131524600 swapFree=131071996/131071996
[pid=1060068] ppid=1060065 vsize=731736 memory=620096 CPUtime=1091.57 cores=4,6
/proc/1060068/stat : 1060068 (fscip) R 1060065 1060068 1059834 0 -1 4194304 275787 0 0 0 109128 29 0 0 20 0 2 0 196845527 749297664 155024 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
/proc/1060068/statm: 182934 155024 3278 3032 0 171019 0
[pid=1060068/tid=1060071] ppid=1060065 vsize=731736 memory=11588 CPUtime=0 cores=4,6
/proc/1060068/task/1060071/stat : 1060071 (fscip) S 1060065 1060068 1059834 0 -1 1077936192 185 0 0 0 0 0 0 0 20 0 2 0 196845649 749297664 155024 134679101440 4194304 16613245 140723286168864 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18822208 18930672 33058816 140723286172691 140723286172807 140723286172807 140723286179824 0
Current children cumulated CPU time: 1091.57 s
Current children cumulated vsize: 731736 KiB
Current children cumulated memory: 620096 KiB

Child status: 0

Real time (s): 1094.39
CPU time (s): 1091.66
CPU user time (s): 1091.36
CPU system time (s): 0.300116
CPU usage (%): 99.7506
Max. virtual memory (cumulated for all children) (KiB): 731736
Max. memory (cumulated for all children) (KiB): 628940

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1091.36
system time used= 0.300116
maximum resident set size= 628940
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 277875
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1128
involuntary context switches= 382


# summary of solver processes directly reported to runsolver:
#   pid: 1060068
#   total CPU time (s): 1091.66
#   total CPU user time (s): 1091.36
#   total CPU system time (s): 0.300116

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.99456 second user time and 5.01622 second system time

The end

Launcher Data 

Begin job on nodeC029 at 2024-07-20 05:39:54
IDJOB=4452760
IDBENCH=165316
IDSOLVER=3064
FILE ID=nodeC029/4452760-1721446781
RUNJOBID= nodeC029-1721446720-1059845
SLURM_JOB_ID= 7545672
Free space on /tmp= 889984 MiB

SOLVER NAME= FiberSCIP 2024-07-02
BENCH NAME= PB24/normalized-PB24/DEC-LIN/nordstrom/CombinatorialBenchmarksPBsolvers/sumineq/sumineq_pyr_5_shuffle/normalized-sumineqArity5pyramidP115.shuf-1.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4452760-1721446781/watcher-4452760-1721446781 -o /tmp/evaluation-result-4452760-1721446781/solver-4452760-1721446781 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC029-1721446720-1059845 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4452760-1721446781.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= a3c218acab88c9e5abe907b008036492
RANDOM SEED=2073625948

nodeC029.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3656.727
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3685.383
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.825
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.303
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3654.205
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3685.391
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3657.323
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7000.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00002a
cpu MHz		: 3600.262
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 7006.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131524600 kB
MemFree:        125772688 kB
MemAvailable:   128722332 kB
Buffers:          535100 kB
Cached:          3228872 kB
SwapCached:            0 kB
Active:          1048468 kB
Inactive:        4017492 kB
Active(anon):       1472 kB
Inactive(anon):  1346096 kB
Active(file):    1046996 kB
Inactive(file):  2671396 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             28976 kB
Writeback:             0 kB
AnonPages:       1301676 kB
Mapped:           143292 kB
Shmem:             45912 kB
KReclaimable:     141796 kB
Slab:             260224 kB
SReclaimable:     141796 kB
SUnreclaim:       118428 kB
KernelStack:        4208 kB
PageTables:        11876 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196834296 kB
Committed_AS:    1453884 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:            71840 kB
HardwareCorrupted:     0 kB
AnonHugePages:    260096 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      281300 kB
DirectMap2M:    36192256 kB
DirectMap1G:    99614720 kB

Free space on /tmp at the end= 889956 MiB
End job on nodeC029 at 2024-07-20 05:58:09