Trace number 4464259

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
FiberSCIP 2024-07-30? 3589.26 3598.37

General information on the benchmark

NamePB24/normalized-PB15eval/OPT-LIN/
EmployeeScheduling/normalized-aug4.5.opb
MD5SUM481101aa5750e702617a44583ed063de
Bench CategoryOPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark204
Best CPU time to get the best result obtained on this benchmark3558.01
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9632
Total number of constraints29620
Number of constraints which are clauses27552
Number of constraints which are cardinality constraints (but not clauses)248
Number of constraints which are nor clauses,nor cardinality constraints1820
Minimum length of a constraint2
Maximum length of a constraint248
Number of terms in the objective function 26
Biggest coefficient in the objective function 20
Number of bits for the biggest coefficient in the objective function 5
Sum of the numbers in the objective function 211
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 160
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 687
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c The following solver is parallelized by UG version 1.0.0 [GitHash: e6e2b6ff-dirty]
0.00/0.00	c SCIP version 10.0.0 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: Soplex 7.1.1] [GitHash: 020d91813d]
0.00/0.00	c Copyright (c) 2002-2024 Zuse Institute Berlin (ZIB)
0.00/0.00	c External libraries: 
0.00/0.00	c   Soplex 7.1.1         Linear Programming Solver developed at Zuse Institute Berlin (soplex.zib.de) [GitHash: b4905e82]
0.00/0.00	c   CppAD 20180000.0     Algorithmic Differentiation of C++ algorithms developed by B. Bell (github.com/coin-or/CppAD)
0.00/0.00	c   AMPL/MP 690e9e7      AMPL .nl file reader library (github.com/ampl/mp)
0.00/0.00	c   PaPILO 2.4.0         parallel presolve for integer and linear optimization (github.com/scipopt/papilo)
0.00/0.00	c   Nauty 2.8.8          Computing Graph Automorphism Groups by Brendan D. McKay (users.cecs.anu.edu.au/~bdm/nauty)
0.00/0.00	c   sassy 1.1            Symmetry preprocessor by Markus Anders (github.com/markusa4/sassy)
0.10/0.15	c Default LC presolving (default).
0.10/0.15	c ** Before presolving: virtualMemUsedAtLc = 102684826, getVmSize() = 88698880, SCIPgetMemUsed() = 55741004, SCIPgetMemTotal() = 64786228, SCIPgetMemExternEstim() = 37898598
0.10/0.15	c ** set memory limit for presolving in LC to 8.79606e+12 for SCIP **
2.58/2.67	c ** Estimated virtualMemUsedAtSolver = 150425712, getVmSize() = 216252416, SCIPgetMemUsed() = 137843603, SCIPgetMemTotal() = 187739971, SCIPgetMemExternEstim() = 37898598
2.58/2.67	c ** set memory limit for solvers to 4.39804e+12 for each SCIP **
2.58/2.67	c Original Problem   :
2.58/2.67	c   Problem name     : instance-4464259-1722385795
2.58/2.67	c   Variables        : 9632 (9632 binary, 0 integer, 0 implicit integer, 0 continuous)
2.58/2.67	c   Constraints      : 29620
2.58/2.67	c   Objective sense  : minimize
2.58/2.67	c Presolved Problem  :
2.58/2.67	c   Variables        : 9561 (9561 binary, 0 integer, 0 implicit integer, 0 continuous)
2.58/2.67	c   Constraints      : 27419
2.58/2.67	c Constraints        : Number
2.58/2.67	c   knapsack         : 1144 
2.58/2.67	c   setppc           : 16027 
2.58/2.67	c   linear           : 28 
2.58/2.67	c   logicor          : 10220 
2.58/2.67	c ** Instance transfer method used: 0
2.68/2.72	c ** ParaScipInstance copy does not increase the number of variables. **
2.78/2.82	c LC is working with racing ramp-up and with rebuilding tree after racing.
2.78/2.82	c                                Nodes    Active                                            
2.78/2.82	c      Time          Nodes        Left   Solvers     Best Integer        Best Node        Gap     Best Node(S)     Gap(S)
1125.05/1127.89	c      1128              2           1         1                -         111.0000          -
1130.63/1133.45	c      1133             11          10         1                -         111.0000          -
1135.72/1138.50	c      1138             14          13         1                -         111.0000          -
1144.20/1147.04	c      1147             16          15         1                -         111.0000          -
1169.03/1171.95	c      1172             18          17         1                -         111.0000          -
1175.41/1178.39	c      1178             21          20         1                -         111.0000          -
1183.20/1186.15	c      1186             29          22         1                -         111.0000          -
1197.56/1200.55	c      1201             31          24         1                -         111.0000          -
1227.78/1230.81	c      1231             33          26         1                -         111.0000          -
1249.94/1253.08	c      1253             35          28         1                -         111.0000          -
3194.95/3203.19	c      3203             38          29         1                -         111.0000          -
3221.06/3229.37	c      3229             40          31         1                -         111.0000          -
3231.85/3240.17	c      3240             42          33         1                -         111.0000          -
3257.07/3265.47	c      3265             44          35         1                -         111.0000          -
3262.56/3270.99	c      3271             46          37         1                -         111.0000          -
3300.68/3309.14	c      3309             48          39         1                -         111.0000          -
3319.64/3328.17	c      3328             50          41         1                -         111.0000          -
3328.80/3337.35	c      3337             52          43         1                -         111.0000          -
3334.19/3342.76	c      3343             57          46         1                -         111.0000          -
3354.24/3362.88	c      3363             58          47         1                -         111.0000          -
3360.22/3368.83	c      3369             61          50         1                -         111.0000          -
3384.87/3393.50	c      3394             62          51         1                -         111.0000          -
3411.80/3420.57	c      3421             65          54         1                -         111.0000          -
3426.56/3435.34	c      3435             68          57         1                -         111.0000          -
3433.54/3442.32	c      3442             71          60         1                -         111.0000          -
3449.41/3458.20	c      3458             73          62         1                -         111.0000          -
3456.39/3465.28	c      3465             74          65         1                -         111.0000          -
3588.99/3598.16	c      3598             74          65         0                -         111.0000          -
3589.08/3598.27	c SCIP Status        : c solving was interrupted [hard time limit reached]
3589.08/3598.27	c Total Time         : 3598.2600
3589.08/3598.27	c   solving          : 3598.2600
3589.08/3598.27	c   presolving       : 2.5215 (included in solving)
3589.08/3598.27	c B&B Tree           :
3589.08/3598.27	c   nodes (total)    : 1
3589.08/3598.27	c Solution           :
3589.08/3598.27	c   Solutions found  : 0
3589.08/3598.27	c   Primal Bound     :          -
3589.08/3598.27	c   Dual Bound       : +1.11000000000000e+02
3589.08/3598.27	c Gap                :          -
3589.18/3598.36	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.4.2 (svn: 4680) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 64096 MiB (62148 MiB free)
  memory of node 1: 64473 MiB (61207 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464259-1722385795/watcher-4464259-1722385795 -o /tmp/evaluation-result-4464259-1722385795/solver-4464259-1722385795 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC004-1722378594-28232 --watchdog 3760 ./fscip settings/racing.prm HOME/instance-4464259-1722385795.opb -qsol -t 3600 -sth 1 

running on 2 cores: 4,6

CPU governors:
  performance: 4 6

Enforcing FSIZE limit: 104857600 KiB
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3700 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 4.18.0-301.1.el8.x86_64
Linux 4.18.0-301.1.el8.x86_64
Starting watchdog thread
solver pid=32517, runsolver pid=32514
Current StackSize limit: 8192 KiB


[startup+0.100102 s]*
/proc/loadavg: 4.11 4.11 4.13 4/242 32518
/proc/meminfo: memFree=126334732/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=64936 memory=54480 CPUtime=0.1 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 11427 0 0 0 8 2 0 0 20 0 1 0 4950623 66494464 13620 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 16234 13620 2555 3035 0 12630 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 64936 KiB
Current children cumulated memory: 54480 KiB

[startup+0.212902 s]*
/proc/loadavg: 4.11 4.11 4.13 7/243 32532
/proc/meminfo: memFree=126305280/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=95900 memory=79772 CPUtime=0.21 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 17737 0 0 0 18 3 0 0 20 0 1 0 4950623 98201600 19943 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 23975 19943 2630 3035 0 20371 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 95900 KiB
Current children cumulated memory: 79772 KiB

[startup+0.312971 s]*
/proc/loadavg: 4.11 4.11 4.13 6/242 32532
/proc/meminfo: memFree=126281620/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=107872 memory=96084 CPUtime=0.31 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 25985 0 0 0 26 5 0 0 20 0 1 0 4950623 110460928 24021 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 26968 24021 2726 3035 0 23364 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 107872 KiB
Current children cumulated memory: 96084 KiB

[startup+0.700331 s]
/proc/loadavg: 4.11 4.11 4.13 5/242 32532
/proc/meminfo: memFree=126236068/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=120220 memory=108020 CPUtime=0.68 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 29720 0 0 0 63 5 0 0 20 0 1 0 4950623 123105280 27005 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 30055 27005 2774 3035 0 26451 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 120220 KiB
Current children cumulated memory: 108020 KiB

[startup+1.50028 s]
/proc/loadavg: 4.11 4.11 4.13 5/239 32554
/proc/meminfo: memFree=126241812/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=122184 memory=109868 CPUtime=1.48 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 30207 0 0 0 143 5 0 0 20 0 1 0 4950623 125116416 27467 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 30546 27467 2774 3035 0 26942 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 122184 KiB
Current children cumulated memory: 109868 KiB

[startup+3.11359 s]
/proc/loadavg: 4.11 4.11 4.13 5/246 32614
/proc/meminfo: memFree=125777084/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=361408 memory=248764 CPUtime=3.08 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 69486 0 0 0 294 14 0 0 20 0 3 0 4950623 370081792 62191 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 90352 62191 2806 3035 0 72841 0
[pid=32517/tid=32613] ppid=32514 vsize=361408 memory=138832 CPUtime=0.36 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 17619 0 0 0 31 5 0 0 20 0 3 0 4950891 370081792 62191 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=361408 memory=0 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 0 0 0 0 0 0 0 0 20 0 3 0 4950906 370081792 62191 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 361408 KiB
Current children cumulated memory: 248764 KiB

[startup+6.30039 s]
/proc/loadavg: 4.10 4.11 4.13 5/246 32614
/proc/meminfo: memFree=125374264/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=361408 memory=273916 CPUtime=6.23 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 91500 0 0 0 605 18 0 0 20 0 3 0 4950623 370081792 68479 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 90352 68479 2806 3035 0 78976 0
[pid=32517/tid=32613] ppid=32514 vsize=361408 memory=-5155631310201056133 CPUtime=3.52 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 39629 0 0 0 343 9 0 0 20 0 3 0 4950891 370081792 68479 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=361408 memory=0 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 7 0 0 0 0 0 0 0 20 0 3 0 4950906 370081792 68479 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 6.23 s
Current children cumulated vsize: 361408 KiB
Current children cumulated memory: 273916 KiB

[startup+12.7004 s]
/proc/loadavg: 4.10 4.10 4.13 5/248 32617
/proc/meminfo: memFree=124958584/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=426944 memory=323372 CPUtime=12.62 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 119815 0 0 0 1241 21 0 0 20 0 3 0 4950623 437190656 80843 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 106736 80843 2950 3035 0 91468 0
[pid=32517/tid=32613] ppid=32514 vsize=426944 memory=5548 CPUtime=9.91 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 67929 0 0 0 979 12 0 0 20 0 3 0 4950891 437190656 80843 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=426944 memory=-5155631310201056133 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 20 0 0 0 0 0 0 0 20 0 3 0 4950906 437190656 80843 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 12.62 s
Current children cumulated vsize: 426944 KiB
Current children cumulated memory: 323372 KiB

[startup+25.5004 s]
/proc/loadavg: 4.07 4.10 4.12 5/248 32619
/proc/meminfo: memFree=124955568/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=426944 memory=323620 CPUtime=25.38 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 128896 0 0 0 2517 21 0 0 20 0 3 0 4950623 437190656 80905 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 106736 80905 2950 3035 0 91500 0
[pid=32517/tid=32613] ppid=32514 vsize=426944 memory=323568 CPUtime=22.68 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 76990 0 0 0 2255 13 0 0 20 0 3 0 4950891 437190656 80905 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=426944 memory=4588 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 39 0 0 0 0 0 0 0 20 0 3 0 4950906 437190656 80905 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 25.38 s
Current children cumulated vsize: 426944 KiB
Current children cumulated memory: 323620 KiB

[startup+51.1127 s]
/proc/loadavg: 4.10 4.10 4.12 5/250 32680
/proc/meminfo: memFree=124435744/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=426944 memory=325160 CPUtime=50.94 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 150884 0 0 0 5071 23 0 0 20 0 3 0 4950623 437190656 81290 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 106736 81290 2950 3035 0 91842 0
[pid=32517/tid=32613] ppid=32514 vsize=426944 memory=11392 CPUtime=48.22 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 98962 0 0 0 4808 14 0 0 20 0 3 0 4950891 437190656 81290 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=426944 memory=-5155631310201056133 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 55 0 0 0 0 0 0 0 20 0 3 0 4950906 437190656 81290 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 50.94 s
Current children cumulated vsize: 426944 KiB
Current children cumulated memory: 325160 KiB

[startup+102.3 s]
/proc/loadavg: 4.04 4.09 4.11 5/250 32690
/proc/meminfo: memFree=124430064/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=443676 memory=354672 CPUtime=102 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 207098 0 0 0 10172 28 0 0 20 0 3 0 4950623 454324224 88668 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 110919 88668 2966 3035 0 101260 0
[pid=32517/tid=32613] ppid=32514 vsize=443676 memory=354656 CPUtime=99.29 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 155161 0 0 0 9910 19 0 0 20 0 3 0 4950891 454324224 88668 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=443676 memory=354656 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 70 0 0 0 0 0 0 0 20 0 3 0 4950906 454324224 88668 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 102 s
Current children cumulated vsize: 443676 KiB
Current children cumulated memory: 354672 KiB

[startup+162.3 s]
/proc/loadavg: 4.12 4.10 4.11 5/250 32701
/proc/meminfo: memFree=124409076/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=509212 memory=371952 CPUtime=161.85 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 246413 0 0 0 16155 30 0 0 20 0 3 0 4950623 521433088 92988 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 127303 92988 2966 3035 0 110261 0
[pid=32517/tid=32613] ppid=32514 vsize=509212 memory=11392 CPUtime=159.13 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 194463 0 0 0 15892 21 0 0 20 0 3 0 4950891 521433088 92988 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=509212 memory=371952 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 83 0 0 0 0 0 0 0 20 0 3 0 4950906 521433088 92988 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 161.85 s
Current children cumulated vsize: 509212 KiB
Current children cumulated memory: 371952 KiB

[startup+222.3 s]
/proc/loadavg: 4.16 4.11 4.11 5/250 32712
/proc/meminfo: memFree=124408232/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=509212 memory=372752 CPUtime=221.7 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 277337 0 0 0 22137 33 0 0 20 0 3 0 4950623 521433088 93188 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 127303 93188 2966 3035 0 116773 0
[pid=32517/tid=32613] ppid=32514 vsize=509212 memory=372080 CPUtime=218.99 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 225381 0 0 0 21875 24 0 0 20 0 3 0 4950891 521433088 93188 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=509212 memory=372752 CPUtime=0 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 89 0 0 0 0 0 0 0 20 0 3 0 4950906 521433088 93188 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 221.7 s
Current children cumulated vsize: 509212 KiB
Current children cumulated memory: 372752 KiB

[startup+282.3 s]
/proc/loadavg: 4.10 4.10 4.11 5/252 32724
/proc/meminfo: memFree=123077364/131655788 swapFree=131071996/131071996

################
# More data... #
################

[pid=32517] ppid=32514 vsize=574748 memory=534992 CPUtime=3453.49 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 699455 0 0 0 345284 65 0 0 20 0 3 0 4950623 588541952 133748 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 143687 133748 3030 3035 0 139708 0
[pid=32517/tid=32613] ppid=32514 vsize=574748 memory=2744 CPUtime=3450.71 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 646924 0 0 0 345020 51 0 0 20 0 3 0 4950891 588541952 133748 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=574748 memory=534992 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 441 0 0 0 1 4 0 0 20 0 3 0 4950906 588541952 133748 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3453.49 s
Current children cumulated vsize: 574748 KiB
Current children cumulated memory: 534992 KiB

[startup+3522.3 s]
/proc/loadavg: 4.13 4.11 4.16 5/253 34353
/proc/meminfo: memFree=122310948/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3513.36 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 702985 0 0 0 351270 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=540556 CPUtime=3510.57 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 650445 0 0 0 351005 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=11392 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 450 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3513.36 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3582.3 s]
/proc/loadavg: 4.05 4.09 4.15 5/253 34533
/proc/meminfo: memFree=122307856/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3573.22 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704201 0 0 0 357256 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=540556 CPUtime=3570.43 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651652 0 0 0 356991 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=540556 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3573.22 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3598.37 s]
# the end of solver process 32517 was just reported to runsolver
# Child status: 0

# cumulated CPU time of all completed processes:  user=3588.58 s, system=0.684921 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+3584 s]*
/proc/loadavg: 4.05 4.09 4.15 5/253 34533
/proc/meminfo: memFree=122307816/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3574.92 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704201 0 0 0 357426 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=7686721470247706567 CPUtime=3572.14 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651652 0 0 0 357162 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=7511280255749425774 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3574.92 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3590.4 s]
/proc/loadavg: 4.04 4.09 4.15 5/253 34533
/proc/meminfo: memFree=122307844/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3581.3 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704211 0 0 0 358064 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=540556 CPUtime=3578.51 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651662 0 0 0 357799 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=540556 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3581.3 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3593.6 s]
/proc/loadavg: 4.04 4.09 4.15 5/253 34534
/proc/meminfo: memFree=122307536/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3584.49 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704216 0 0 0 358383 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=540556 CPUtime=3581.71 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651667 0 0 0 358119 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=6796 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3584.49 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3596.8 s]
/proc/loadavg: 4.12 4.10 4.15 5/253 34534
/proc/meminfo: memFree=122307560/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3587.68 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704218 0 0 0 358702 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=11392 CPUtime=3584.9 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651669 0 0 0 358438 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=12880 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3587.68 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3597.6 s]
/proc/loadavg: 4.12 4.10 4.15 4/246 34542
/proc/meminfo: memFree=122621852/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3588.48 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704218 0 0 0 358782 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=-7307771561947259519 CPUtime=3585.7 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651669 0 0 0 358518 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=5548 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3588.48 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3598 s]*
/proc/loadavg: 4.12 4.10 4.15 4/244 34565
/proc/meminfo: memFree=122650204/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=640284 memory=540556 CPUtime=3588.89 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 704218 0 0 0 358823 66 0 0 20 0 3 0 4950623 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 160071 135139 3030 3035 0 141288 0
[pid=32517/tid=32613] ppid=32514 vsize=640284 memory=7686721470247706567 CPUtime=3586.11 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 651669 0 0 0 358559 52 0 0 20 0 3 0 4950891 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=640284 memory=-4421386496231237476 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 655650816 135139 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3588.89 s
Current children cumulated vsize: 640284 KiB
Current children cumulated memory: 540556 KiB

[startup+3598.2 s]
/proc/loadavg: 4.12 4.10 4.15 4/244 34565
/proc/meminfo: memFree=122650204/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=623552 memory=523824 CPUtime=3589.08 cores=4,6
/proc/32517/stat : 32517 (fscip) S 32514 32517 28221 0 -1 1077936128 705038 0 0 0 358842 66 0 0 20 0 3 0 4950623 638517248 130956 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 155888 130956 3030 3035 0 137105 0
[pid=32517/tid=32613] ppid=32514 vsize=623552 memory=540556 CPUtime=3586.3 cores=4,6
/proc/32517/task/32613/stat : 32613 (fscip) R 32514 32517 28221 0 -1 4194368 652479 0 0 0 358578 52 0 0 20 0 3 0 4950891 638517248 130956 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 -1 4 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
[pid=32517/tid=32614] ppid=32514 vsize=623552 memory=2744 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 3 0 4950906 638517248 130956 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3589.08 s
Current children cumulated vsize: 623552 KiB
Current children cumulated memory: 523824 KiB

[startup+3598.3 s]
/proc/loadavg: 4.12 4.10 4.15 4/244 34565
/proc/meminfo: memFree=122650204/131655788 swapFree=131071996/131071996
[pid=32517] ppid=32514 vsize=622652 memory=521960 CPUtime=3589.18 cores=4,6
/proc/32517/stat : 32517 (fscip) R 32514 32517 28221 0 -1 4194304 706145 0 0 0 358852 66 0 0 20 0 2 0 4950623 637595648 130490 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 0 0 0 17 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
/proc/32517/statm: 155663 130490 3030 3035 0 136880 0
[pid=32517/tid=32614] ppid=32514 vsize=622652 memory=540556 CPUtime=0.05 cores=4,6
/proc/32517/task/32614/stat : 32614 (fscip) S 32514 32517 28221 0 -1 1077936192 459 0 0 0 1 4 0 0 20 0 2 0 4950906 637595648 130490 134679101440 4194304 16623229 140722683769856 0 0 0 0 0 2 1 0 0 -1 6 0 0 0 0 0 18838560 18947056 56594432 140722683778070 140722683778186 140722683778186 140722683785200 0
Current children cumulated CPU time: 3589.18 s
Current children cumulated vsize: 622652 KiB
Current children cumulated memory: 521960 KiB

Child status: 0

Real time (s): 3598.37
CPU time (s): 3589.26
CPU user time (s): 3588.58
CPU system time (s): 0.684921
CPU usage (%): 99.7469
Max. virtual memory (cumulated for all children) (KiB): 640284
Max. memory (cumulated for all children) (KiB): 540556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3588.58
system time used= 0.684921
maximum resident set size= 540556
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 708781
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3739
involuntary context switches= 1754


# summary of solver processes directly reported to runsolver:
#   pid: 32517
#   total CPU time (s): 3589.26
#   total CPU user time (s): 3588.58
#   total CPU system time (s): 0.684921

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 18.441 second user time and 34.3333 second system time

The end

Launcher Data 

Begin job on nodeC004 at 2024-07-31 02:29:55
IDJOB=4464259
IDBENCH=158396
IDSOLVER=3092
FILE ID=nodeC004/4464259-1722385795
RUNJOBID= nodeC004-1722378594-28232
SLURM_JOB_ID= 8249834
Free space on /tmp= 723680 MiB

SOLVER NAME= FiberSCIP 2024-07-30
BENCH NAME= PB24/normalized-PB15eval/OPT-LIN/EmployeeScheduling/normalized-aug4.5.opb
COMMAND LINE= ./fscip settings/racing.prm BENCHNAME -qsol -t TIMEOUT -sth 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp --file-size-limit 102400 -w /tmp/evaluation-result-4464259-1722385795/watcher-4464259-1722385795 -o /tmp/evaluation-result-4464259-1722385795/solver-4464259-1722385795 -C 3600 -W 3700 -M 31000 --bin-var /tmp/runsolver-exch-nodeC004-1722378594-28232 --watchdog 3760  ./fscip settings/racing.prm HOME/instance-4464259-1722385795.opb -qsol -t 3600 -sth 1

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 2

MD5SUM BENCH= 481101aa5750e702617a44583ed063de
RANDOM SEED=292526229

nodeC004.alineos.net Linux 4.18.0-301.1.el8.x86_64 #1 SMP Tue Apr 13 16:24:22 UTC 2021

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3669.163
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3654.267
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.412
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.315
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 3491.947
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 2993.081
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.233
cache size	: 15360 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 79
model name	: Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz
stepping	: 1
microcode	: 0xb00001f
cpu MHz		: 1197.452
cache size	: 15360 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 20
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa itlb_multihit
bogomips	: 6983.39
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       131655788 kB
MemFree:        126317032 kB
MemAvailable:   127330940 kB
Buffers:           99424 kB
Cached:          1748892 kB
SwapCached:            0 kB
Active:           277612 kB
Inactive:        4622692 kB
Active(anon):       1432 kB
Inactive(anon):  3071916 kB
Active(file):     276180 kB
Inactive(file):  1550776 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      131071996 kB
SwapFree:       131071996 kB
Dirty:             58184 kB
Writeback:             0 kB
AnonPages:       3050064 kB
Mapped:           121040 kB
Shmem:             21320 kB
KReclaimable:      54300 kB
Slab:             130756 kB
SReclaimable:      54300 kB
SUnreclaim:        76456 kB
KernelStack:        3920 kB
PageTables:        15520 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    196899888 kB
Committed_AS:    2012012 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
Percpu:             6944 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2400256 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:      172872 kB
DirectMap2M:     9168896 kB
DirectMap1G:    126877696 kB

Free space on /tmp at the end= 723684 MiB
End job on nodeC004 at 2024-07-31 03:29:54