2019 XCSP3 competition: mini-solver track (sequential and parallel solvers): results by benchmark

Results by benchmark for category optimization problem (COP)

This page displays the results of the different solvers for each benchmark for category optimization problem (COP)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
cosoco 2 (complete)
cosoco 2.0 (complete)
cosoco 2.0 (complete)
(reference) PicatSAT 2019-09-12 (complete)

Bench nameBest results
on this
instance
cosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Auction/Auction-sum/
Auction-sum-decay200_c18.xml
SAT TO
f=1164883
TT=2400.02
T1=111.29
SAT (TO)
f=1164883
TT=2400.06
T1=111.29
SAT (TO)
f=1164883
TT=2400.1
T1=112.67
SAT (TO)
f=1164883
TT=2400.02
T1=113.28
? (TO)

TT=2400.07

Auction/Auction-sum/
Auction-sum-decay500_c18.xml
SAT TO
f=2539538
TT=2400.01
T1=186.97
SAT (TO)
f=2539538
TT=2400.11
T1=186.97
SAT (TO)
f=2539538
TT=2400.01
T1=187.97
SAT (TO)
f=2539538
TT=2400.1
T1=202.17
? (TO)

TT=2400.1

Bacp/Bacp-m2/
Bacp-m2-12b_c18.xml
SAT TO
f=17
TT=2400.03
T1=0
SAT (TO)
f=17
TT=2400.05
T1=0
SAT (TO)
f=17
TT=2400.07
T1=0
SAT (TO)
f=17
TT=2400.03
T1=0
? (TO)

TT=2400.06

GolombRuler/
GolombRuler-a3v18-08_c18.xml
OPT
f=34
TT=0.402
T1=0
OPT
f=34
TT=0.405
T1=0
OPT
f=34
TT=0.402
T1=0
OPT
f=34
TT=0.403
T1=0
OPT
f=34
TT=33.041
T1=33
GolombRuler/
GolombRuler-a3v18-09_c18.xml
OPT
f=44
TT=5.281
T1=1.79
OPT
f=44
TT=5.306
T1=1.79
OPT
f=44
TT=5.281
T1=1.79
OPT
f=44
TT=5.304
T1=1.79
OPT
f=44
TT=93.628
T1=93.59
GolombRuler/
GolombRuler-a3v18-10_c18.xml
OPT
f=55
TT=62.662
T1=46.59
OPT
f=55
TT=63.147
T1=46.89
OPT
f=55
TT=62.754
T1=46.59
OPT
f=55
TT=62.662
T1=46.59
OPT
f=55
TT=296.652
T1=296.58
GolombRuler/
GolombRuler-a3v18-14_c18.xml
SAT TO
f=140
TT=2400.01
T1=881.8
SAT (TO)
f=140
TT=2400.01
T1=888.27
SAT (TO)
f=140
TT=2400.09
T1=881.8
SAT (TO)
f=140
TT=2400.08
T1=885.83
? (TO)

TT=2400.07

GolombRuler/
GolombRuler-a3v18-nodv-10_c18.xml
OPT
f=55
TT=306.942
T1=306.87
OPT
f=55
TT=868.748
T1=804.55
OPT
f=55
TT=860.549
T1=796.95
OPT
f=55
TT=989.471
T1=916.46
OPT
f=55
TT=306.942
T1=306.87
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-1-fullins-5.xml
OPT
f=5
TT=7.633
T1=0.41
OPT
f=5
TT=19.522
T1=0.41
OPT
f=5
TT=19.488
T1=0.46
OPT
f=5
TT=19.992
T1=0.52
OPT
f=5
TT=7.633
T1=7.58
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-2-fullins-5.xml
OPT
f=6
TT=57.738
T1=1.88
OPT
f=6
TT=373.004
T1=1.89
OPT
f=6
TT=301.293
T1=1.88
OPT
f=6
TT=332.521
T1=1.88
OPT
f=6
TT=57.738
T1=57.67
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-3-fullins-3.xml
OPT
f=5
TT=0.059
T1=0
OPT
f=5
TT=0.059
T1=0
OPT
f=5
TT=0.069
T1=0
OPT
f=5
TT=0.061
T1=0
OPT
f=5
TT=1.586
T1=1.48
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-4-insertions-3.xml
OPT
f=3
TT=4.94
T1=4.88
SAT (TO)
f=3
TT=2400.01
T1=0
SAT (TO)
f=3
TT=2400.05
T1=0
SAT (TO)
f=3
TT=2400.04
T1=0
OPT
f=3
TT=4.94
T1=4.88
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-5-fullins-3.xml
OPT
f=7
TT=0.316
T1=0.1
OPT
f=7
TT=0.317
T1=0.1
OPT
f=7
TT=0.368
T1=0.1
OPT
f=7
TT=0.316
T1=0.1
OPT
f=7
TT=4.901
T1=4.88
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-5-fullins-4.xml
OPT
f=8
TT=75.362
T1=1.69
OPT
f=8
TT=138.77
T1=1.79
OPT
f=8
TT=162.982
T1=2.1
OPT
f=8
TT=171.478
T1=1.69
OPT
f=8
TT=75.362
T1=75.26
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-ash331GPIA.xml
OPT
f=3
TT=0.688
T1=0.59
OPT
f=3
TT=0.688
T1=0.59
OPT
f=3
TT=0.797
T1=0.69
OPT
f=3
TT=0.694
T1=0.6
OPT
f=3
TT=11.814
T1=11.77
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-david.xml
OPT
f=10
TT=8.67
T1=0
OPT
f=10
TT=84.179
T1=0
OPT
f=10
TT=84.836
T1=0
OPT
f=10
TT=85.452
T1=0
OPT
f=10
TT=8.67
T1=8.59
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-dsjc-1000-9.xml
SAT TO
f=298
TT=2400.05
T1=84.49
SAT (TO)
f=298
TT=2400.05
T1=84.49
SAT (TO)
f=298
TT=2400.1
T1=85.35
SAT (TO)
f=298
TT=2400.07
T1=85.23
? (TO)

TT=2400.06

GraphColoring/
GraphColoring-m1-mono/
GraphColoring-dsjc-250-5.xml
SAT TO
f=33
TT=2400.05
T1=526.1
SAT (TO)
f=33
TT=2400.09
T1=526.1
SAT (TO)
f=33
TT=2400.06
T1=580.38
SAT (TO)
f=33
TT=2400.05
T1=539
? (TO)

TT=2400.05

GraphColoring/
GraphColoring-m1-mono/
GraphColoring-dsjr-500-1.xml
OPT
f=11
TT=29.781
T1=0.5
OPT
f=11
TT=1014.26
T1=0.5
OPT
f=11
TT=1401.47
T1=0.51
OPT
f=11
TT=1096.03
T1=0.6
OPT
f=11
TT=29.781
T1=29.67
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-fpsol2-i-1.xml
SAT TO
f=64
TT=2400.02
T1=1.77
SAT (TO)
f=64
TT=2400.08
T1=1.79
SAT (TO)
f=64
TT=2400.09
T1=1.77
SAT (TO)
f=64
TT=2400.02
T1=1.79
? (TO)

TT=2400.03

Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-fpsol2-i-2.xml
SAT TO
f=29
TT=2400.03
T1=1.28
SAT (TO)
f=29
TT=2400.07
T1=1.28
SAT (TO)
f=29
TT=2400.04
T1=1.33
SAT (TO)
f=29
TT=2400.03
T1=1.52
? (TO)

TT=2400.09

GraphColoring/
GraphColoring-m1-mono/
GraphColoring-huck.xml
OPT
f=10
TT=7.337
T1=0
OPT
f=10
TT=39.779
T1=0
OPT
f=10
TT=39.421
T1=0
OPT
f=10
TT=39.663
T1=0
OPT
f=10
TT=7.337
T1=7.28
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-lei450-05b.xml
OPT
f=4
TT=227.213
T1=227.16
OPT
f=4
TT=227.213
T1=227.16
OPT
f=4
TT=237.224
T1=237.16
OPT
f=4
TT=234.661
T1=234.61
OPT
f=4
TT=733.332
T1=733.23
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-lei450-05c.xml
OPT
f=4
TT=1.959
T1=1.89
OPT
f=4
TT=1.959
T1=1.89
OPT
f=4
TT=2.227
T1=2.12
OPT
f=4
TT=2.044
T1=1.94
OPT
f=4
TT=23.918
T1=23.88
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-lei450-05d.xml
OPT
f=4
TT=2.201
T1=2.15
OPT
f=4
TT=2.201
T1=2.2
OPT
f=4
TT=2.22
T1=2.15
OPT
f=4
TT=2.222
T1=2.16
OPT
f=4
TT=23.148
T1=23.09
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-queen8-12.xml
OPT
f=11
TT=29.416
T1=0.12
OPT
f=11
TT=1306.23
T1=0.2
OPT
f=11
TT=1310.37
T1=0.15
OPT
f=11
TT=1317.4
T1=0.12
OPT
f=11
TT=29.416
T1=29.32
GraphColoring/
GraphColoring-m1-mono/
GraphColoring-wap05a.xml
SAT TO
f=49
TT=2400.03
T1=7.06
SAT (TO)
f=49
TT=2400.08
T1=7.09
SAT (TO)
f=49
TT=2400.11
T1=7.06
SAT (TO)
f=49
TT=2400.03
T1=7.1
? (TO)

TT=2400.05

GraphColoring/
GraphColoring-m1-mono/
GraphColoring-zeroin-i-2.xml
SAT TO
f=29
TT=2400.03
T1=0.5
SAT (TO)
f=29
TT=2400.05
T1=0.5
SAT (TO)
f=29
TT=2400.08
T1=0.52
SAT (TO)
f=29
TT=2400.03
T1=0.5
? (TO)

TT=2400.05

Knapsack/
Knapsack-m1-s30/
Knapsack-30-100-02.xml
OPT
f=820
TT=0.48
T1=0
OPT
f=820
TT=0.48
T1=0
OPT
f=820
TT=0.48
T1=0
OPT
f=820
TT=0.49
T1=0
OPT
f=820
TT=29.427
T1=29.38
Knapsack/
Knapsack-m1-s30/
Knapsack-30-100-03.xml
OPT
f=781
TT=1.714
T1=0.1
OPT
f=781
TT=1.714
T1=0.1
OPT
f=781
TT=1.724
T1=0.1
OPT
f=781
TT=1.727
T1=0.1
OPT
f=781
TT=48.454
T1=48.38
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Knapsack/
Knapsack-m1-s30/
Knapsack-30-100-08.xml
OPT
f=1059
TT=1.69
T1=0
OPT
f=1059
TT=1.703
T1=0
OPT
f=1059
TT=1.69
T1=0
OPT
f=1059
TT=1.706
T1=0
OPT
f=1059
TT=54.563
T1=54.49
Knapsack/
Knapsack-m1-s30/
Knapsack-30-100-09.xml
OPT
f=569
TT=0.478
T1=0
OPT
f=569
TT=0.48
T1=0
OPT
f=569
TT=0.478
T1=0
OPT
f=569
TT=0.479
T1=0
OPT
f=569
TT=48.687
T1=48.59
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-00.xml
OPT
f=932
TT=19.125
T1=1
OPT
f=932
TT=19.261
T1=1
OPT
f=932
TT=19.125
T1=1
OPT
f=932
TT=19.148
T1=1
OPT
f=932
TT=124.267
T1=124.18
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-01.xml
OPT
f=1128
TT=10.015
T1=1.69
OPT
f=1128
TT=10.015
T1=1.69
OPT
f=1128
TT=10.038
T1=1.69
OPT
f=1128
TT=10.046
T1=1.69
OPT
f=1128
TT=83.127
T1=83.09
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-05.xml
OPT
f=1072
TT=16.831
T1=1.89
OPT
f=1072
TT=16.976
T1=1.99
OPT
f=1072
TT=16.888
T1=1.89
OPT
f=1072
TT=16.831
T1=1.89
OPT
f=1072
TT=70.502
T1=70.4
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-06.xml
OPT
f=741
TT=20.16
T1=0
OPT
f=741
TT=20.192
T1=0
OPT
f=741
TT=20.236
T1=0
OPT
f=741
TT=20.16
T1=0
OPT
f=741
TT=143.653
T1=143.58
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-07.xml
OPT
f=1021
TT=23.56
T1=0
OPT
f=1021
TT=23.56
T1=0
OPT
f=1021
TT=23.637
T1=0
OPT
f=1021
TT=23.915
T1=0
OPT
f=1021
TT=136.185
T1=136.11
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-08.xml
OPT
f=887
TT=6.928
T1=0.31
OPT
f=887
TT=6.938
T1=0.31
OPT
f=887
TT=6.928
T1=0.31
OPT
f=887
TT=6.981
T1=0.31
OPT
f=887
TT=122.808
T1=122.79
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-09.xml
OPT
f=1102
TT=26.295
T1=3.59
OPT
f=1102
TT=26.331
T1=3.59
OPT
f=1102
TT=26.295
T1=3.59
OPT
f=1102
TT=26.558
T1=3.69
OPT
f=1102
TT=91.847
T1=91.8
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-10.xml
OPT
f=973
TT=12.136
T1=1.89
OPT
f=973
TT=12.158
T1=1.89
OPT
f=973
TT=12.136
T1=1.89
OPT
f=973
TT=12.258
T1=1.89
OPT
f=973
TT=129.081
T1=128.99
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-12.xml
OPT
f=954
TT=21.712
T1=3.49
OPT
f=954
TT=21.712
T1=3.49
OPT
f=954
TT=21.722
T1=3.49
OPT
f=954
TT=21.945
T1=3.59
OPT
f=954
TT=152.826
T1=152.78
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-13.xml
OPT
f=1242
TT=16.121
T1=0.4
OPT
f=1242
TT=16.121
T1=0.4
OPT
f=1242
TT=16.176
T1=0.41
OPT
f=1242
TT=16.176
T1=0.41
OPT
f=1242
TT=99.756
T1=99.68
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-14.xml
OPT
f=941
TT=4.942
T1=1.39
OPT
f=941
TT=4.953
T1=1.39
OPT
f=941
TT=4.957
T1=1.4
OPT
f=941
TT=4.942
T1=1.39
OPT
f=941
TT=129.978
T1=129.88
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-15.xml
OPT
f=867
TT=12.988
T1=1.89
OPT
f=867
TT=13.025
T1=1.89
OPT
f=867
TT=13.009
T1=1.89
OPT
f=867
TT=12.988
T1=1.89
OPT
f=867
TT=150.679
T1=150.66
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-16.xml
OPT
f=886
TT=29.829
T1=4.39
OPT
f=886
TT=30.172
T1=4.49
OPT
f=886
TT=30.029
T1=4.39
OPT
f=886
TT=29.829
T1=4.39
OPT
f=886
TT=189.816
T1=189.77
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-17.xml
OPT
f=1030
TT=28.987
T1=2.39
OPT
f=1030
TT=28.987
T1=2.39
OPT
f=1030
TT=29.201
T1=2.39
OPT
f=1030
TT=29.047
T1=2.39
OPT
f=1030
TT=104.542
T1=104.49
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-18.xml
OPT
f=863
TT=10.475
T1=1.19
OPT
f=863
TT=10.531
T1=1.19
OPT
f=863
TT=10.475
T1=1.19
OPT
f=863
TT=10.54
T1=1.19
OPT
f=863
TT=123.288
T1=123.27
Knapsack/
Knapsack-m1-s40/
Knapsack-40-150-19.xml
OPT
f=975
TT=7.296
T1=0.21
OPT
f=975
TT=7.296
T1=0.21
OPT
f=975
TT=7.334
T1=0.21
OPT
f=975
TT=7.318
T1=0.21
OPT
f=975
TT=96.884
T1=96.78
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-00.xml
OPT
f=960
TT=29.277
T1=6.29
OPT
f=960
TT=29.353
T1=6.29
OPT
f=960
TT=29.468
T1=6.39
OPT
f=960
TT=29.277
T1=6.29
OPT
f=960
TT=215.72
T1=215.66
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-01.xml
OPT
f=1297
TT=47.488
T1=0
OPT
f=1297
TT=47.488
T1=0
OPT
f=1297
TT=47.51
T1=0
OPT
f=1297
TT=47.644
T1=0
OPT
f=1297
TT=216.556
T1=216.49
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-02.xml
OPT
f=1003
TT=244.357
T1=8.29
OPT
f=1003
TT=245.075
T1=8.29
OPT
f=1003
TT=244.943
T1=8.29
OPT
f=1003
TT=244.357
T1=8.29
OPT
f=1003
TT=621.711
T1=181.27
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-03.xml
OPT
f=1109
TT=123.668
T1=12.59
OPT
f=1109
TT=123.668
T1=12.59
OPT
f=1109
TT=123.989
T1=12.59
OPT
f=1109
TT=124.103
T1=12.59
OPT
f=1109
TT=433.921
T1=373.62
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-04.xml
OPT
f=1289
TT=107.777
T1=4.49
OPT
f=1289
TT=108.748
T1=4.59
OPT
f=1289
TT=107.777
T1=4.49
OPT
f=1289
TT=108.267
T1=4.59
OPT
f=1289
TT=491.882
T1=491.84
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-05.xml
OPT
f=1105
TT=37.593
T1=22
OPT
f=1105
TT=37.694
T1=22
OPT
f=1105
TT=38.47
T1=22.49
OPT
f=1105
TT=37.593
T1=22
OPT
f=1105
TT=198.684
T1=198.62
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-06.xml
OPT
f=1079
TT=74.423
T1=0
OPT
f=1079
TT=74.59
T1=0
OPT
f=1079
TT=74.938
T1=0
OPT
f=1079
TT=74.423
T1=0
OPT
f=1079
TT=426.806
T1=166.9
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-07.xml
OPT
f=1070
TT=47.812
T1=9.69
OPT
f=1070
TT=48.06
T1=9.69
OPT
f=1070
TT=48.122
T1=9.69
OPT
f=1070
TT=47.812
T1=9.69
OPT
f=1070
TT=142.181
T1=142.1
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-08.xml
OPT
f=1169
TT=41.198
T1=21.49
OPT
f=1169
TT=41.43
T1=21.69
OPT
f=1169
TT=41.198
T1=21.49
OPT
f=1169
TT=41.39
T1=21.59
OPT
f=1169
TT=125.924
T1=125.87
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-09.xml
OPT
f=1241
TT=86.406
T1=14
OPT
f=1241
TT=86.525
T1=14
OPT
f=1241
TT=86.406
T1=14
OPT
f=1241
TT=86.859
T1=14.1
OPT
f=1241
TT=204.978
T1=204.9
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-10.xml
OPT
f=1148
TT=33.05
T1=4.89
OPT
f=1148
TT=33.548
T1=5
OPT
f=1148
TT=33.05
T1=4.89
OPT
f=1148
TT=33.301
T1=5
OPT
f=1148
TT=229.322
T1=229.31
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-11.xml
OPT
f=1049
TT=86.956
T1=17.99
OPT
f=1049
TT=86.956
T1=17.99
OPT
f=1049
TT=87.416
T1=18.1
OPT
f=1049
TT=87.728
T1=18.1
OPT
f=1049
TT=273.396
T1=132.48
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-15.xml
OPT
f=986
TT=64.971
T1=4.79
OPT
f=986
TT=65.643
T1=4.89
OPT
f=986
TT=64.971
T1=4.79
OPT
f=986
TT=65.056
T1=4.79
OPT
f=986
TT=180.209
T1=180.11
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-16.xml
OPT
f=1429
TT=309.279
T1=12.79
OPT
f=1429
TT=310.27
T1=12.89
OPT
f=1429
TT=309.279
T1=12.79
OPT
f=1429
TT=309.97
T1=12.79
OPT
f=1429
TT=699.051
T1=641.56
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-17.xml
OPT
f=992
TT=221.484
T1=1.39
OPT
f=992
TT=222.499
T1=1.39
OPT
f=992
TT=222.23
T1=1.39
OPT
f=992
TT=221.484
T1=1.39
OPT
f=992
TT=409.737
T1=409.69
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-18.xml
OPT
f=937
TT=65.045
T1=6.1
OPT
f=937
TT=65.045
T1=6.1
OPT
f=937
TT=65.49
T1=6.19
OPT
f=937
TT=65.09
T1=6.1
OPT
f=937
TT=175.161
T1=115.99
Knapsack/
Knapsack-m1-s50/
Knapsack-50-200-19.xml
OPT
f=1025
TT=206.976
T1=1.1
OPT
f=1025
TT=206.976
T1=1.1
OPT
f=1025
TT=207.116
T1=1.1
OPT
f=1025
TT=208.001
T1=1.1
OPT
f=1025
TT=635.746
T1=355.79
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-006.xml
OPT
f=7
TT=0.012
T1=0
OPT
f=7
TT=0.013
T1=0
OPT
f=7
TT=0.012
T1=0
OPT
f=7
TT=0.014
T1=0
OPT
f=7
TT=0.099
T1=0
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-012.xml
OPT
f=10
TT=0.214
T1=0
OPT
f=10
TT=0.214
T1=0
OPT
f=10
TT=0.215
T1=0
OPT
f=10
TT=0.216
T1=0
OPT
f=10
TT=0.801
T1=0.69
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-013.xml
OPT
f=6
TT=0.096
T1=0
OPT
f=6
TT=0.096
T1=0
OPT
f=6
TT=0.096
T1=0
OPT
f=6
TT=0.097
T1=0
OPT
f=6
TT=0.192
T1=0.09
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-017.xml
OPT
f=32
TT=26.99
T1=0.2
OPT
f=32
TT=36.585
T1=0.21
OPT
f=32
TT=36.016
T1=0.2
OPT
f=32
TT=35.725
T1=0.2
OPT
f=32
TT=26.99
T1=26.89
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-018.xml
OPT
f=25
TT=17.611
T1=1
OPT
f=25
TT=60.955
T1=1
OPT
f=25
TT=60.39
T1=1
OPT
f=25
TT=60.715
T1=1
OPT
f=25
TT=17.611
T1=17.59
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-019.xml
OPT
f=29
TT=32.232
T1=1.88
OPT
f=29
TT=133.222
T1=1.89
OPT
f=29
TT=133.396
T1=1.89
OPT
f=29
TT=133.545
T1=1.88
OPT
f=29
TT=32.232
T1=32.18
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-020.xml
OPT
f=26
TT=29.899
T1=3.19
OPT
f=26
TT=331.978
T1=3.19
OPT
f=26
TT=356.782
T1=3.19
OPT
f=26
TT=331.118
T1=3.19
OPT
f=26
TT=29.899
T1=29.79
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-021.xml
OPT
f=26
TT=31.785
T1=31.68
OPT
f=26
TT=365.275
T1=168.2
OPT
f=26
TT=381.21
T1=172.79
OPT
f=26
TT=361.351
T1=167
OPT
f=26
TT=31.785
T1=31.68
LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-029.xml
SAT TO
f=62
TT=2400.05
T1=1710.11
SAT (TO)
f=62
TT=2400.09
T1=1745.14
SAT (TO)
f=62
TT=2400.07
T1=1784.55
SAT (TO)
f=62
TT=2400.05
T1=1710.11
? (TO)

TT=2400.01

LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-033.xml
SAT TO
f=96
TT=2400.05
T1=956.56
SAT (TO)
f=96
TT=2400.09
T1=956.56
SAT (TO)
f=96
TT=2400.05
T1=962.44
SAT (TO)
f=96
TT=2400.09
T1=959.22
? (TO)

TT=2400.02

LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-038.xml
SAT TO
f=143
TT=2400.05
T1=1954.77
SAT (TO)
f=143
TT=2400.07
T1=2015.12
SAT (TO)
f=143
TT=2400.05
T1=1954.77
SAT (TO)
f=159
TT=2400.09
T1=62.48
? (TO)

TT=2400.1

LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-062.xml
SAT TO
f=595
TT=2400.08
T1=2264
SAT (TO)
f=595
TT=2400.09
T1=2321.39
SAT (TO)
f=595
TT=2400.1
T1=2264
SAT (TO)
f=595
TT=2400.08
T1=2288.27
? (TO)

TT=2400.02

LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-067.xml
SAT TO
f=881
TT=2400.05
T1=264.64
SAT (TO)
f=881
TT=2400.05
T1=264.64
SAT (TO)
f=881
TT=2400.1
T1=293.01
SAT (TO)
f=881
TT=2400.11
T1=289.07
? (TO)

TT=2400.09

LowAutocorrelation/
LowAutocorrelation-m1-s1/
LowAutocorrelation-089.xml
SAT TO
f=1620
TT=2400.03
T1=170.03
SAT (TO)
f=1620
TT=2400.1
T1=170.03
SAT (TO)
f=1620
TT=2400.08
T1=170.83
SAT (TO)
f=1620
TT=2400.03
T1=175.2
? (TO)

TT=2400.06

OpenStacks/
OpenStacks-m1c-s1/
OpenStacks-m1c-gp-050-1.xml
OPT
f=45
TT=624.527
T1=624.47
SAT (TO)
f=47
TT=2400.1
T1=320.23
SAT (TO)
f=47
TT=2400.07
T1=321.92
SAT (TO)
f=47
TT=2400.03
T1=308.09
OPT
f=45
TT=624.527
T1=624.47
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-pb-20-10-1.xml
OPT
f=9
TT=20.109
T1=0.09
OPT
f=9
TT=1708.88
T1=0.09
OPT
f=9
TT=1731.21
T1=0.09
OPT
f=9
TT=1937.96
T1=0.1
OPT
f=9
TT=20.109
T1=20.09
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbo-10-20-1.xml
OPT
f=5
TT=37.457
T1=37.4
SAT (TO)
f=6
TT=2400.1
T1=0.69
SAT (TO)
f=6
TT=2400.04
T1=0.69
SAT (TO)
f=6
TT=2400.08
T1=0.69
OPT
f=5
TT=37.457
T1=37.4
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbo-15-30-1.xml
OPT
f=4
TT=44.082
T1=43.99
SAT (TO)
f=9
TT=2400.05
T1=641.3
SAT (TO)
f=9
TT=2400.06
T1=624.26
SAT (TO)
f=9
TT=2400.1
T1=615.06
OPT
f=4
TT=44.082
T1=43.99
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbo-20-20-1.xml
OPT
f=3
TT=27.614
T1=27.58
SAT (TO)
f=5
TT=2400.07
T1=6.38
SAT (TO)
f=5
TT=2400.05
T1=6.29
SAT (TO)
f=5
TT=2400.05
T1=6.29
OPT
f=3
TT=27.614
T1=27.58
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbo-30-10-1.xml
OPT
f=10
TT=37.36
T1=24.18
OPT
f=10
TT=1084.01
T1=24.18
OPT
f=10
TT=1095.76
T1=24.38
OPT
f=10
TT=1107.92
T1=24.69
OPT
f=10
TT=37.36
T1=37.28
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbo-30-15-1.xml
OPT
f=7
TT=48.588
T1=48.49
SAT (TO)
f=8
TT=2400.01
T1=249.96
SAT (TO)
f=8
TT=2400.1
T1=260.67
SAT (TO)
f=8
TT=2400
T1=266.5
OPT
f=7
TT=48.588
T1=48.49
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbop-10-20-1.xml
OPT
f=5
TT=27.263
T1=27.18
SAT (TO)
f=6
TT=2400.09
T1=24.99
SAT (TO)
f=6
TT=2400.01
T1=30
SAT (TO)
f=6
TT=2400.01
T1=26.69
OPT
f=5
TT=27.263
T1=27.18
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbop-20-20-1.xml
OPT
f=3
TT=29.582
T1=29.49
SAT (TO)
f=6
TT=2400.08
T1=1882.97
SAT (TO)
f=6
TT=2400.07
T1=1937.47
SAT (TO)
f=6
TT=2400.01
T1=1854.51
OPT
f=3
TT=29.582
T1=29.49
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbop-30-15-1.xml
OPT
f=10
TT=48.681
T1=48.58
SAT (TO)
f=11
TT=2400.08
T1=8.99
SAT (TO)
f=11
TT=2400.08
T1=8.88
SAT (TO)
f=11
TT=2400.06
T1=8.89
OPT
f=10
TT=48.681
T1=48.58
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbop-30-30-1.xml
OPT
f=3
TT=44.111
T1=44.09
SAT (TO)
f=13
TT=2400.03
T1=6.39
SAT (TO)
f=13
TT=2400
T1=6.1
SAT (TO)
f=13
TT=2400.01
T1=6.19
OPT
f=3
TT=44.111
T1=44.09
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbp-15-15-1.xml
OPT
f=4
TT=15.718
T1=15.69
SAT (TO)
f=4
TT=2400.01
T1=560.86
SAT (TO)
f=4
TT=2400.02
T1=558.07
SAT (TO)
f=4
TT=2400.02
T1=570.26
OPT
f=4
TT=15.718
T1=15.69
OpenStacks/OpenStacks-m1c-s1/
OpenStacks-m1c-wbp-20-10-1.xml
OPT
f=8
TT=14.98
T1=0.1
OPT
f=8
TT=1643.84
T1=0.1
OPT
f=8
TT=1666.67
T1=0.1
OPT
f=8
TT=1634.97
T1=0.1
OPT
f=8
TT=14.98
T1=14.89
OpenStacks/
OpenStacks-m1-s1/
OpenStacks-m1-gp-050-1.xml
OPT
f=45
TT=705.708
T1=705.63
SAT (TO)
f=47
TT=2400.08
T1=386.6
SAT (TO)
f=47
TT=2400.08
T1=339.28
SAT (TO)
f=47
TT=2400.07
T1=302.51
OPT
f=45
TT=705.708
T1=705.63
OpenStacks/
OpenStacks-m1-s1/
OpenStacks-m1-Miller-19.xml
SAT TO
f=17
TT=2400.02
T1=19.59
SAT (TO)
f=17
TT=2400.02
T1=19.59
SAT (TO)
f=17
TT=2400.09
T1=19.68
SAT (TO)
f=17
TT=2400.03
T1=19.59
? (TO)

TT=2400.02

OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-nrwsLarge-4-1.xml
OPT
f=12
TT=899.249
T1=899.16
SAT (TO)
f=19
TT=2400.09
T1=3.38
SAT (TO)
f=19
TT=2400.05
T1=4.09
SAT (TO)
f=19
TT=2400.11
T1=4.29
OPT
f=12
TT=899.249
T1=899.16
OpenStacks/
OpenStacks-m1-s1/
OpenStacks-m1-pb-20-10-1.xml
OPT
f=9
TT=18.659
T1=0.09
OPT
f=9
TT=1684.23
T1=0.09
OPT
f=9
TT=1707.29
T1=0.1
OPT
f=9
TT=1762.11
T1=0.1
OPT
f=9
TT=18.659
T1=18.59
OpenStacks/
OpenStacks-m1-s1/
OpenStacks-m1-pb-30-10-1.xml
UNSAT

TT=37.743

UNSAT

TT=1582.87

UNSAT

TT=1559.84

UNSAT

TT=1586.66

UNSAT

TT=37.743

OpenStacks/
OpenStacks-m1-s1/
OpenStacks-m1-pb-30-15-1.xml
OPT
f=14
TT=78.244
T1=78.19
? (TO)

TT=2400.1

? (TO)

TT=2400.04

? (TO)

TT=2400.02

OPT
f=14
TT=78.244
T1=78.19
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbo-10-20-1.xml
OPT
f=5
TT=29.521
T1=29.48
SAT (TO)
f=6
TT=2400.08
T1=0.69
SAT (TO)
f=6
TT=2400.1
T1=0.69
SAT (TO)
f=6
TT=2400.08
T1=0.69
OPT
f=5
TT=29.521
T1=29.48
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbo-10-30-1.xml
OPT
f=6
TT=82.691
T1=34.3
SAT (TO)
f=7
TT=2400.06
T1=40
SAT (TO)
f=7
TT=2400.08
T1=46.88
SAT (TO)
f=7
TT=2400.01
T1=47
OPT
f=6
TT=82.691
T1=34.3
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbo-20-20-1.xml
OPT
f=3
TT=32.502
T1=32.49
SAT (TO)
f=5
TT=2400.04
T1=6.29
SAT (TO)
f=5
TT=2400.09
T1=6.1
SAT (TO)
f=5
TT=2400.1
T1=6.29
OPT
f=3
TT=32.502
T1=32.49
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbo-30-15-1.xml
OPT
f=7
TT=42.815
T1=42.79
SAT (TO)
f=8
TT=2400.02
T1=269.12
SAT (TO)
f=8
TT=2400.06
T1=251.87
SAT (TO)
f=8
TT=2400.03
T1=260.28
OPT
f=7
TT=42.815
T1=42.79
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbop-10-20-1.xml
OPT
f=5
TT=26.764
T1=26.7
SAT (TO)
f=6
TT=2400.07
T1=24.49
SAT (TO)
f=6
TT=2400.02
T1=26
SAT (TO)
f=6
TT=2400.01
T1=29.6
OPT
f=5
TT=26.764
T1=26.7
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbop-30-15-1.xml
OPT
f=10
TT=49.552
T1=49.48
SAT (TO)
f=11
TT=2400.1
T1=9.28
SAT (TO)
f=11
TT=2400.03
T1=9.38
SAT (TO)
f=11
TT=2400.1
T1=9.59
OPT
f=10
TT=49.552
T1=49.48
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbop-30-30-1.xml
OPT
f=3
TT=61.183
T1=61.11
SAT (TO)
f=13
TT=2400.11
T1=6.19
SAT (TO)
f=13
TT=2400.09
T1=6.59
SAT (TO)
f=13
TT=2400.02
T1=6
OPT
f=3
TT=61.183
T1=61.11
OpenStacks/OpenStacks-m1-s1/
OpenStacks-m1-wbp-15-15-1.xml
OPT
f=4
TT=15.657
T1=15.59
SAT (TO)
f=4
TT=2400.05
T1=558.73
SAT (TO)
f=4
TT=2400.03
T1=566.36
SAT (TO)
f=4
TT=2400.07
T1=563.04
OPT
f=4
TT=15.657
T1=15.59
PseudoBoolean/
PseudoBoolean-opt-bgr/
Pb-bgr-06.xml
OPT
f=17
TT=0.294
T1=0.1
OPT
f=17
TT=0.294
T1=0.1
OPT
f=17
TT=0.297
T1=0.1
OPT
f=17
TT=0.299
T1=0.1
OPT
f=17
TT=2.85
T1=2.79
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-aim-200-2-0-yes1-1.xml
OPT
f=200
TT=5.35
T1=5.29
OPT
f=200
TT=2173.24
T1=171.29
OPT
f=200
TT=2223.63
T1=175.57
OPT
f=200
TT=2189.79
T1=172.27
OPT
f=200
TT=5.35
T1=5.29
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-hanoi4.xml
OPT
f=718
TT=109.55
T1=109.49
? (TO)

TT=2400.09

? (TO)

TT=2400.03

? (TO)

TT=2400.08

OPT
f=718
TT=109.55
T1=109.49
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-ii16c1.xml
SAT TO
f=1420
TT=2400.02
T1=439.13
SAT (TO)
f=1420
TT=2400.11
T1=440.21
SAT (TO)
f=1420
TT=2400.02
T1=439.13
SAT (TO)
f=1420
TT=2400.02
T1=446.26
? (TO)

TT=2400.03

Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-ii32a1.xml
OPT
f=444
TT=76.037
T1=76
SAT (TO)
f=444
TT=2400.02
T1=8.59
SAT (TO)
f=444
TT=2400.09
T1=8.69
SAT (TO)
f=444
TT=2400.04
T1=8.79
OPT
f=444
TT=76.037
T1=76
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-ii32e3.xml
OPT
f=310
TT=92.068
T1=92
SAT (TO)
f=310
TT=2400.06
T1=25.78
SAT (TO)
f=310
TT=2400.05
T1=25.68
SAT (TO)
f=310
TT=2400.03
T1=25.68
OPT
f=310
TT=92.068
T1=92
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-ii32e5.xml
OPT
f=503
TT=226.188
T1=218.29
SAT (TO)
f=503
TT=2400.06
T1=1573.68
SAT (TO)
f=503
TT=2400.04
T1=1587.11
SAT (TO)
f=503
TT=2400.03
T1=1572.7
OPT
f=503
TT=226.188
T1=218.29
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-jnh217.xml
OPT
f=89
TT=28.83
T1=28.79
OPT
f=89
TT=55.836
T1=34
OPT
f=89
TT=56.884
T1=34.59
OPT
f=89
TT=55.991
T1=34.09
OPT
f=89
TT=28.83
T1=28.79
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-jnh220.xml
OPT
f=94
TT=4.843
T1=0.79
OPT
f=94
TT=4.843
T1=0.79
OPT
f=94
TT=5.591
T1=0.89
OPT
f=94
TT=4.873
T1=0.79
OPT
f=94
TT=18.476
T1=18.39
PseudoBoolean/
PseudoBoolean-opt-dimacs/
Pb-par16-3.xml
OPT
f=1015
TT=53.826
T1=53.79
SAT (TO)
f=1015
TT=2400.01
T1=123.68
SAT (TO)
f=1015
TT=2400.1
T1=137.01
SAT (TO)
f=1015
TT=2400.1
T1=125.59
OPT
f=1015
TT=53.826
T1=53.79
PseudoBoolean/
PseudoBoolean-opt-factor/
Pb-factor-S9-P293-Q307.xml
OPT
f=293
TT=0.143
T1=0.1
OPT
f=293
TT=0.158
T1=0.1
OPT
f=293
TT=0.158
T1=0.1
OPT
f=293
TT=0.159
T1=0.1
OPT
f=293
TT=0.143
T1=0.1
PseudoBoolean/
PseudoBoolean-opt-fx/
Pb-fx84.xml
OPT
f=8
TT=66.982
T1=66.87
OPT
f=8
TT=70.473
T1=70.38
OPT
f=8
TT=66.982
T1=66.87
OPT
f=8
TT=71.214
T1=71.11
OPT
f=8
TT=138.509
T1=138.4
PseudoBoolean/
PseudoBoolean-opt-logicSynthesis/
Pb-logic-ex6inp-r.xml
OPT
f=4
TT=0.596
T1=0
OPT
f=4
TT=0.596
T1=0
OPT
f=4
TT=0.687
T1=0
OPT
f=4
TT=0.602
T1=0
OPT
f=4
TT=0.672
T1=0.59
PseudoBoolean/
PseudoBoolean-opt-logicSynthesis/
Pb-logic-m050-100-30-30-r.xml
OPT
f=4
TT=7.978
T1=7.89
OPT
f=4
TT=50.115
T1=46.9
OPT
f=4
TT=50.191
T1=47
OPT
f=4
TT=50.283
T1=47.1
OPT
f=4
TT=7.978
T1=7.89
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
PseudoBoolean/
PseudoBoolean-opt-logicSynthesis/
Pb-logic-m100-100-30-30-r.xml
OPT
f=5
TT=29.283
T1=29.19
OPT
f=5
TT=1163.6
T1=1045.25
OPT
f=5
TT=1328.51
T1=1193.11
OPT
f=5
TT=1166.96
T1=1048.28
OPT
f=5
TT=29.283
T1=29.19
PseudoBoolean/
PseudoBoolean-opt-logicSynthesis/
Pb-logic-prom2-pi.xml
SAT TO
f=445
TT=2400.04
T1=0.5
SAT (TO)
f=445
TT=2400.07
T1=0.5
SAT (TO)
f=445
TT=2400.04
T1=0.51
SAT (TO)
f=445
TT=2400.04
T1=0.51
? (TO)

TT=2400.03

PseudoBoolean/
PseudoBoolean-opt-marketSplit/
Pb-msplit-opt-4-30-1.xml
OPT
f=2
TT=858.942
T1=35.39
OPT
f=2
TT=858.942
T1=35.39
OPT
f=2
TT=860.587
T1=35.49
OPT
f=2
TT=860.212
T1=35.59
OPT
f=2
TT=1248.49
T1=1248.45
PseudoBoolean/
PseudoBoolean-opt-mps/
Pb-mps-v2-20-10-p0040.xml
OPT
f=62027
TT=11.214
T1=2.49
OPT
f=62027
TT=11.214
T1=2.49
OPT
f=62027
TT=11.269
T1=2.5
OPT
f=62027
TT=11.275
T1=2.49
OPT
f=62027
TT=137.878
T1=137.8
PseudoBoolean/
PseudoBoolean-opt-routing/
Pb-routing-s4-4-3-1.xml
OPT
f=62
TT=58.085
T1=57.99
SAT (TO)
f=66
TT=2400.08
T1=1101.13
SAT (TO)
f=66
TT=2400.05
T1=1135.51
SAT (TO)
f=66
TT=2400.04
T1=1135.4
OPT
f=62
TT=58.085
T1=57.99
PseudoBoolean/
PseudoBoolean-opt-ttp/
Pb-circ8-3.xml
SAT TO
f=182
TT=2400.03
T1=4.89
SAT (TO)
f=182
TT=2400.03
T1=4.89
SAT (TO)
f=182
TT=2400.09
T1=4.89
SAT (TO)
f=182
TT=2400.1
T1=4.99
? (TO)

TT=2400.06

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-bur26d.xml
SAT TO
f=1718419
TT=2400.04
T1=22.47
SAT (TO)
f=1718419
TT=2400.1
T1=24.39
SAT (TO)
f=1718419
TT=2400.04
T1=22.48
SAT (TO)
f=1718419
TT=2400.05
T1=22.47
? (TO)

TT=2400.09

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-chr15b.xml
OPT
f=3995
TT=1.146
T1=0.41
OPT
f=3995
TT=1.149
T1=0.41
OPT
f=3995
TT=1.146
T1=0.41
OPT
f=3995
TT=1.157
T1=0.41
OPT
f=3995
TT=165.341
T1=165.3
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-chr15c.xml
OPT
f=4752
TT=49.23
T1=22.69
OPT
f=4752
TT=49.46
T1=22.79
OPT
f=4752
TT=49.23
T1=22.69
OPT
f=4752
TT=49.553
T1=22.79
OPT
f=4752
TT=191.692
T1=191.58
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-chr18a.xml
OPT
f=5549
TT=65.618
T1=27.59
OPT
f=5549
TT=65.81
T1=27.69
OPT
f=5549
TT=65.618
T1=27.59
OPT
f=5549
TT=65.979
T1=27.79
OPT
f=5549
TT=405.166
T1=141.57
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-chr20b.xml
OPT
f=1149
TT=27.782
T1=21.79
OPT
f=1149
TT=31
T1=21.79
OPT
f=1149
TT=31.029
T1=21.87
OPT
f=1149
TT=30.995
T1=21.79
OPT
f=1149
TT=27.782
T1=27.69
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-esc16d.xml
OPT
f=8
TT=23.782
T1=0
OPT
f=8
TT=143.145
T1=0
OPT
f=8
TT=164.121
T1=0.1
OPT
f=8
TT=143.08
T1=0
OPT
f=8
TT=23.782
T1=23.69
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-esc16e.xml
OPT
f=14
TT=30.699
T1=0
OPT
f=14
TT=30.772
T1=0
OPT
f=14
TT=30.699
T1=0
OPT
f=14
TT=30.747
T1=0
OPT
f=14
TT=42.44
T1=42.38
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-kra32.xml
SAT TO
f=57895
TT=2400.05
T1=1385.22
SAT (TO)
f=57895
TT=2400.09
T1=1385.22
SAT (TO)
f=57895
TT=2400.05
T1=1394.8
SAT (TO)
f=57895
TT=2400.1
T1=1403.11
? (TO)

TT=2400.02

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-lipa30b.xml
SAT TO
f=93923
TT=2400.03
T1=19.1
SAT (TO)
f=93923
TT=2400.1
T1=19.28
SAT (TO)
f=93923
TT=2400.06
T1=19.1
SAT (TO)
f=93923
TT=2400.03
T1=19.29
? (TO)

TT=2400.08

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-lipa50a.xml
SAT TO
f=31710
TT=2400.04
T1=1292.79
SAT (TO)
f=31710
TT=2400.06
T1=1302.2
SAT (TO)
f=31710
TT=2400.04
T1=1292.79
SAT (TO)
f=31710
TT=2400.11
T1=1298.26
? (TO)

TT=2400.03

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-lipa60b.xml
SAT TO
f=1615360
TT=2400.05
T1=2105.33
SAT (TO)
f=1615360
TT=2400.11
T1=2105.33
SAT (TO)
f=1615360
TT=2400.05
T1=2136.83
SAT (TO)
f=1615360
TT=2400.09
T1=2150.18
? (TO)

TT=2400.03

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-nug16a.xml
SAT TO
f=875
TT=2400.07
T1=2271.78
SAT (TO)
f=875
TT=2400.11
T1=2298.5
SAT (TO)
f=875
TT=2400.1
T1=2278.77
SAT (TO)
f=875
TT=2400.07
T1=2271.78
? (TO)

TT=2400.06

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-nug17.xml
SAT TO
f=960
TT=2400.03
T1=915.91
SAT (TO)
f=960
TT=2400.03
T1=930.48
SAT (TO)
f=960
TT=2400.03
T1=918.93
SAT (TO)
f=960
TT=2400.05
T1=915.91
? (TO)

TT=2400.09

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-scr12.xml
OPT
f=15705
TT=3.854
T1=0.51
OPT
f=15705
TT=3.864
T1=0.51
OPT
f=15705
TT=3.865
T1=0.51
OPT
f=15705
TT=3.854
T1=0.51
OPT
f=15705
TT=147.308
T1=147.29
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-scr15.xml
OPT
f=25570
TT=726.59
T1=145.8
OPT
f=25570
TT=728.107
T1=503.47
OPT
f=25570
TT=726.59
T1=502.26
OPT
f=25570
TT=729.672
T1=504.27
OPT
f=25570
TT=1426.76
T1=145.8
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-sko42.xml
SAT TO
f=9639
TT=2400.02
T1=1824.83
SAT (TO)
f=9639
TT=2400.04
T1=1825.06
SAT (TO)
f=9639
TT=2400.03
T1=1824.83
SAT (TO)
f=9639
TT=2400.02
T1=1834.42
? (TO)

TT=2400.05

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-tai10a.xml
OPT
f=67514
TT=305.003
T1=137.89
OPT
f=67514
TT=306.653
T1=138.66
OPT
f=67514
TT=305.003
T1=137.89
OPT
f=67514
TT=313.893
T1=141.89
? (TO)

TT=2400.07

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-tai10b.xml
OPT
f=58937
TT=0.549
T1=0.31
OPT
f=58937
TT=0.555
T1=0.31
OPT
f=58937
TT=0.549
T1=0.31
OPT
f=58937
TT=0.555
T1=0.31
OPT
f=58937
TT=1947.18
T1=1947.14
QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-tai17a.xml
SAT TO
f=273667
TT=2400.02
T1=183.89
SAT (TO)
f=273667
TT=2400.02
T1=191.64
SAT (TO)
f=273667
TT=2400.07
T1=188.09
SAT (TO)
f=273667
TT=2400.04
T1=183.89
? (TO)

TT=2400.02

QuadraticAssignment/
QuadraticAssignment-m1-s1/
QuadraticAssignment-wil100.xml
SAT TO
f=148097
TT=2400.05
T1=163.85
SAT (TO)
f=148097
TT=2400.05
T1=167.26
SAT (TO)
f=148097
TT=2400.1
T1=173.66
SAT (TO)
f=148097
TT=2400.1
T1=163.85
? (TO)

TT=2400.13

Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-graph-03-opt_c18.xml
OPT
f=380
TT=0.346
T1=0.31
OPT
f=380
TT=0.346
T1=0.31
OPT
f=380
TT=0.346
T1=0.31
OPT
f=380
TT=0.4
T1=0.31
OPT
f=380
TT=33.878
T1=33.79
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-graph-04-opt_c18.xml
OPT
f=394
TT=0.601
T1=0.5
OPT
f=394
TT=0.602
T1=0.51
OPT
f=394
TT=0.601
T1=0.5
OPT
f=394
TT=0.699
T1=0.68
OPT
f=394
TT=61.571
T1=61.48
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-graph-07-opt_c18.xml
OPT
f=4324
TT=1359.07
T1=1359.02
? (exit code)

TT=20.972

? (exit code)

TT=21.065

? (exit code)

TT=23.648

OPT
f=4324
TT=1359.07
T1=1359.02
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-graph-10-opt_c18.xml
OPT
f=394
TT=0.88
T1=0.79
OPT
f=394
TT=0.881
T1=0.79
OPT
f=394
TT=0.88
T1=0.79
OPT
f=394
TT=1.015
T1=0.99
OPT
f=394
TT=123.297
T1=123.2
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-graph-11-opt_c18.xml




? (exit code)

TT=23.186

? (exit code)

TT=22.728

? (exit code)

TT=26.211

? (TO)

TT=2400.05

Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-scen-04-opt_c18.xml
OPT
f=46
TT=0.599
T1=0.5
OPT
f=46
TT=0.599
T1=0.5
OPT
f=46
TT=0.601
T1=0.5
OPT
f=46
TT=0.696
T1=0.59
OPT
f=46
TT=39.659
T1=39.59
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-scen-05-opt_c18.xml
OPT
f=792
TT=0.472
T1=0.4
OPT
f=792
TT=0.472
T1=0.41
OPT
f=792
TT=0.472
T1=0.4
OPT
f=792
TT=0.549
T1=0.51
OPT
f=792
TT=104.534
T1=104.47
Rlfap_mini/Rlfap-opt_mini/
Rlfap-ext-scen-10-opt_c18.xml




? (exit code)

TT=292.796

? (exit code)

TT=278.065

? (exit code)

TT=312.56

? (TO)

TT=2400.08

SumColoring/
SumColoring-dsjc-250-1_c18.xml
SAT TO
f=941
TT=2400.04
T1=0.4
SAT (TO)
f=941
TT=2400.07
T1=0.4
SAT (TO)
f=941
TT=2400.04
T1=0.4
SAT (TO)
f=941
TT=2400.05
T1=0.41
? (TO)

TT=2400.03

test/cop/
OpenStacks-m1-pb-10-10-1.xml
OPT
f=5
TT=5.451
T1=0
OPT
f=5
TT=52.654
T1=0
OPT
f=5
TT=52.52
T1=0.01
OPT
f=5
TT=52.92
T1=0.05
OPT
f=5
TT=5.451
T1=5.37
TravellingSalesman/
TravellingSalesman-m1-n100/
TravellingSalesman-100-50-01.xml
SAT TO
f=1006
TT=2400.01
T1=306.82
SAT (TO)
f=1006
TT=2400.08
T1=308.78
SAT (TO)
f=1006
TT=2400.09
T1=313.63
SAT (TO)
f=1006
TT=2400.01
T1=306.82
? (TO)

TT=2400.05

TravellingSalesman/
TravellingSalesman-m1-n100/
TravellingSalesman-100-50-13.xml
SAT TO
f=1066
TT=2400.04
T1=286.28
SAT (TO)
f=1066
TT=2400.09
T1=289.41
SAT (TO)
f=1066
TT=2400.04
T1=287.68
SAT (TO)
f=1066
TT=2400.05
T1=286.28
? (TO)

TT=2400.02

TravellingSalesman/
TravellingSalesman-m1-n150/
TravellingSalesman-150-50-00.xml
SAT TO
f=1424
TT=2400.03
T1=779.39
SAT (TO)
f=1424
TT=2400.03
T1=779.39
SAT (TO)
f=1424
TT=2400.08
T1=784.63
SAT (TO)
f=1424
TT=2400.06
T1=783.47
? (TO)

TT=2400.08

TravellingSalesman/
TravellingSalesman-m1-n150/
TravellingSalesman-150-50-07.xml
SAT TO
f=1190
TT=2400.01
T1=1412.31
SAT (TO)
f=1190
TT=2400.01
T1=1412.67
SAT (TO)
f=1190
TT=2400.09
T1=1418.77
SAT (TO)
f=1190
TT=2400.04
T1=1412.31
? (TO)

TT=2400.06

Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-00.xml
OPT
f=93
TT=106.436
T1=106.39
SAT (TO)
f=93
TT=2400.08
T1=91.56
SAT (TO)
f=93
TT=2400.04
T1=90.69
SAT (TO)
f=93
TT=2400.03
T1=91.79
OPT
f=93
TT=106.436
T1=106.39
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-01.xml
OPT
f=106
TT=81.079
T1=8.29
OPT
f=106
TT=462.975
T1=8.39
OPT
f=106
TT=456.583
T1=8.29
OPT
f=106
TT=458.206
T1=8.29
OPT
f=106
TT=81.079
T1=80.98
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-02.xml
OPT
f=114
TT=51.752
T1=16.59
OPT
f=114
TT=604.761
T1=16.79
OPT
f=114
TT=596.432
T1=16.59
OPT
f=114
TT=602.187
T1=16.69
OPT
f=114
TT=51.752
T1=51.69
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-03.xml
OPT
f=98
TT=65.725
T1=7.79
OPT
f=98
TT=320.868
T1=7.89
OPT
f=98
TT=317.207
T1=7.79
OPT
f=98
TT=318.301
T1=7.89
OPT
f=98
TT=65.725
T1=65.7
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-04.xml
OPT
f=116
TT=84.682
T1=84.6
SAT (TO)
f=116
TT=2400.01
T1=56.79
SAT (TO)
f=116
TT=2400.01
T1=65.01
SAT (TO)
f=116
TT=2400.06
T1=56.49
OPT
f=116
TT=84.682
T1=84.6
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-06.xml
OPT
f=99
TT=53.951
T1=5.48
OPT
f=99
TT=432.255
T1=5.48
OPT
f=99
TT=428.297
T1=5.49
OPT
f=99
TT=433.272
T1=5.49
OPT
f=99
TT=53.951
T1=53.88
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-10.xml
OPT
f=104
TT=105.886
T1=105.79
SAT (TO)
f=104
TT=2400.03
T1=12.6
SAT (TO)
f=104
TT=2400.08
T1=12.58
SAT (TO)
f=104
TT=2400.01
T1=14.39
OPT
f=104
TT=105.886
T1=105.79
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-11.xml
OPT
f=76
TT=96.059
T1=26
OPT
f=76
TT=1279.19
T1=26.1
OPT
f=76
TT=1278.22
T1=26
OPT
f=76
TT=1282.21
T1=26.1
OPT
f=76
TT=96.059
T1=96.01
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-12.xml
OPT
f=105
TT=43.099
T1=42.99
SAT (TO)
f=105
TT=2400.02
T1=35.29
SAT (TO)
f=105
TT=2400.06
T1=34.79
SAT (TO)
f=105
TT=2400.01
T1=40.6
OPT
f=105
TT=43.099
T1=42.99
TravellingSalesman/
TravellingSalesman-m1-n15/
TravellingSalesman-15-30-17.xml
OPT
f=85
TT=113.495
T1=66.1
OPT
f=85
TT=1951.09
T1=66.48
OPT
f=85
TT=1941.17
T1=66.1
OPT
f=85
TT=1952.15
T1=66.48
OPT
f=85
TT=113.495
T1=113.39
Bench nameBest resultscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
TravellingSalesman/
TravellingSalesman-m1-n20/
TravellingSalesman-20-30-04.xml
OPT
f=122
TT=389.928
T1=389.88
SAT (TO)
f=150
TT=2400.08
T1=2195.56
SAT (TO)
f=150
TT=2400.1
T1=2189.01
SAT (TO)
f=150
TT=2400.02
T1=2204.39
OPT
f=122
TT=389.928
T1=389.88
TravellingSalesman/
TravellingSalesman-m1-n20/
TravellingSalesman-20-30-05.xml
OPT
f=114
TT=740.811
T1=96.59
SAT (TO)
f=151
TT=2400.12
T1=2392.39
SAT (TO)
f=151
TT=2400.06
T1=2373.65
SAT (TO)
f=151
TT=2400.04
T1=2363.43
OPT
f=114
TT=740.811
T1=96.59
TravellingSalesman/
TravellingSalesman-m1-n20/
TravellingSalesman-20-30-14.xml
OPT
f=97
TT=258.185
T1=258.1
SAT (TO)
f=116
TT=2400.04
T1=2125.04
SAT (TO)
f=116
TT=2400.02
T1=2104.71
SAT (TO)
f=116
TT=2400.04
T1=2129.92
OPT
f=97
TT=258.185
T1=258.1
TravellingSalesman/
TravellingSalesman-m1-n25/
TravellingSalesman-25-30-01.xml
OPT
f=111
TT=478.215
T1=478.14
SAT (TO)
f=169
TT=2400.09
T1=2364.48
SAT (TO)
f=169
TT=2400.08
T1=2349.37
SAT (TO)
f=169
TT=2400.02
T1=2354.11
OPT
f=111
TT=478.215
T1=478.14
TravellingSalesman/
TravellingSalesman-m1-n30/
TravellingSalesman-30-30-10.xml
SAT TO
f=225
TT=2400.01
T1=2348.61
SAT (TO)
f=225
TT=2400.08
T1=2354.46
SAT (TO)
f=225
TT=2400.03
T1=2348.61
SAT (TO)
f=225
TT=2400.01
T1=2352.6
? (TO)

TT=2400.02

TravellingSalesman/
TravellingSalesman-m1-n40/
TravellingSalesman-40-30-06.xml
SAT TO
f=373
TT=2400.01
T1=1383.06
SAT (TO)
f=373
TT=2400.08
T1=1391.27
SAT (TO)
f=373
TT=2400.01
T1=1383.06
SAT (TO)
f=373
TT=2400.02
T1=1393.12
? (TO)

TT=2400.04

TravellingSalesman/
TravellingSalesman-m1-n40/
TravellingSalesman-40-30-12.xml
SAT TO
f=315
TT=2400.01
T1=22.59
SAT (TO)
f=315
TT=2400.03
T1=22.59
SAT (TO)
f=315
TT=2400.01
T1=25.79
SAT (TO)
f=315
TT=2400.01
T1=22.69
? (TO)

TT=2400.01

TravellingSalesman/
TravellingSalesman-m1-n45/
TravellingSalesman-45-30-01.xml
SAT TO
f=330
TT=2400.02
T1=1726.08
SAT (TO)
f=330
TT=2400.03
T1=1734.65
SAT (TO)
f=330
TT=2400.09
T1=1726.08
SAT (TO)
f=330
TT=2400.02
T1=1728.62
? (TO)

TT=2400.05

TravellingSalesman/
TravellingSalesman-m1-n45/
TravellingSalesman-45-30-17.xml
SAT TO
f=298
TT=2400.03
T1=2328.41
SAT (TO)
f=298
TT=2400.07
T1=2349.96
SAT (TO)
f=298
TT=2400.03
T1=2340.73
SAT (TO)
f=298
TT=2400.03
T1=2328.41
? (TO)

TT=2400.02

TravellingSalesman/
TravellingSalesman-m1-n50/
TravellingSalesman-50-30-04.xml
SAT TO
f=344
TT=2400.04
T1=874.97
SAT (TO)
f=344
TT=2400.1
T1=883.51
SAT (TO)
f=344
TT=2400.04
T1=874.97
SAT (TO)
f=344
TT=2400.05
T1=878.53
? (TO)

TT=2400.08




Statisticscosoco
2
(complete)
cosoco
2.0
(complete)
cosoco
2.0
(complete)
(reference) PicatSAT
2019-09-12
(complete)
Number of times the solver is able to give the best known answer141141140136
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
65715469