2018 XCSP3 competition: mini-solvers track: benchmarks results per solver
Result page for solver miniBTD
2018.07.27_3
(complete)
Category "decision problem" (CSP)
Solver proved unsatisfiability (UNSATISFIABLE) (44 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
Haystacks/
Haystacks-ext-04_c18.xml
UNSAT
0.004232
0.0050009
4301173
Dubois/
Dubois-018_c18.xml
UNSAT
0.005911
0.00662004
4301055
Dubois/
Dubois-020_c18.xml
UNSAT
0.006227
0.00694391
4301056
Haystacks/
Haystacks-ext-05_c18.xml
UNSAT
0.00639
0.00709305
4301174
Dubois/
Dubois-022_c18.xml
UNSAT
0.006395
0.00703106
4301058
Dubois/
Dubois-021_c18.xml
UNSAT
0.006495
0.00710304
4301057
Dubois/
Dubois-023_c18.xml
UNSAT
0.00667
0.0074451
4301059
Dubois/
Dubois-025_c18.xml
UNSAT
0.006859
0.00758288
4301061
Dubois/
Dubois-024_c18.xml
UNSAT
0.006869
0.00748204
4301060
Dubois/
Dubois-030_c18.xml
UNSAT
0.007704
0.00870911
4301062
Haystacks/
Haystacks-ext-06_c18.xml
UNSAT
0.00896
0.00974903
4301175
Dubois/
Dubois-040_c18.xml
UNSAT
0.009522
0.0101001
4301063
Dubois/
Dubois-050_c18.xml
UNSAT
0.011968
0.012648
4301064
Dubois/
Dubois-075_c18.xml
UNSAT
0.018123
0.0187721
4301065
Dubois/
Dubois-100_c18.xml
UNSAT
0.02538
0.026208
4301066
Haystacks/
Haystacks-ext-07_c18.xml
UNSAT
0.035583
0.0366889
4301176
Haystacks/
Haystacks-ext-08_c18.xml
UNSAT
0.228991
0.230211
4301177
Langford/
LangfordBin-06_c18.xml
UNSAT
0.236967
0.237778
4301044
ColouredQueens/
ColouredQueens-06_c18.xml
UNSAT
0.666306
0.672298
4301033
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f10_c18.xml
UNSAT
0.666444
0.667285
4301197
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f12_c18.xml
UNSAT
0.75096
0.754751
4301203
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f11_c18.xml
UNSAT
0.761584
0.766743
4301205
Quasigroups_mini/
QuasiGroup-v7-07_mini_c18.xml
UNSAT
0.943598
0.944193
4301112
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f09_c18.xml
UNSAT
1.72457
1.72573
4301204
Haystacks/
Haystacks-ext-09_c18.xml
UNSAT
1.89413
1.8951
4301178
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f08_c18.xml
UNSAT
2.17015
2.17141
4301206
Subisomorphism/
Subisomorphism-g34-g36_c18.xml
UNSAT
3.50068
3.50236
4301130
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f07_c18.xml
UNSAT
7.97542
7.97652
4301196
Quasigroups_mini/
QuasiGroup-v4-07_mini_c18.xml
UNSAT
8.6404
8.64134
4301104
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f06_c18.xml
UNSAT
12.2503
12.2527
4301200
Haystacks/
Haystacks-ext-10_c18.xml
UNSAT
17.7585
17.7592
4301179
Quasigroups_mini/
QuasiGroup-v7-08_mini_c18.xml
UNSAT
42.4206
42.4192
4301113
Subisomorphism/
Subisomorphism-g17-g42_c18.xml
UNSAT
45.8848
45.8932
4301126
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f05_c18.xml
UNSAT
56.6956
56.7171
4301199
Haystacks/
Haystacks-ext-11_c18.xml
UNSAT
197.639
197.643
4301180
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f04_c18.xml
UNSAT
230.645
230.674
4301198
Subisomorphism/
Subisomorphism-g11-g30_c18.xml
UNSAT
292.707
292.707
4301123
MagicHexagon/
MagicHexagon-04-0017_c18.xml
UNSAT
356.449
356.443
4301068
Crossword/
Crossword-m18-ogd2008-vg-16-17_c18.xml
UNSAT
369.771
369.756
4301172
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f03_c18.xml
UNSAT
908.285
908.279
4301195
Subisomorphism/
Subisomorphism-g11-g44_c18.xml
UNSAT
1228.13
1228.05
4301124
Quasigroups_mini/
QuasiGroup-v4-08_mini_c18.xml
UNSAT
1807.25
1807.2
4301105
Haystacks/
Haystacks-ext-12_c18.xml
UNSAT
2367.8
2367.74
4301181
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f02_c18.xml
UNSAT
2473.79
2473.76
4301202
Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (33 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
ColouredQueens/
ColouredQueens-05_c18.xml
SAT
0.003844
0.0047789
4301032
Eternity/
Eternity-04-04_c18.xml
SAT
0.0085
0.00923103
4301078
MagicSquare/
MagicSquare-04-sum_c18.xml
SAT
0.009964
0.0107151
4301147
ColouredQueens/
ColouredQueens-07_c18.xml
SAT
0.013973
0.0146889
4301034
GracefulGraph/
GracefulGraph-K03-P03_c18.xml
SAT
0.014443
0.0149169
4301094
Crossword/
Crossword-m18-ogd2008-vg-04-05_c18.xml
SAT
0.044886
0.0450529
4301160
Eternity/
Eternity-05-05_c18.xml
SAT
0.090708
0.0917969
4301079
Crossword/
Crossword-m18-ogd2008-vg-05-06_c18.xml
SAT
0.121011
0.125925
4301161
Langford/
LangfordBin-07_c18.xml
SAT
0.160988
0.161356
4301045
Crossword/
Crossword-m18-ogd2008-vg-06-07_c18.xml
SAT
0.278967
0.278919
4301162
Frb/
frb-30-15-1_c18.xml
SAT
0.360068
0.361189
4301131
GracefulGraph/
GracefulGraph-K04-P02_c18.xml
SAT
0.399637
0.400553
4301095
MagicSquare/
MagicSquare-05-sum_c18.xml
SAT
0.970351
1.00832
4301148
Quasigroups_mini/
QuasiGroup-v4-09_mini_c18.xml
SAT
1.06121
1.0626
4301106
GracefulGraph/
GracefulGraph-K02-P09_c18.xml
SAT
1.17044
1.17156
4301093
Subisomorphism/
Subisomorphism-g08-g43_c18.xml
SAT
1.30732
1.30831
4301120
PseudoBoolean-dec/
Pb-robin08_c18.xml
SAT
2.34873
2.3502
4301190
Eternity/
Eternity-10-04_c18.xml
SAT
2.38702
2.38799
4301084
Langford/
LangfordBin-08_c18.xml
SAT
3.32349
3.32448
4301046
Eternity/
Eternity-06-06_c18.xml
SAT
4.37464
4.37641
4301080
Frb/
frb-35-17-1_c18.xml
SAT
7.11843
7.12086
4301132
Quasigroups_mini/
QuasiGroup-v7-09_mini_c18.xml
SAT
12.2612
12.2619
4301114
PseudoBoolean-dec/
Pb-robin10_c18.xml
SAT
23.449
23.4567
4301191
Frb/
frb-40-19-1-mgd_c18.xml
SAT
26.6757
26.6748
4301133
Crossword/
Crossword-m18-ogd2008-vg-07-08_c18.xml
SAT
41.9072
41.9146
4301163
MagicHexagon/
MagicHexagon-04-0003_c18.xml
SAT
42.9984
43.0091
4301067
MagicHexagon/
MagicHexagon-04-m004_c18.xml
SAT
274.47
274.512
4301069
GracefulGraph/
GracefulGraph-K04-P03_c18.xml
SAT
438.893
438.907
4301096
GracefulGraph/
GracefulGraph-K05-P02_c18.xml
SAT
451.632
451.646
4301098
Eternity/
Eternity-07-07_c18.xml
SAT
454.314
454.283
4301081
Eternity/
Eternity-10-05_c18.xml
SAT
1818.88
1818.93
4301085
GracefulGraph/
GracefulGraph-K04-P04_c18.xml
SAT
2104.75
2104.69
4301097
Subisomorphism/
Subisomorphism-g17-g37_c18.xml
SAT
2422.5
2422.44
4301125
Solver didn't decide (UNKNOWN) (31 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
Langford/
LangfordBin-12_c18.xml
?
2520
2519.93
4301050
Langford/
LangfordBin-15_c18.xml
?
2520
2519.92
4301053
Langford/
LangfordBin-10_c18.xml
?
2520
2519.95
4301048
ColouredQueens/
ColouredQueens-15_c18.xml
?
2520
2519.97
4301042
Langford/
LangfordBin-11_c18.xml
?
2520
2519.83
4301049
ColouredQueens/
ColouredQueens-14_c18.xml
?
2520
2519.95
4301041
PseudoBoolean-dec/
Pb-chnl10-11_c18.xml
?
2520
2519.95
4301183
GracefulGraph/
GracefulGraph-K06-P02_c18.xml
?
2520
2519.92
4301100
GracefulGraph/
GracefulGraph-K05-P03_c18.xml
?
2520
2519.94
4301099
ColouredQueens/
ColouredQueens-08_c18.xml
?
2520.01
2519.81
4301035
Langford/
LangfordBin-16_c18.xml
?
2520.01
2519.98
4301054
Haystacks/
Haystacks-ext-13_c18.xml
?
2520.01
2519.95
4301182
Subisomorphism/
Subisomorphism-g10-g27_c18.xml
?
2520.01
2519.94
4301122
PseudoBoolean-dec/
Pb-chnl15-16_c18.xml
?
2520.01
2519.92
4301184
ColouredQueens/
ColouredQueens-09_c18.xml
?
2520.01
2519.98
4301036
Quasigroups_mini/
QuasiGroup-v7-12_mini_c18.xml
?
2520.02
2519.97
4301116
Eternity/
Eternity-08-08_c18.xml
?
2520.02
2519.98
4301082
GracefulGraph/
GracefulGraph-K06-P03_c18.xml
?
2520.02
2519.96
4301101
Subisomorphism/
Subisomorphism-g10-g23_c18.xml
?
2520.02
2519.97
4301121
Quasigroups_mini/
QuasiGroup-v4-10_mini_c18.xml
?
2520.03
2519.95
4301107
Eternity/
Eternity-10-06_c18.xml
?
2520.03
2519.96
4301086
Quasigroups_mini/
QuasiGroup-v7-14_mini_c18.xml
?
2520.03
2519.83
4301117
Frb/
frb-50-23-2-mgd_c18.xml
?
2520.04
2519.97
4301136
Frb/
frb-53-24-1-mgd_c18.xml
?
2520.05
2520.01
4301138
Frb/
frb-50-23-1-mgd_c18.xml
?
2520.05
2520
4301135
Frb/
frb-50-23-3-mgd_c18.xml
?
2520.05
2519.87
4301137
Eternity/
Eternity-10-10_c18.xml
?
2520.06
2519.98
4301087
Frb/
frb-53-24-3-mgd_c18.xml
?
2520.06
2519.89
4301140
Frb/
frb-53-24-2-mgd_c18.xml
?
2520.06
2520.01
4301139
Frb/
frb-56-25-3-mgd_c18.xml
?
2520.07
2519.88
4301143
Subisomorphism/
Subisomorphism-g19-g43_c18.xml
?
2520.07
2519.89
4301127
Solver timed out (no solution given) (68 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
PseudoBoolean-dec/
Pb-chnl20-21_c18.xml
? (TO)
2519.61
2520.01
4301185
ColouredQueens/
ColouredQueens-12_c18.xml
? (TO)
2519.66
2520.01
4301039
ColouredQueens/
ColouredQueens-10_c18.xml
? (TO)
2519.71
2520.01
4301037
MagicSquare/
MagicSquare-16-sum_c18.xml
? (TO)
2519.73
2520.01
4301159
Quasigroups_mini/
QuasiGroup-v4-20_mini_c18.xml
? (TO)
2519.74
2520
4301111
Quasigroups_mini/
QuasiGroup-v7-20_mini_c18.xml
? (TO)
2519.76
2520.01
4301119
Crossword/
Crossword-m18-ogd2008-vg-13-14_c18.xml
? (TO)
2519.87
2520.01
4301169
Crossword/
Crossword-m18-ogd2008-vg-08-09_c18.xml
? (TO)
2519.89
2520.01
4301164
MagicSquare/
MagicSquare-06-sum_c18.xml
? (TO)
2519.89
2520.01
4301149
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f01_c18.xml
? (TO)
2519.9
2520.01
4301201
Eternity/
Eternity-13-13_c18.xml
? (TO)
2519.91
2520.01
4301090
Eternity/
Eternity-09-09_c18.xml
? (TO)
2519.92
2520.01
4301083
PseudoBoolean-dec/
Pb-robin12_c18.xml
? (TO)
2519.92
2520.01
4301192
Quasigroups_mini/
QuasiGroup-v7-10_mini_c18.xml
? (TO)
2519.92
2520.01
4301115
Langford/
LangfordBin-14_c18.xml
? (TO)
2519.92
2520.01
4301052
PseudoBoolean-dec/
Pb-chnl50-51_c18.xml
? (TO)
2519.92
2520.01
4301187
ColouredQueens/
ColouredQueens-11_c18.xml
? (TO)
2519.93
2520.01
4301038
PseudoBoolean-dec/
Pb-robin18_c18.xml
? (TO)
2519.93
2520.01
4301031
Quasigroups_mini/
QuasiGroup-v7-16_mini_c18.xml
? (TO)
2519.94
2520.01
4301118
ColouredQueens/
ColouredQueens-16_c18.xml
? (TO)
2519.94
2520.01
4301043
PseudoBoolean-dec/
Pb-chnl30-31_c18.xml
? (TO)
2519.94
2520.01
4301186
Langford/
LangfordBin-13_c18.xml
? (TO)
2519.94
2520.01
4301051
GracefulGraph/
GracefulGraph-K07-P02_c18.xml
? (TO)
2519.95
2520.01
4301102
GracefulGraph/
GracefulGraph-K07-P03_c18.xml
? (TO)
2519.95
2520.01
4301103
Subisomorphism/
Subisomorphism-g29-g50_c18.xml
? (TO)
2519.95
2520.01
4301129
ColouredQueens/
ColouredQueens-13_c18.xml
? (TO)
2519.96
2520.01
4301040
Langford/
LangfordBin-09_c18.xml
? (TO)
2519.96
2520.01
4301047
Crossword/
Crossword-m18-ogd2008-vg-10-11_c18.xml
? (TO)
2520
2520.01
4301166
MagicHexagon/
MagicHexagon-05-0006_c18.xml
? (TO)
2520.01
2520.01
4301070
PseudoBoolean-dec/
Pb-fpga45-45-sat_c18.xml
? (TO)
2520.02
2520.01
4301189
Crossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
? (TO)
2520.02
2520.01
4301167
Crossword/
Crossword-m18-ogd2008-vg-15-16_c18.xml
? (TO)
2520.03
2520.01
4301171
Frb/
frb-45-21-1_c18.xml
? (TO)
2520.03
2520.01
4301134
PseudoBoolean-dec/
Pb-robin16_c18.xml
? (TO)
2520.03
2520.01
4301194
Frb/
frb-56-25-1-mgd_c18.xml
? (TO)
2520.04
2520.01
4301141
Subisomorphism/
Subisomorphism-g19-g45_c18.xml
? (TO)
2520.04
2520.01
4301128
MagicSquare/
MagicSquare-14-sum_c18.xml
? (TO)
2520.04
2520.01
4301157
Frb/
frb-59-26-1-mgd_c18.xml
? (TO)
2520.04
2520.01
4301144
Crossword/
Crossword-m18-ogd2008-vg-12-13_c18.xml
? (TO)
2520.04
2520.01
4301168
Quasigroups_mini/
QuasiGroup-v4-14_mini_c18.xml
? (TO)
2520.05
2520.01
4301109
Eternity/
Eternity-11-11_c18.xml
? (TO)
2520.05
2520.01
4301088
PseudoBoolean-dec/
Pb-robin14_c18.xml
? (TO)
2520.06
2519.9
4301193
MagicSquare/
MagicSquare-13-sum_c18.xml
? (TO)
2520.06
2520.01
4301156
MagicHexagon/
MagicHexagon-07-m011_c18.xml
? (TO)
2520.06
2520.01
4301075
MagicHexagon/
MagicHexagon-06-m001_c18.xml
? (TO)
2520.06
2520.01
4301073
Eternity/
Eternity-12-12_c18.xml
? (TO)
2520.06
2520.01
4301089
Crossword/
Crossword-m18-ogd2008-vg-14-15_c18.xml
? (TO)
2520.06
2519.9
4301170
MagicSquare/
MagicSquare-10-sum_c18.xml
? (TO)
2520.06
2520.01
4301153
Frb/
frb-59-26-2-mgd_c18.xml
? (TO)
2520.06
2520.01
4301145
Crossword/
Crossword-m18-ogd2008-vg-09-10_c18.xml
? (TO)
2520.06
2520.01
4301165
Eternity/
Eternity-14-14_c18.xml
? (TO)
2520.06
2520.01
4301091
Eternity/
Eternity-15-15_c18.xml
? (TO)
2520.06
2519.9
4301092
MagicHexagon/
MagicHexagon-08-0006_c18.xml
? (TO)
2520.07
2520.01
4301076
MagicSquare/
MagicSquare-15-sum_c18.xml
? (TO)
2520.07
2520.01
4301158
Quasigroups_mini/
QuasiGroup-v4-12_mini_c18.xml
? (TO)
2520.07
2520.01
4301108
Frb/
frb-59-26-3-mgd_c18.xml
? (TO)
2520.07
2520.01
4301146
MagicHexagon/
MagicHexagon-07-0002_c18.xml
? (TO)
2520.07
2520.01
4301074
Frb/
frb-56-25-2-mgd_c18.xml
? (TO)
2520.07
2520.01
4301142
MagicSquare/
MagicSquare-12-sum_c18.xml
? (TO)
2520.07
2520.01
4301155
MagicSquare/
MagicSquare-09-sum_c18.xml
? (TO)
2520.08
2520.01
4301152
MagicHexagon/
MagicHexagon-05-m003_c18.xml
? (TO)
2520.08
2520.01
4301071
Quasigroups_mini/
QuasiGroup-v4-16_mini_c18.xml
? (TO)
2520.08
2519.9
4301110
MagicSquare/
MagicSquare-11-sum_c18.xml
? (TO)
2520.09
2519.9
4301154
PseudoBoolean-dec/
Pb-fpga25-25-sat_c18.xml
? (TO)
2520.09
2520.01
4301188
MagicSquare/
MagicSquare-07-sum_c18.xml
? (TO)
2520.1
2520.01
4301150
MagicHexagon/
MagicHexagon-06-0010_c18.xml
? (TO)
2520.1
2519.9
4301072
MagicSquare/
MagicSquare-08-sum_c18.xml
? (TO)
2520.1
2519.9
4301151
MagicHexagon/
MagicHexagon-08-m009_c18.xml
? (TO)
2520.1
2519.9
4301077