2018 XCSP3 competition: mini-solvers track: benchmarks results per solver
Result page for solver miniBTD_12
2018.07.27_12
(complete)
Category "decision problem" (CSP)
Solver proved unsatisfiability (UNSATISFIABLE) (43 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
Haystacks/
Haystacks-ext-04_c18.xml
UNSAT
0.003967
0.00448988
4300997
Haystacks/
Haystacks-ext-05_c18.xml
UNSAT
0.00499
0.00593809
4300998
Dubois/
Dubois-018_c18.xml
UNSAT
0.005881
0.00662109
4300879
Dubois/
Dubois-020_c18.xml
UNSAT
0.006307
0.00704302
4300880
Dubois/
Dubois-021_c18.xml
UNSAT
0.006767
0.0075019
4300881
Dubois/
Dubois-022_c18.xml
UNSAT
0.006798
0.00722692
4300882
Dubois/
Dubois-025_c18.xml
UNSAT
0.007141
0.00778706
4300885
Dubois/
Dubois-023_c18.xml
UNSAT
0.007149
0.0077769
4300883
Dubois/
Dubois-024_c18.xml
UNSAT
0.007728
0.00829505
4300884
Dubois/
Dubois-030_c18.xml
UNSAT
0.007815
0.00846998
4300886
Dubois/
Dubois-040_c18.xml
UNSAT
0.009642
0.0104489
4300887
Dubois/
Dubois-050_c18.xml
UNSAT
0.012434
0.013291
4300888
Haystacks/
Haystacks-ext-06_c18.xml
UNSAT
0.012475
0.01309
4300999
Dubois/
Dubois-075_c18.xml
UNSAT
0.018862
0.0196609
4300889
Dubois/
Dubois-100_c18.xml
UNSAT
0.026228
0.026918
4300890
Haystacks/
Haystacks-ext-07_c18.xml
UNSAT
0.037916
0.0379011
4301000
Langford/
LangfordBin-06_c18.xml
UNSAT
0.223411
0.223931
4300868
Haystacks/
Haystacks-ext-08_c18.xml
UNSAT
0.231564
0.236578
4301001
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f12_c18.xml
UNSAT
0.478995
0.479632
4301027
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f11_c18.xml
UNSAT
0.491031
0.49213
4301029
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f10_c18.xml
UNSAT
0.646437
0.647067
4301021
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f09_c18.xml
UNSAT
0.756679
0.781827
4301028
ColouredQueens/
ColouredQueens-06_c18.xml
UNSAT
0.950512
0.953709
4300857
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f08_c18.xml
UNSAT
1.05344
1.07463
4301030
Haystacks/
Haystacks-ext-09_c18.xml
UNSAT
1.99503
1.99697
4301002
Quasigroups_mini/
QuasiGroup-v7-07_mini_c18.xml
UNSAT
3.00038
3.00788
4300936
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f07_c18.xml
UNSAT
4.40572
4.41122
4301020
Subisomorphism/
Subisomorphism-g34-g36_c18.xml
UNSAT
4.42166
4.42287
4300954
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f06_c18.xml
UNSAT
10.775
10.7752
4301024
Quasigroups_mini/
QuasiGroup-v4-07_mini_c18.xml
UNSAT
16.4858
16.4856
4300928
Haystacks/
Haystacks-ext-10_c18.xml
UNSAT
19.2083
19.2116
4301003
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f05_c18.xml
UNSAT
49.8877
49.8946
4301023
Subisomorphism/
Subisomorphism-g10-g23_c18.xml
UNSAT
92.4592
92.4706
4300945
Subisomorphism/
Subisomorphism-g17-g42_c18.xml
UNSAT
126.159
126.169
4300950
Haystacks/
Haystacks-ext-11_c18.xml
UNSAT
207.7
207.718
4301004
MagicHexagon/
MagicHexagon-04-0017_c18.xml
UNSAT
215.334
215.357
4300892
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f04_c18.xml
UNSAT
223.471
223.508
4301022
Subisomorphism/
Subisomorphism-g11-g30_c18.xml
UNSAT
426.292
426.348
4300947
Quasigroups_mini/
QuasiGroup-v4-08_mini_c18.xml
UNSAT
516.879
516.886
4300929
Crossword/
Crossword-m18-ogd2008-vg-16-17_c18.xml
UNSAT
640.896
640.945
4300996
Quasigroups_mini/
QuasiGroup-v7-08_mini_c18.xml
UNSAT
767.325
767.272
4300937
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f03_c18.xml
UNSAT
910.067
910.02
4301019
Subisomorphism/
Subisomorphism-g11-g44_c18.xml
UNSAT
1308.78
1308.93
4300948
Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (36 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
ColouredQueens/
ColouredQueens-05_c18.xml
SAT
0.00403
0.00504996
4300856
ColouredQueens/
ColouredQueens-07_c18.xml
SAT
0.005023
0.00582494
4300858
Eternity/
Eternity-04-04_c18.xml
SAT
0.007095
0.00780492
4300902
MagicSquare/
MagicSquare-04-sum_c18.xml
SAT
0.007112
0.00737108
4300971
GracefulGraph/
GracefulGraph-K03-P03_c18.xml
SAT
0.009483
0.00984789
4300918
GracefulGraph/
GracefulGraph-K02-P09_c18.xml
SAT
0.021478
0.022276
4300917
Crossword/
Crossword-m18-ogd2008-vg-04-05_c18.xml
SAT
0.0441
0.0453159
4300984
GracefulGraph/
GracefulGraph-K04-P02_c18.xml
SAT
0.059962
0.0604059
4300919
Crossword/
Crossword-m18-ogd2008-vg-05-06_c18.xml
SAT
0.120232
0.121373
4300985
Eternity/
Eternity-05-05_c18.xml
SAT
0.121587
0.122112
4300903
Langford/
LangfordBin-07_c18.xml
SAT
0.159453
0.160174
4300869
PseudoBoolean-dec/
Pb-fpga25-25-sat_c18.xml
SAT
0.239595
0.240398
4301012
Crossword/
Crossword-m18-ogd2008-vg-06-07_c18.xml
SAT
0.270002
0.270666
4300986
MagicSquare/
MagicSquare-05-sum_c18.xml
SAT
0.295931
0.297233
4300972
PseudoBoolean-dec/
Pb-robin08_c18.xml
SAT
0.35925
0.364721
4301014
Eternity/
Eternity-06-06_c18.xml
SAT
0.729172
0.730013
4300904
Quasigroups_mini/
QuasiGroup-v4-09_mini_c18.xml
SAT
0.744985
0.750081
4300930
Frb/
frb-30-15-1_c18.xml
SAT
0.884534
0.885437
4300955
Quasigroups_mini/
QuasiGroup-v7-09_mini_c18.xml
SAT
1.478
1.47908
4300938
Langford/
LangfordBin-08_c18.xml
SAT
2.58914
2.59038
4300870
Subisomorphism/
Subisomorphism-g08-g43_c18.xml
SAT
3.69579
3.69658
4300944
PseudoBoolean-dec/
Pb-fpga45-45-sat_c18.xml
SAT
4.20498
4.20762
4301013
Eternity/
Eternity-10-04_c18.xml
SAT
4.69024
4.69159
4300908
GracefulGraph/
GracefulGraph-K04-P03_c18.xml
SAT
5.39913
5.40475
4300920
Eternity/
Eternity-07-07_c18.xml
SAT
11.6944
11.7011
4300905
Frb/
frb-35-17-1_c18.xml
SAT
12.001
12.0029
4300956
MagicHexagon/
MagicHexagon-04-0003_c18.xml
SAT
37.8631
37.8643
4300891
Eternity/
Eternity-10-05_c18.xml
SAT
43.6918
43.6954
4300909
Frb/
frb-40-19-1-mgd_c18.xml
SAT
49.8847
49.8883
4300957
MagicSquare/
MagicSquare-06-sum_c18.xml
SAT
55.9655
55.9682
4300973
GracefulGraph/
GracefulGraph-K05-P02_c18.xml
SAT
86.3015
86.302
4300922
PseudoBoolean-dec/
Pb-robin10_c18.xml
SAT
96.4929
96.4916
4301015
MagicHexagon/
MagicHexagon-04-m004_c18.xml
SAT
183.111
183.113
4300893
GracefulGraph/
GracefulGraph-K04-P04_c18.xml
SAT
425.388
425.417
4300921
Crossword/
Crossword-m18-ogd2008-vg-07-08_c18.xml
SAT
721.102
721.115
4300987
MagicSquare/
MagicSquare-07-sum_c18.xml
SAT
2234.36
2234.31
4300974
Solver didn't decide (UNKNOWN) (19 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
ColouredQueens/
ColouredQueens-10_c18.xml
?
2520
2519.83
4300861
ColouredQueens/
ColouredQueens-14_c18.xml
?
2520
2519.93
4300865
ColouredQueens/
ColouredQueens-12_c18.xml
?
2520
2519.93
4300863
Langford/
LangfordBin-09_c18.xml
?
2520
2520.01
4300871
PseudoBoolean-dec/
Pb-chnl10-11_c18.xml
?
2520
2519.89
4301007
Quasigroups_mini/
QuasiGroup-v7-10_mini_c18.xml
?
2520.01
2519.89
4300939
ColouredQueens/
ColouredQueens-16_c18.xml
?
2520.01
2520
4300867
Langford/
LangfordBin-12_c18.xml
?
2520.01
2519.82
4300874
GracefulGraph/
GracefulGraph-K05-P03_c18.xml
?
2520.01
2519.84
4300923
Langford/
LangfordBin-10_c18.xml
?
2520.01
2519.97
4300872
GracefulGraph/
GracefulGraph-K07-P02_c18.xml
?
2520.02
2519.95
4300926
GracefulGraph/
GracefulGraph-K06-P03_c18.xml
?
2520.02
2519.83
4300925
Frb/
frb-50-23-2-mgd_c18.xml
?
2520.04
2520
4300960
Quasigroups_mini/
QuasiGroup-v7-16_mini_c18.xml
?
2520.04
2520
4300942
Eternity/
Eternity-09-09_c18.xml
?
2520.04
2519.98
4300907
Frb/
frb-50-23-1-mgd_c18.xml
?
2520.05
2519.88
4300959
Frb/
frb-53-24-3-mgd_c18.xml
?
2520.06
2519.89
4300964
Subisomorphism/
Subisomorphism-g19-g45_c18.xml
?
2520.06
2519.88
4300952
Frb/
frb-59-26-2-mgd_c18.xml
?
2520.08
2519.88
4300969
Solver timed out (no solution given) (78 runs)
[Show/Hide]
Benchmark Name
Answer
objective function
CPU time
Wall clock time
TraceID
Crossword/
Crossword-m18-ogd2008-vg-10-11_c18.xml
? (TO)
2519.64
2520.01
4300990
Quasigroups_mini/
QuasiGroup-v7-12_mini_c18.xml
? (TO)
2519.68
2520.01
4300940
Subisomorphism/
Subisomorphism-g17-g37_c18.xml
? (TO)
2519.72
2520.01
4300949
PseudoBoolean-dec/
Pb-chnl30-31_c18.xml
? (TO)
2519.73
2520.01
4301010
Eternity/
Eternity-12-12_c18.xml
? (TO)
2519.73
2520.01
4300913
GracefulGraph/
GracefulGraph-K07-P03_c18.xml
? (TO)
2519.73
2520.01
4300927
Eternity/
Eternity-10-06_c18.xml
? (TO)
2519.74
2520.01
4300910
Frb/
frb-50-23-3-mgd_c18.xml
? (TO)
2519.75
2520.01
4300961
Quasigroups_mini/
QuasiGroup-v4-20_mini_c18.xml
? (TO)
2519.75
2520.01
4300935
Subisomorphism/
Subisomorphism-g29-g50_c18.xml
? (TO)
2519.76
2520.01
4300953
Langford/
LangfordBin-15_c18.xml
? (TO)
2519.77
2520.01
4300877
Crossword/
Crossword-m18-ogd2008-vg-09-10_c18.xml
? (TO)
2519.77
2520
4300989
ColouredQueens/
ColouredQueens-11_c18.xml
? (TO)
2519.78
2520
4300862
Quasigroups_mini/
QuasiGroup-v4-14_mini_c18.xml
? (TO)
2519.79
2520.01
4300933
Eternity/
Eternity-14-14_c18.xml
? (TO)
2519.79
2520.01
4300915
PseudoBoolean-dec/
Pb-chnl50-51_c18.xml
? (TO)
2519.8
2520.01
4301011
MagicHexagon/
MagicHexagon-08-0006_c18.xml
? (TO)
2519.81
2520.01
4300900
ColouredQueens/
ColouredQueens-15_c18.xml
? (TO)
2519.82
2520.01
4300866
Frb/
frb-56-25-2-mgd_c18.xml
? (TO)
2519.82
2520.01
4300966
Langford/
LangfordBin-13_c18.xml
? (TO)
2519.83
2520.01
4300875
Frb/
frb-53-24-2-mgd_c18.xml
? (TO)
2519.83
2520.01
4300963
Haystacks/
Haystacks-ext-12_c18.xml
? (TO)
2519.84
2520.01
4301005
Langford/
LangfordBin-11_c18.xml
? (TO)
2519.86
2520.01
4300873
MagicHexagon/
MagicHexagon-06-0010_c18.xml
? (TO)
2519.88
2520.01
4300896
ColouredQueens/
ColouredQueens-08_c18.xml
? (TO)
2519.89
2520.01
4300859
Crossword/
Crossword-m18-ogd2008-vg-08-09_c18.xml
? (TO)
2519.89
2520.01
4300988
PseudoBoolean-dec/
Pb-robin14_c18.xml
? (TO)
2519.9
2520.01
4301017
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f02_c18.xml
? (TO)
2519.9
2520.01
4301026
Frb/
frb-56-25-3-mgd_c18.xml
? (TO)
2519.91
2520.01
4300967
Frb/
frb-53-24-1-mgd_c18.xml
? (TO)
2519.91
2520.01
4300962
Subisomorphism/
Subisomorphism-g10-g27_c18.xml
? (TO)
2519.91
2520.01
4300946
Quasigroups_mini/
QuasiGroup-v7-20_mini_c18.xml
? (TO)
2519.91
2520.01
4300943
Langford/
LangfordBin-16_c18.xml
? (TO)
2519.91
2520.01
4300878
ColouredQueens/
ColouredQueens-09_c18.xml
? (TO)
2519.91
2520
4300860
ColouredQueens/
ColouredQueens-13_c18.xml
? (TO)
2519.91
2520.01
4300864
MagicSquare/
MagicSquare-09-sum_c18.xml
? (TO)
2519.92
2520.01
4300976
Crossword/
Crossword-m18-ogd2008-vg-12-13_c18.xml
? (TO)
2519.92
2520.01
4300992
Eternity/
Eternity-08-08_c18.xml
? (TO)
2519.93
2520.01
4300906
PseudoBoolean-dec/
Pb-chnl20-21_c18.xml
? (TO)
2519.93
2520.01
4301009
MagicSquare/
MagicSquare-15-sum_c18.xml
? (TO)
2519.93
2520.01
4300982
MagicSquare/
MagicSquare-14-sum_c18.xml
? (TO)
2519.94
2520.01
4300981
MagicHexagon/
MagicHexagon-06-m001_c18.xml
? (TO)
2519.94
2520.01
4300897
MagicHexagon/
MagicHexagon-07-m011_c18.xml
? (TO)
2519.94
2520.01
4300899
Crossword/
Crossword-m18-ogd2008-vg-15-16_c18.xml
? (TO)
2519.96
2520.01
4300995
PseudoBoolean-dec/
Pb-robin16_c18.xml
? (TO)
2519.97
2520.01
4301018
Quasigroups_mini/
QuasiGroup-v4-12_mini_c18.xml
? (TO)
2519.97
2520.01
4300932
GracefulGraph/
GracefulGraph-K06-P02_c18.xml
? (TO)
2519.97
2520.01
4300924
MagicHexagon/
MagicHexagon-08-m009_c18.xml
? (TO)
2519.98
2520.01
4300901
Crossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
? (TO)
2519.98
2520.01
4300991
Frb/
frb-56-25-1-mgd_c18.xml
? (TO)
2519.98
2520.01
4300965
Eternity/
Eternity-11-11_c18.xml
? (TO)
2519.98
2520.01
4300912
PseudoBoolean-dec/
Pb-chnl15-16_c18.xml
? (TO)
2519.99
2520.01
4301008
Frb/
frb-45-21-1_c18.xml
? (TO)
2519.99
2520.01
4300958
Quasigroups_mini/
QuasiGroup-v4-16_mini_c18.xml
? (TO)
2519.99
2520.01
4300934
Rlfap_mini/Rlfap-dec-scens11_mini/
Rlfap-ext-scen-11-f01_c18.xml
? (TO)
2520
2520.01
4301025
Quasigroups_mini/
QuasiGroup-v7-14_mini_c18.xml
? (TO)
2520.01
2520.01
4300941
Crossword/
Crossword-m18-ogd2008-vg-14-15_c18.xml
? (TO)
2520.01
2520.01
4300994
MagicSquare/
MagicSquare-08-sum_c18.xml
? (TO)
2520.01
2520.01
4300975
Langford/
LangfordBin-14_c18.xml
? (TO)
2520.01
2520.01
4300876
Frb/
frb-59-26-1-mgd_c18.xml
? (TO)
2520.01
2520.01
4300968
Eternity/
Eternity-13-13_c18.xml
? (TO)
2520.01
2520.01
4300914
Haystacks/
Haystacks-ext-13_c18.xml
? (TO)
2520.02
2519.9
4301006
MagicSquare/
MagicSquare-13-sum_c18.xml
? (TO)
2520.02
2520.01
4300980
Quasigroups_mini/
QuasiGroup-v4-10_mini_c18.xml
? (TO)
2520.03
2519.9
4300931
Eternity/
Eternity-15-15_c18.xml
? (TO)
2520.04
2519.9
4300916
Eternity/
Eternity-10-10_c18.xml
? (TO)
2520.05
2519.9
4300911
PseudoBoolean-dec/
Pb-robin18_c18.xml
? (TO)
2520.05
2520.01
4300855
Crossword/
Crossword-m18-ogd2008-vg-13-14_c18.xml
? (TO)
2520.06
2519.9
4300993
PseudoBoolean-dec/
Pb-robin12_c18.xml
? (TO)
2520.06
2519.9
4301016
Frb/
frb-59-26-3-mgd_c18.xml
? (TO)
2520.07
2520.01
4300970
Subisomorphism/
Subisomorphism-g19-g43_c18.xml
? (TO)
2520.07
2520.01
4300951
MagicSquare/
MagicSquare-10-sum_c18.xml
? (TO)
2520.08
2519.9
4300977
MagicSquare/
MagicSquare-11-sum_c18.xml
? (TO)
2520.1
2520.01
4300978
MagicSquare/
MagicSquare-16-sum_c18.xml
? (TO)
2520.1
2519.9
4300983
MagicHexagon/
MagicHexagon-07-0002_c18.xml
? (TO)
2520.1
2520.01
4300898
MagicHexagon/
MagicHexagon-05-0006_c18.xml
? (TO)
2520.1
2519.9
4300894
MagicSquare/
MagicSquare-12-sum_c18.xml
? (TO)
2520.1
2519.9
4300979
MagicHexagon/
MagicHexagon-05-m003_c18.xml
? (TO)
2520.1
2519.9
4300895