2018 XCSP3 competition: mini-solvers track: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.003967	0.00448988	4300997
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.00499	0.00593809	4300998
Dubois/ Dubois-018_c18.xml	UNSAT	0.005881	0.00662109	4300879
Dubois/ Dubois-020_c18.xml	UNSAT	0.006307	0.00704302	4300880
Dubois/ Dubois-021_c18.xml	UNSAT	0.006767	0.0075019	4300881
Dubois/ Dubois-022_c18.xml	UNSAT	0.006798	0.00722692	4300882
Dubois/ Dubois-025_c18.xml	UNSAT	0.007141	0.00778706	4300885
Dubois/ Dubois-023_c18.xml	UNSAT	0.007149	0.0077769	4300883
Dubois/ Dubois-024_c18.xml	UNSAT	0.007728	0.00829505	4300884
Dubois/ Dubois-030_c18.xml	UNSAT	0.007815	0.00846998	4300886
Dubois/ Dubois-040_c18.xml	UNSAT	0.009642	0.0104489	4300887
Dubois/ Dubois-050_c18.xml	UNSAT	0.012434	0.013291	4300888
Haystacks/ Haystacks-ext-06_c18.xml	UNSAT	0.012475	0.01309	4300999
Dubois/ Dubois-075_c18.xml	UNSAT	0.018862	0.0196609	4300889
Dubois/ Dubois-100_c18.xml	UNSAT	0.026228	0.026918	4300890
Haystacks/ Haystacks-ext-07_c18.xml	UNSAT	0.037916	0.0379011	4301000
Langford/ LangfordBin-06_c18.xml	UNSAT	0.223411	0.223931	4300868
Haystacks/ Haystacks-ext-08_c18.xml	UNSAT	0.231564	0.236578	4301001
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f12_c18.xml	UNSAT	0.478995	0.479632	4301027
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f11_c18.xml	UNSAT	0.491031	0.49213	4301029
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f10_c18.xml	UNSAT	0.646437	0.647067	4301021
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f09_c18.xml	UNSAT	0.756679	0.781827	4301028
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.950512	0.953709	4300857
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f08_c18.xml	UNSAT	1.05344	1.07463	4301030
Haystacks/ Haystacks-ext-09_c18.xml	UNSAT	1.99503	1.99697	4301002
Quasigroups_mini/ QuasiGroup-v7-07_mini_c18.xml	UNSAT	3.00038	3.00788	4300936
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f07_c18.xml	UNSAT	4.40572	4.41122	4301020
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	4.42166	4.42287	4300954
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f06_c18.xml	UNSAT	10.775	10.7752	4301024
Quasigroups_mini/ QuasiGroup-v4-07_mini_c18.xml	UNSAT	16.4858	16.4856	4300928
Haystacks/ Haystacks-ext-10_c18.xml	UNSAT	19.2083	19.2116	4301003
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f05_c18.xml	UNSAT	49.8877	49.8946	4301023
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT	92.4592	92.4706	4300945
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	126.159	126.169	4300950
Haystacks/ Haystacks-ext-11_c18.xml	UNSAT	207.7	207.718	4301004
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	215.334	215.357	4300892
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f04_c18.xml	UNSAT	223.471	223.508	4301022
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	426.292	426.348	4300947
Quasigroups_mini/ QuasiGroup-v4-08_mini_c18.xml	UNSAT	516.879	516.886	4300929
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	640.896	640.945	4300996
Quasigroups_mini/ QuasiGroup-v7-08_mini_c18.xml	UNSAT	767.325	767.272	4300937
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f03_c18.xml	UNSAT	910.067	910.02	4301019
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1308.78	1308.93	4300948

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.00403	0.00504996	4300856
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.005023	0.00582494	4300858
Eternity/ Eternity-04-04_c18.xml	SAT	0.007095	0.00780492	4300902
MagicSquare/ MagicSquare-04-sum_c18.xml	SAT	0.007112	0.00737108	4300971
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.009483	0.00984789	4300918
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	0.021478	0.022276	4300917
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.0441	0.0453159	4300984
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.059962	0.0604059	4300919
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.120232	0.121373	4300985
Eternity/ Eternity-05-05_c18.xml	SAT	0.121587	0.122112	4300903
Langford/ LangfordBin-07_c18.xml	SAT	0.159453	0.160174	4300869
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT	0.239595	0.240398	4301012
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.270002	0.270666	4300986
MagicSquare/ MagicSquare-05-sum_c18.xml	SAT	0.295931	0.297233	4300972
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	0.35925	0.364721	4301014
Eternity/ Eternity-06-06_c18.xml	SAT	0.729172	0.730013	4300904
Quasigroups_mini/ QuasiGroup-v4-09_mini_c18.xml	SAT	0.744985	0.750081	4300930
Frb/ frb-30-15-1_c18.xml	SAT	0.884534	0.885437	4300955
Quasigroups_mini/ QuasiGroup-v7-09_mini_c18.xml	SAT	1.478	1.47908	4300938
Langford/ LangfordBin-08_c18.xml	SAT	2.58914	2.59038	4300870
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	3.69579	3.69658	4300944
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT	4.20498	4.20762	4301013
Eternity/ Eternity-10-04_c18.xml	SAT	4.69024	4.69159	4300908
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	5.39913	5.40475	4300920
Eternity/ Eternity-07-07_c18.xml	SAT	11.6944	11.7011	4300905
Frb/ frb-35-17-1_c18.xml	SAT	12.001	12.0029	4300956
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	37.8631	37.8643	4300891
Eternity/ Eternity-10-05_c18.xml	SAT	43.6918	43.6954	4300909
Frb/ frb-40-19-1-mgd_c18.xml	SAT	49.8847	49.8883	4300957
MagicSquare/ MagicSquare-06-sum_c18.xml	SAT	55.9655	55.9682	4300973
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	86.3015	86.302	4300922
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	96.4929	96.4916	4301015
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	183.111	183.113	4300893
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	425.388	425.417	4300921
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	721.102	721.115	4300987
MagicSquare/ MagicSquare-07-sum_c18.xml	SAT	2234.36	2234.31	4300974

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-10_c18.xml	?	2520	2519.83	4300861
ColouredQueens/ ColouredQueens-14_c18.xml	?	2520	2519.93	4300865
ColouredQueens/ ColouredQueens-12_c18.xml	?	2520	2519.93	4300863
Langford/ LangfordBin-09_c18.xml	?	2520	2520.01	4300871
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	?	2520	2519.89	4301007
Quasigroups_mini/ QuasiGroup-v7-10_mini_c18.xml	?	2520.01	2519.89	4300939
ColouredQueens/ ColouredQueens-16_c18.xml	?	2520.01	2520	4300867
Langford/ LangfordBin-12_c18.xml	?	2520.01	2519.82	4300874
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	?	2520.01	2519.84	4300923
Langford/ LangfordBin-10_c18.xml	?	2520.01	2519.97	4300872
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	?	2520.02	2519.95	4300926
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	?	2520.02	2519.83	4300925
Frb/ frb-50-23-2-mgd_c18.xml	?	2520.04	2520	4300960
Quasigroups_mini/ QuasiGroup-v7-16_mini_c18.xml	?	2520.04	2520	4300942
Eternity/ Eternity-09-09_c18.xml	?	2520.04	2519.98	4300907
Frb/ frb-50-23-1-mgd_c18.xml	?	2520.05	2519.88	4300959
Frb/ frb-53-24-3-mgd_c18.xml	?	2520.06	2519.89	4300964
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	?	2520.06	2519.88	4300952
Frb/ frb-59-26-2-mgd_c18.xml	?	2520.08	2519.88	4300969

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.64	2520.01	4300990
Quasigroups_mini/ QuasiGroup-v7-12_mini_c18.xml	? (TO)	2519.68	2520.01	4300940
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	? (TO)	2519.72	2520.01	4300949
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	? (TO)	2519.73	2520.01	4301010
Eternity/ Eternity-12-12_c18.xml	? (TO)	2519.73	2520.01	4300913
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2519.73	2520.01	4300927
Eternity/ Eternity-10-06_c18.xml	? (TO)	2519.74	2520.01	4300910
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2519.75	2520.01	4300961
Quasigroups_mini/ QuasiGroup-v4-20_mini_c18.xml	? (TO)	2519.75	2520.01	4300935
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2519.76	2520.01	4300953
Langford/ LangfordBin-15_c18.xml	? (TO)	2519.77	2520.01	4300877
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2519.77	2520	4300989
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.78	2520	4300862
Quasigroups_mini/ QuasiGroup-v4-14_mini_c18.xml	? (TO)	2519.79	2520.01	4300933
Eternity/ Eternity-14-14_c18.xml	? (TO)	2519.79	2520.01	4300915
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2519.8	2520.01	4301011
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2519.81	2520.01	4300900
ColouredQueens/ ColouredQueens-15_c18.xml	? (TO)	2519.82	2520.01	4300866
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2519.82	2520.01	4300966
Langford/ LangfordBin-13_c18.xml	? (TO)	2519.83	2520.01	4300875
Frb/ frb-53-24-2-mgd_c18.xml	? (TO)	2519.83	2520.01	4300963
Haystacks/ Haystacks-ext-12_c18.xml	? (TO)	2519.84	2520.01	4301005
Langford/ LangfordBin-11_c18.xml	? (TO)	2519.86	2520.01	4300873
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2519.88	2520.01	4300896
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.89	2520.01	4300859
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.89	2520.01	4300988
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2519.9	2520.01	4301017
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f02_c18.xml	? (TO)	2519.9	2520.01	4301026
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2519.91	2520.01	4300967
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2519.91	2520.01	4300962
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	? (TO)	2519.91	2520.01	4300946
Quasigroups_mini/ QuasiGroup-v7-20_mini_c18.xml	? (TO)	2519.91	2520.01	4300943
Langford/ LangfordBin-16_c18.xml	? (TO)	2519.91	2520.01	4300878
ColouredQueens/ ColouredQueens-09_c18.xml	? (TO)	2519.91	2520	4300860
ColouredQueens/ ColouredQueens-13_c18.xml	? (TO)	2519.91	2520.01	4300864
MagicSquare/ MagicSquare-09-sum_c18.xml	? (TO)	2519.92	2520.01	4300976
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.92	2520.01	4300992
Eternity/ Eternity-08-08_c18.xml	? (TO)	2519.93	2520.01	4300906
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.93	2520.01	4301009
MagicSquare/ MagicSquare-15-sum_c18.xml	? (TO)	2519.93	2520.01	4300982
MagicSquare/ MagicSquare-14-sum_c18.xml	? (TO)	2519.94	2520.01	4300981
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2519.94	2520.01	4300897
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2519.94	2520.01	4300899
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2519.96	2520.01	4300995
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.97	2520.01	4301018
Quasigroups_mini/ QuasiGroup-v4-12_mini_c18.xml	? (TO)	2519.97	2520.01	4300932
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.97	2520.01	4300924
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2519.98	2520.01	4300901
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2519.98	2520.01	4300991
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2519.98	2520.01	4300965
Eternity/ Eternity-11-11_c18.xml	? (TO)	2519.98	2520.01	4300912
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	? (TO)	2519.99	2520.01	4301008
Frb/ frb-45-21-1_c18.xml	? (TO)	2519.99	2520.01	4300958
Quasigroups_mini/ QuasiGroup-v4-16_mini_c18.xml	? (TO)	2519.99	2520.01	4300934
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f01_c18.xml	? (TO)	2520	2520.01	4301025
Quasigroups_mini/ QuasiGroup-v7-14_mini_c18.xml	? (TO)	2520.01	2520.01	4300941
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2520.01	2520.01	4300994
MagicSquare/ MagicSquare-08-sum_c18.xml	? (TO)	2520.01	2520.01	4300975
Langford/ LangfordBin-14_c18.xml	? (TO)	2520.01	2520.01	4300876
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2520.01	2520.01	4300968
Eternity/ Eternity-13-13_c18.xml	? (TO)	2520.01	2520.01	4300914
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2520.02	2519.9	4301006
MagicSquare/ MagicSquare-13-sum_c18.xml	? (TO)	2520.02	2520.01	4300980
Quasigroups_mini/ QuasiGroup-v4-10_mini_c18.xml	? (TO)	2520.03	2519.9	4300931
Eternity/ Eternity-15-15_c18.xml	? (TO)	2520.04	2519.9	4300916
Eternity/ Eternity-10-10_c18.xml	? (TO)	2520.05	2519.9	4300911
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2520.05	2520.01	4300855
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2520.06	2519.9	4300993
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2520.06	2519.9	4301016
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.07	2520.01	4300970
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2520.07	2520.01	4300951
MagicSquare/ MagicSquare-10-sum_c18.xml	? (TO)	2520.08	2519.9	4300977
MagicSquare/ MagicSquare-11-sum_c18.xml	? (TO)	2520.1	2520.01	4300978
MagicSquare/ MagicSquare-16-sum_c18.xml	? (TO)	2520.1	2519.9	4300983
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.1	2520.01	4300898
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2520.1	2519.9	4300894
MagicSquare/ MagicSquare-12-sum_c18.xml	? (TO)	2520.1	2519.9	4300979
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2520.1	2519.9	4300895

2018 XCSP3 competition: mini-solvers track: benchmarks results per solver

Result page for solver miniBTD_12 2018.07.27_12 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (43 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (36 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (19 runs) [Show/Hide]

Solver timed out (no solution given) (78 runs) [Show/Hide]