2018 XCSP3 competition: mini-solvers track: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.007089	0.00832306	4300821
Langford/ LangfordBin-06_c18.xml	UNSAT	0.203771	0.20486	4300692
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f12_c18.xml	UNSAT	0.612067	0.613741	4300851
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f11_c18.xml	UNSAT	0.619953	0.621486	4300853
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f10_c18.xml	UNSAT	0.637231	0.63804	4300845
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.671007	0.672187	4300822
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.878148	0.946665	4300681
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f09_c18.xml	UNSAT	1.01466	1.01581	4300852
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f08_c18.xml	UNSAT	1.49461	1.50019	4300854
Quasigroups_mini/ QuasiGroup-v4-07_mini_c18.xml	UNSAT	3.74642	3.7482	4300752
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	4.53501	4.53566	4300778
Quasigroups_mini/ QuasiGroup-v7-07_mini_c18.xml	UNSAT	5.31783	5.31927	4300760
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f07_c18.xml	UNSAT	7.65113	7.65275	4300844
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f06_c18.xml	UNSAT	14.4229	14.4275	4300848
Dubois/ Dubois-018_c18.xml	UNSAT	18.8356	18.8381	4300703
Dubois/ Dubois-020_c18.xml	UNSAT	53.5344	53.5359	4300704
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f05_c18.xml	UNSAT	64.3843	64.4008	4300847
Dubois/ Dubois-021_c18.xml	UNSAT	66.0777	66.0843	4300705
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT	90.3467	90.3512	4300769
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	129.415	129.423	4300774
Dubois/ Dubois-022_c18.xml	UNSAT	140.016	140.022	4300706
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	217.454	217.457	4300716
Dubois/ Dubois-023_c18.xml	UNSAT	325.883	325.891	4300707
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f04_c18.xml	UNSAT	330.11	330.125	4300846
Quasigroups_mini/ QuasiGroup-v4-08_mini_c18.xml	UNSAT	333.62	333.632	4300753
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	416.269	416.296	4300771
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	762.414	762.343	4300820
Quasigroups_mini/ QuasiGroup-v7-08_mini_c18.xml	UNSAT	786.511	786.519	4300761
Dubois/ Dubois-024_c18.xml	UNSAT	812.513	812.551	4300708
Dubois/ Dubois-025_c18.xml	UNSAT	1004.9	1004.97	4300709
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1295.26	1295.3	4300772
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f03_c18.xml	UNSAT	1326.26	1326.29	4300843

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.004879	0.0970609	4300680
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.004946	0.00585197	4300682
MagicSquare/ MagicSquare-04-sum_c18.xml	SAT	0.006339	0.00735692	4300795
Eternity/ Eternity-04-04_c18.xml	SAT	0.007775	0.00846492	4300726
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.008964	0.00968698	4300742
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	0.02091	0.0217909	4300741
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.027223	0.027664	4300743
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.043623	0.044481	4300808
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.121903	0.123043	4300809
Langford/ LangfordBin-07_c18.xml	SAT	0.133173	0.133172	4300693
Eternity/ Eternity-05-05_c18.xml	SAT	0.13588	0.136583	4300727
Quasigroups_mini/ QuasiGroup-v4-09_mini_c18.xml	SAT	0.173346	0.174046	4300754
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT	0.23495	0.240084	4300836
MagicSquare/ MagicSquare-05-sum_c18.xml	SAT	0.294973	0.297452	4300796
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.505879	0.506747	4300810
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	0.766161	0.767154	4300838
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	0.80942	0.810325	4300744
Frb/ frb-30-15-1_c18.xml	SAT	0.835048	0.835938	4300779
Eternity/ Eternity-10-04_c18.xml	SAT	1.9203	1.92084	4300732
Langford/ LangfordBin-08_c18.xml	SAT	2.94925	2.95059	4300694
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	3.76263	3.76301	4300768
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT	4.19137	4.19277	4300837
Eternity/ Eternity-06-06_c18.xml	SAT	4.4341	4.43557	4300728
Eternity/ Eternity-10-05_c18.xml	SAT	4.84885	4.8491	4300733
Quasigroups_mini/ QuasiGroup-v7-09_mini_c18.xml	SAT	5.75845	5.75951	4300762
Frb/ frb-35-17-1_c18.xml	SAT	12.7779	12.7793	4300780
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	38.2336	38.2351	4300715
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	54.1602	54.1622	4300745
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	54.3518	54.5217	4300839
MagicSquare/ MagicSquare-06-sum_c18.xml	SAT	56.064	56.066	4300797
Frb/ frb-40-19-1-mgd_c18.xml	SAT	69.511	69.5259	4300781
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	183.727	183.733	4300717
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	354.745	354.719	4300746
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	597.275	597.294	4300811
Eternity/ Eternity-07-07_c18.xml	SAT	613.513	613.496	4300729
Quasigroups_mini/ QuasiGroup-v4-12_mini_c18.xml	SAT	782.479	782.496	4300756
MagicSquare/ MagicSquare-07-sum_c18.xml	SAT	2234.84	2234.83	4300798

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Dubois/ Dubois-030_c18.xml	?	2520	2519.76	4300710
Haystacks/ Haystacks-ext-07_c18.xml	?	2520.01	2520.01	4300824
Langford/ LangfordBin-09_c18.xml	?	2520.01	2519.71	4300695
ColouredQueens/ ColouredQueens-12_c18.xml	?	2520.01	2519.7	4300687
Haystacks/ Haystacks-ext-11_c18.xml	?	2520.01	2519.71	4300828
Dubois/ Dubois-040_c18.xml	?	2520.01	2520.01	4300711
Quasigroups_mini/ QuasiGroup-v7-12_mini_c18.xml	?	2520.02	2519.83	4300764
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	?	2520.02	2519.83	4300751
Haystacks/ Haystacks-ext-12_c18.xml	?	2520.02	2519.84	4300829
Eternity/ Eternity-10-06_c18.xml	?	2520.02	2519.74	4300734
Eternity/ Eternity-09-09_c18.xml	?	2520.04	2519.74	4300731
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	?	2520.04	2519.88	4300773
Frb/ frb-50-23-2-mgd_c18.xml	?	2520.05	2519.76	4300784
Eternity/ Eternity-10-10_c18.xml	?	2520.06	2519.76	4300735
Frb/ frb-59-26-3-mgd_c18.xml	?	2520.07	2519.78	4300794
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	?	2520.08	2519.79	4300834

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.47	2520.01	4300686
Dubois/ Dubois-050_c18.xml	? (TO)	2519.74	2520.01	4300712
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2519.77	2520.01	4300776
Quasigroups_mini/ QuasiGroup-v7-20_mini_c18.xml	? (TO)	2519.78	2520.01	4300767
Frb/ frb-53-24-3-mgd_c18.xml	? (TO)	2519.79	2520.01	4300788
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2519.79	2520.01	4300750
Langford/ LangfordBin-16_c18.xml	? (TO)	2519.8	2520.01	4300702
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2519.8	2520.01	4300830
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2519.81	2520.01	4300783
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2519.86	2520.01	4300777
ColouredQueens/ ColouredQueens-15_c18.xml	? (TO)	2519.86	2520.01	4300690
Langford/ LangfordBin-15_c18.xml	? (TO)	2519.87	2520.01	4300701
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	? (TO)	2519.87	2520	4300747
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.87	2520.01	4300814
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.87	2520.01	4300683
ColouredQueens/ ColouredQueens-16_c18.xml	? (TO)	2519.89	2520.01	4300691
ColouredQueens/ ColouredQueens-09_c18.xml	? (TO)	2519.9	2520	4300684
Frb/ frb-53-24-2-mgd_c18.xml	? (TO)	2519.9	2520.01	4300787
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2519.9	2520.01	4300819
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.9	2520.01	4300679
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.9	2520	4300833
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.9	2520.01	4300817
Eternity/ Eternity-08-08_c18.xml	? (TO)	2519.9	2520.01	4300730
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f02_c18.xml	? (TO)	2519.91	2520.01	4300850
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2519.91	2520.01	4300813
Quasigroups_mini/ QuasiGroup-v4-10_mini_c18.xml	? (TO)	2519.91	2520.01	4300755
Quasigroups_mini/ QuasiGroup-v4-20_mini_c18.xml	? (TO)	2519.91	2520.01	4300759
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2519.91	2520.01	4300841
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2519.91	2520.01	4300719
Eternity/ Eternity-12-12_c18.xml	? (TO)	2519.92	2520.01	4300737
Haystacks/ Haystacks-ext-08_c18.xml	? (TO)	2519.93	2520.01	4300825
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.93	2520.01	4300812
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2519.93	2520.01	4300791
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2519.93	2520.01	4300790
MagicSquare/ MagicSquare-10-sum_c18.xml	? (TO)	2519.93	2520.01	4300801
Dubois/ Dubois-075_c18.xml	? (TO)	2519.93	2520.01	4300713
Haystacks/ Haystacks-ext-06_c18.xml	? (TO)	2519.93	2520.01	4300823
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2519.93	2520.01	4300786
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	? (TO)	2519.93	2520.01	4300770
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	? (TO)	2519.93	2520.01	4300832
Haystacks/ Haystacks-ext-09_c18.xml	? (TO)	2519.93	2520.01	4300826
Langford/ LangfordBin-12_c18.xml	? (TO)	2519.93	2520.01	4300698
Langford/ LangfordBin-13_c18.xml	? (TO)	2519.94	2520.01	4300699
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2519.94	2520.01	4300720
ColouredQueens/ ColouredQueens-14_c18.xml	? (TO)	2519.94	2520.01	4300689
Eternity/ Eternity-11-11_c18.xml	? (TO)	2519.94	2520.01	4300736
MagicSquare/ MagicSquare-15-sum_c18.xml	? (TO)	2519.94	2520.01	4300806
Langford/ LangfordBin-11_c18.xml	? (TO)	2519.95	2520.01	4300697
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	? (TO)	2519.95	2520.01	4300831
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2519.95	2520.01	4300840
Quasigroups_mini/ QuasiGroup-v7-10_mini_c18.xml	? (TO)	2519.95	2520.01	4300763
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2519.95	2520.01	4300789
MagicSquare/ MagicSquare-13-sum_c18.xml	? (TO)	2519.96	2520.01	4300804
ColouredQueens/ ColouredQueens-13_c18.xml	? (TO)	2519.96	2520.01	4300688
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2519.96	2520.01	4300721
MagicSquare/ MagicSquare-14-sum_c18.xml	? (TO)	2519.96	2520.01	4300805
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.96	2520.01	4300748
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	? (TO)	2519.96	2520.01	4300749
MagicSquare/ MagicSquare-08-sum_c18.xml	? (TO)	2519.96	2520.01	4300799
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2519.96	2520.01	4300723
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.97	2520.01	4300816
Haystacks/ Haystacks-ext-10_c18.xml	? (TO)	2519.97	2520.01	4300827
ColouredQueens/ ColouredQueens-10_c18.xml	? (TO)	2519.98	2520.01	4300685
Dubois/ Dubois-100_c18.xml	? (TO)	2519.98	2520.01	4300714
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2519.98	2520.01	4300792
Quasigroups_mini/ QuasiGroup-v7-16_mini_c18.xml	? (TO)	2519.98	2520.01	4300766
Langford/ LangfordBin-14_c18.xml	? (TO)	2519.98	2520.01	4300700
Eternity/ Eternity-15-15_c18.xml	? (TO)	2519.98	2520.01	4300740
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.98	2520.01	4300842
Frb/ frb-45-21-1_c18.xml	? (TO)	2519.99	2520.01	4300782
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2519.99	2520.01	4300793
Eternity/ Eternity-13-13_c18.xml	? (TO)	2519.99	2520.01	4300738
Eternity/ Eternity-14-14_c18.xml	? (TO)	2519.99	2520.01	4300739
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f01_c18.xml	? (TO)	2519.99	2520.01	4300849
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2520	2520.01	4300725
Langford/ LangfordBin-10_c18.xml	? (TO)	2520	2520.01	4300696
MagicSquare/ MagicSquare-09-sum_c18.xml	? (TO)	2520	2520.01	4300800
Quasigroups_mini/ QuasiGroup-v7-14_mini_c18.xml	? (TO)	2520	2520.01	4300765
MagicSquare/ MagicSquare-12-sum_c18.xml	? (TO)	2520.01	2520.01	4300803
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2520.01	2519.7	4300775
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2520.01	2520.01	4300718
MagicSquare/ MagicSquare-16-sum_c18.xml	? (TO)	2520.02	2520.01	4300807
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2520.02	2519.7	4300785
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.02	2519.7	4300722
MagicSquare/ MagicSquare-11-sum_c18.xml	? (TO)	2520.02	2519.7	4300802
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2520.07	2519.8	4300724
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2520.08	2519.8	4300818
Quasigroups_mini/ QuasiGroup-v4-14_mini_c18.xml	? (TO)	2520.08	2519.8	4300757
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2520.08	2519.8	4300835
Quasigroups_mini/ QuasiGroup-v4-16_mini_c18.xml	? (TO)	2520.09	2519.8	4300758
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2520.11	2520.01	4300815

2018 XCSP3 competition: mini-solvers track: benchmarks results per solver

Result page for solver minimacht 2018.07.27 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (32 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (37 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (16 runs) [Show/Hide]

Solver timed out (no solution given) (91 runs) [Show/Hide]