2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.006655	0.00684504	4294741
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.007701	0.0080551	4294696
Dubois/ Dubois-018_c18.xml	UNSAT	0.008321	0.00848492	4294651
Dubois/ Dubois-021_c18.xml	UNSAT	0.008507	0.00876397	4294606
Dubois/ Dubois-022_c18.xml	UNSAT	0.008653	0.00885589	4294642
Dubois/ Dubois-023_c18.xml	UNSAT	0.00885	0.00904189	4294597
Dubois/ Dubois-024_c18.xml	UNSAT	0.008882	0.0090419	4294660
Dubois/ Dubois-025_c18.xml	UNSAT	0.009108	0.00942997	4294669
Dubois/ Dubois-020_c18.xml	UNSAT	0.009425	0.00961891	4294615
Dubois/ Dubois-030_c18.xml	UNSAT	0.009915	0.010181	4294633
Dubois/ Dubois-040_c18.xml	UNSAT	0.011408	0.011679	4294624
Haystacks/ Haystacks-ext-06_c18.xml	UNSAT	0.012743	0.013037	4294732
Dubois/ Dubois-050_c18.xml	UNSAT	0.013329	0.013538	4294579
Dubois/ Dubois-075_c18.xml	UNSAT	0.018843	0.019088	4294588
Quasigroups/ QuasiGroup-7-07_c18.xml	UNSAT	0.020216	0.02041	4295861
Dubois/ Dubois-100_c18.xml	UNSAT	0.02551	0.025747	4294678
Quasigroups/ QuasiGroup-7-08_c18.xml	UNSAT	0.026782	0.027113	4295933
Haystacks/ Haystacks-ext-07_c18.xml	UNSAT	0.039482	0.039629	4294750
Quasigroups/ QuasiGroup-7-10_c18.xml	UNSAT	0.076347	0.076735	4295915
Quasigroups/ QuasiGroup-7-12_c18.xml	UNSAT	0.118322	0.118449	4295825
Langford/ LangfordBin-06_c18.xml	UNSAT	0.223483	0.227708	4294242
Haystacks/ Haystacks-ext-08_c18.xml	UNSAT	0.242325	0.242457	4294723
Quasigroups/ QuasiGroup-7-14_c18.xml	UNSAT	0.280219	0.280641	4295906
Quasigroups/ QuasiGroup-7-16_c18.xml	UNSAT	0.49057	0.494968	4295870
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.588674	0.588963	4292783
Quasigroups/ QuasiGroup-7-20_c18.xml	UNSAT	1.02102	1.02119	4295843
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f12_c18.xml	UNSAT	1.2214	1.22174	4293531
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f11_c18.xml	UNSAT	1.2298	1.23444	4293441
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f10_c18.xml	UNSAT	1.26159	1.26622	4293486
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f09_c18.xml	UNSAT	1.59286	1.59322	4293468
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f08_c18.xml	UNSAT	1.61406	1.61445	4293540
Haystacks/ Haystacks-ext-09_c18.xml	UNSAT	1.95228	2.97687	4294705
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	3.50204	3.50671	4295232
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f07_c18.xml	UNSAT	3.97447	3.97691	4293477
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f06_c18.xml	UNSAT	6.47444	6.47552	4293513
Quasigroups/ QuasiGroup-4-07_c18.xml	UNSAT	8.95951	8.96104	4295897
Haystacks/ Haystacks-ext-10_c18.xml	UNSAT	18.0643	18.0646	4294768
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	UNSAT	18.7763	18.7931	4293522
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	44.6249	44.6251	4295286
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f04_c18.xml	UNSAT	65.6643	65.6871	4293504
Haystacks/ Haystacks-ext-11_c18.xml	UNSAT	199.16	199.163	4294687
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f03_c18.xml	UNSAT	226.071	226.112	4293459
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	287.106	287.14	4295223
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	354.838	354.842	4295546
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	367.118	367.126	4294833
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f02_c18.xml	UNSAT	609.291	609.369	4293450
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f01_c18.xml	UNSAT	1199.08	1199.22	4293495
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1208.66	1208.64	4295277
Quasigroups/ QuasiGroup-4-08_c18.xml	UNSAT	1567.21	1567.19	4295888
Haystacks/ Haystacks-ext-12_c18.xml	UNSAT	2436.75	2436.77	4294759

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.006477	0.00673398	4292855
Eternity/ Eternity-04-04_c18.xml	SAT	0.009972	0.010122	4296076
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.015516	0.015918	4292792
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.016169	0.016314	4293378
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.045348	0.0455211	4294851
Eternity/ Eternity-05-05_c18.xml	SAT	0.084193	0.0846019	4296157
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.120186	0.125471	4294869
Langford/ LangfordBin-07_c18.xml	SAT	0.157229	0.161357	4294215
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.272855	0.273025	4294878
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.386471	0.386641	4293342
Frb/ frb-30-15-1_c18.xml	SAT	0.420007	0.420196	4295681
Quasigroups/ QuasiGroup-4-09_c18.xml	SAT	1.05202	1.05219	4295834
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	1.13208	1.13673	4293405
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	1.23312	1.23744	4295241
Eternity/ Eternity-10-04_c18.xml	SAT	2.01933	2.01956	4296121
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	2.33427	2.3397	4293777
Langford/ LangfordBin-08_c18.xml	SAT	3.22641	3.2272	4294206
Eternity/ Eternity-06-06_c18.xml	SAT	3.75631	3.75628	4296067
Frb/ frb-35-17-1_c18.xml	SAT	8.51703	8.51708	4295609
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	23.2549	23.266	4293750
Frb/ frb-40-19-1-mgd_c18.xml	SAT	31.9611	31.9629	4295699
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	40.3	40.2993	4294914
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	42.3615	42.3607	4295564
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	268.174	268.167	4295528
Eternity/ Eternity-07-07_c18.xml	SAT	386.79	386.759	4296193
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	429.053	429.07	4293351
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	440.608	440.652	4293414
Eternity/ Eternity-10-05_c18.xml	SAT	1503.01	1502.9	4296085
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	1995.84	1995.92	4293360
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	SAT	2306.99	2306.93	4295313

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Langford/ LangfordBin-15_c18.xml	?	2520.01	2519.94	4294197
Langford/ LangfordBin-09_c18.xml	?	2520.01	2519.97	4294260
Langford/ LangfordBin-14_c18.xml	?	2520.01	2519.97	4294188
Langford/ LangfordBin-10_c18.xml	?	2520.01	2519.96	4294224
Langford/ LangfordBin-13_c18.xml	?	2520.01	2519.94	4294251
Langford/ LangfordBin-16_c18.xml	?	2520.01	2519.94	4294233
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	?	2520.02	2519.97	4295304
Haystacks/ Haystacks-ext-13_c18.xml	?	2520.02	2519.97	4294714
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	?	2520.02	2519.95	4295259
Eternity/ Eternity-08-08_c18.xml	?	2520.03	2519.94	4296175
MagicHexagon/ MagicHexagon-05-0006_c18.xml	?	2520.03	2519.95	4295537
Quasigroups/ QuasiGroup-4-10_c18.xml	?	2520.05	2520	4295807
Eternity/ Eternity-10-10_c18.xml	?	2520.07	2519.89	4296148

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CarSequencing/ CarSequencing-dingbas_c18.xml	? (NS)	0.006116	0.00621594	4295022
MisteryShopper/ MisteryShopper-04_c18.xml	? (NS)	0.007263	0.00740902	4294552
SportsScheduling/ SportsScheduling-08_c18.xml	? (NS)	0.007288	0.00745007	4295780
CarSequencing/ CarSequencing-04-72_c18.xml	? (NS)	0.008193	0.00833896	4295031
CarSequencing/ CarSequencing-06-76_c18.xml	? (NS)	0.008257	0.00848999	4294986
Bibd/ Bibd-sum-07-03-01_c18.xml	? (NS)	0.008274	0.00841808	4294062
SportsScheduling/ SportsScheduling-10_c18.xml	? (NS)	0.008373	0.00858694	4295753
CarSequencing/ CarSequencing-60-02_c18.xml	? (NS)	0.010336	0.0105051	4295067
MisteryShopper/ MisteryShopper-10a_c18.xml	? (NS)	0.010483	0.0107311	4294498
MisteryShopper/ MisteryShopper-06a_c18.xml	? (NS)	0.010579	0.0108181	4294561
CarSequencing/ CarSequencing-70-02_c18.xml	? (NS)	0.01058	0.0107549	4295076
CarSequencing/ CarSequencing-65-02_c18.xml	? (NS)	0.010616	0.0108379	4295085
CarSequencing/ CarSequencing-75-02_c18.xml	? (NS)	0.010628	0.010923	4295094
CarSequencing/ CarSequencing-60-01_c18.xml	? (NS)	0.010648	0.0107991	4294950
SportsScheduling/ SportsScheduling-12_c18.xml	? (NS)	0.010652	0.0110661	4295798
CarSequencing/ CarSequencing-80-02_c18.xml	? (NS)	0.010674	0.0108761	4294968
CarSequencing/ CarSequencing-90-01_c18.xml	? (NS)	0.010683	0.0108259	4295040
CarSequencing/ CarSequencing-80-01_c18.xml	? (NS)	0.010689	0.0108229	4295049
CarSequencing/ CarSequencing-85-01_c18.xml	? (NS)	0.010695	0.0108039	4295013
CarSequencing/ CarSequencing-90-02_c18.xml	? (NS)	0.010707	0.0110531	4295058
CarSequencing/ CarSequencing-75-01_c18.xml	? (NS)	0.01072	0.0109	4294977
CarSequencing/ CarSequencing-65-01_c18.xml	? (NS)	0.01073	0.0107879	4294995
CarSequencing/ CarSequencing-85-02_c18.xml	? (NS)	0.01073	0.010885	4294959
CarSequencing/ CarSequencing-70-01_c18.xml	? (NS)	0.010835	0.0109591	4295004
StripPacking/ StripPacking-1b_c18.xml	? (NS)	0.010853	0.0110101	4293137
StripPacking/ StripPacking-1a_c18.xml	? (NS)	0.011926	0.012297	4293182
SportsScheduling/ SportsScheduling-14_c18.xml	? (NS)	0.013861	0.014234	4295726
StripPacking/ StripPacking-C1P3_c18.xml	? (NS)	0.013892	0.0142891	4293119
StripPacking/ StripPacking-C1P1_c18.xml	? (NS)	0.013898	0.0142279	4293164
StripPacking/ StripPacking-C1P2_c18.xml	? (NS)	0.014455	0.014643	4293110
MisteryShopper/ MisteryShopper-06b_c18.xml	? (NS)	0.01499	0.0152791	4294507
StripPacking/ StripPacking-T1c_c18.xml	? (NS)	0.015756	0.015938	4293128
StripPacking/ StripPacking-N1c_c18.xml	? (NS)	0.01577	0.015986	4293209
StripPacking/ StripPacking-T1a_c18.xml	? (NS)	0.01577	0.0161661	4293146
StripPacking/ StripPacking-N1b_c18.xml	? (NS)	0.015805	0.0161551	4293200
StripPacking/ StripPacking-N1a_c18.xml	? (NS)	0.015811	0.0159631	4293173
StripPacking/ StripPacking-T1d_c18.xml	? (NS)	0.015838	0.0160009	4293191
MisteryShopper/ MisteryShopper-10b_c18.xml	? (NS)	0.01647	0.0166721	4294534
SportsScheduling/ SportsScheduling-16_c18.xml	? (NS)	0.018499	0.018671	4295762
StripPacking/ StripPacking-C2P1_c18.xml	? (NS)	0.018656	0.0189219	4293155
MisteryShopper/ MisteryShopper-06c_c18.xml	? (NS)	0.022062	0.0223101	4294516
SportsScheduling/ SportsScheduling-18_c18.xml	? (NS)	0.027597	0.027976	4295744
MisteryShopper/ MisteryShopper-10c_c18.xml	? (NS)	0.028055	0.028346	4294570
Bibd/ Bibd-sc-07-03-01_c18.xml	? (NS)	0.028071	0.0283701	4294107
MisteryShopper/ MisteryShopper-06d_c18.xml	? (NS)	0.033827	0.033948	4294525
MisteryShopper/ MisteryShopper-12_c18.xml	? (NS)	0.036893	0.037181	4294543
SportsScheduling/ SportsScheduling-20_c18.xml	? (NS)	0.03881	0.0389801	4295789
MisteryShopper/ MisteryShopper-10d_c18.xml	? (NS)	0.048089	0.048332	4294489
SportsScheduling/ SportsScheduling-22_c18.xml	? (NS)	0.053883	0.0542639	4295717
Bibd/ Bibd-sum-12-06-05_c18.xml	? (NS)	0.067096	0.0672891	4294161
SportsScheduling/ SportsScheduling-24_c18.xml	? (NS)	0.082225	0.0826381	4295735
SportsScheduling/ SportsScheduling-26_c18.xml	? (NS)	0.112972	0.11316	4295771
SocialGolfers/ SocialGolfers-4-4-4-cp_c18.xml	? (NS)	0.147333	0.147609	4294390
SocialGolfers/ SocialGolfers-4-4-5-cp_c18.xml	? (NS)	0.247787	0.248098	4294462
Bibd/ Bibd-sc-12-06-05_c18.xml	? (NS)	0.299299	0.299624	4294152
SocialGolfers/ SocialGolfers-4-4-6-cp_c18.xml	? (NS)	0.380656	0.380988	4294399
Bibd/ Bibd-sum-09-03-09_c18.xml	? (NS)	0.426747	0.431472	4294071
SocialGolfers/ SocialGolfers-4-4-7-cp_c18.xml	? (NS)	0.540462	0.540808	4294471
SocialGolfers/ SocialGolfers-5-5-5-cp_c18.xml	? (NS)	0.653077	0.653287	4294381
Bibd/ Bibd-sum-10-03-08_c18.xml	? (NS)	0.755784	0.755976	4294098
SocialGolfers/ SocialGolfers-5-5-6-cp_c18.xml	? (NS)	1.02846	1.02876	4294435
Bibd/ Bibd-sc-09-03-09_c18.xml	? (NS)	1.25785	1.2628	4294080
Bibd/ Bibd-sum-22-033-12-08-04_c18.xml	? (NS)	1.26851	1.26894	4294125
SocialGolfers/ SocialGolfers-5-5-7-cp_c18.xml	? (NS)	1.51808	1.51843	4294444
Bibd/ Bibd-sc-10-03-08_c18.xml	? (NS)	2.10455	2.11477	4294143
SocialGolfers/ SocialGolfers-5-5-8-cp_c18.xml	? (NS)	2.23787	2.23823	4294453
SocialGolfers/ SocialGolfers-6-6-6-cp_c18.xml	? (NS)	2.49321	3.12715	4294426
Bibd/ Bibd-sc-22-033-12-08-04_c18.xml	? (NS)	3.17876	3.17926	4294134
SocialGolfers/ SocialGolfers-6-6-7-cp_c18.xml	? (NS)	3.812	3.81239	4294480
SocialGolfers/ SocialGolfers-6-6-8-cp_c18.xml	? (NS)	5.63729	5.6381	4294408
SocialGolfers/ SocialGolfers-6-6-9-cp_c18.xml	? (NS)	8.09229	8.54736	4294417
Bibd/ Bibd-sum-34-085-30-12-10_c18.xml	? (NS)	99.7856	99.8364	4294116
Bibd/ Bibd-sc-34-085-30-12-10_c18.xml	? (NS)	168.17	168.199	4294089

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2519.77	2520.01	4295555
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	? (TO)	2519.78	2520	4293714
Langford/ LangfordBin-12_c18.xml	? (TO)	2519.79	2520.01	4294170
Frb/ frb-50-23-2-mgd_c18.xml	? (TO)	2519.8	2520.01	4295663
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.8	2520.01	4293804
Frb/ frb-45-21-1_c18.xml	? (TO)	2519.82	2520.01	4295654
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.89	2520.01	4293741
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.9	2520.01	4293813
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2519.9	2520.01	4295708
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.9	2520.01	4294887
ColouredQueens/ ColouredQueens-12_c18.xml	? (TO)	2519.9	2520	4292864
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2519.9	2520.01	4293723
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.91	2520.01	4292846
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	? (TO)	2519.91	2520.01	4293396
ColouredQueens/ ColouredQueens-10_c18.xml	? (TO)	2519.91	2520.01	4292819
ColouredQueens/ ColouredQueens-14_c18.xml	? (TO)	2519.91	2520.01	4292837
Eternity/ Eternity-12-12_c18.xml	? (TO)	2519.91	2520	4296184
Eternity/ Eternity-09-09_c18.xml	? (TO)	2519.91	2520	4296139
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.91	2520.01	4294932
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	? (TO)	2519.91	2520.01	4293369
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.91	2520.01	4294842
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	? (TO)	2519.91	2520.01	4293786
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2519.91	2520.01	4293759
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2519.91	2520	4293732
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	? (TO)	2519.91	2520.01	4293795
ColouredQueens/ ColouredQueens-09_c18.xml	? (TO)	2519.91	2520.01	4292801
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2519.91	2520.01	4293432
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2519.92	2520	4293423
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.92	2520.01	4292873
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	? (TO)	2519.92	2520	4293705
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2519.92	2520.01	4295672
Eternity/ Eternity-10-06_c18.xml	? (TO)	2519.92	2520.01	4296094
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2519.93	2520.01	4295573
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.93	2520.01	4293387
Langford/ LangfordBin-11_c18.xml	? (TO)	2519.93	2520.01	4294179
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2519.93	2520.01	4295636
ColouredQueens/ ColouredQueens-16_c18.xml	? (TO)	2519.93	2520.01	4292810
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	? (TO)	2519.93	2520.01	4293768
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2519.93	2520.01	4295250
ColouredQueens/ ColouredQueens-15_c18.xml	? (TO)	2519.93	2520.01	4292774
ColouredQueens/ ColouredQueens-13_c18.xml	? (TO)	2519.94	2520.01	4292828
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2520	2520.01	4295295
Eternity/ Eternity-13-13_c18.xml	? (TO)	2520	2519.81	4296130
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2520.03	2520.01	4294896
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2520.03	2520.01	4294860
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2520.03	2520.01	4294941
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2520.03	2520.01	4295618
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2520.04	2520.01	4294923
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2520.04	2520.01	4295600
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2520.04	2520.01	4294905
Quasigroups/ QuasiGroup-4-16_c18.xml	? (TO)	2520.04	2520.01	4295924
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2520.05	2520.01	4295268
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2520.05	2520.01	4295627
Frb/ frb-53-24-2-mgd_c18.xml	? (TO)	2520.05	2520	4295690
Frb/ frb-53-24-3-mgd_c18.xml	? (TO)	2520.05	2520.01	4295591
Quasigroups/ QuasiGroup-4-14_c18.xml	? (TO)	2520.06	2519.9	4295879
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.06	2520.01	4295582
Eternity/ Eternity-14-14_c18.xml	? (TO)	2520.06	2520.01	4296166
Eternity/ Eternity-15-15_c18.xml	? (TO)	2520.06	2519.9	4296103
Eternity/ Eternity-11-11_c18.xml	? (TO)	2520.06	2520.01	4296112
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2520.06	2520.01	4295645
Quasigroups/ QuasiGroup-4-20_c18.xml	? (TO)	2520.06	2520.01	4295942
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2520.07	2520.01	4295492
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2520.08	2520.01	4295474
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2520.09	2520.01	4295501
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.09	2520.01	4295483
Quasigroups/ QuasiGroup-4-12_c18.xml	? (TO)	2520.1	2519.9	4295816
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2520.1	2520.01	4295510
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2520.11	2520.01	4295519

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver BTD 2018.06.11_3 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (50 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (30 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (13 runs) [Show/Hide]

Solver does not handle one of the constraint (73 runs) [Show/Hide]

Solver timed out (no solution given) (69 runs) [Show/Hide]

Solver wrongly proved unsatitisfiability (1 run) [Show/Hide]