2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.006772	0.00715397	4306200
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.007789	0.00790502	4306201
Dubois/ Dubois-018_c18.xml	UNSAT	0.008476	0.00876104	4306061
Dubois/ Dubois-020_c18.xml	UNSAT	0.008772	0.00910808	4306062
Dubois/ Dubois-023_c18.xml	UNSAT	0.009115	0.00941205	4306065
Dubois/ Dubois-021_c18.xml	UNSAT	0.009252	0.00961301	4306063
Dubois/ Dubois-022_c18.xml	UNSAT	0.009332	0.009406	4306064
Dubois/ Dubois-025_c18.xml	UNSAT	0.00936	0.00959901	4306067
Dubois/ Dubois-024_c18.xml	UNSAT	0.00949	0.00961609	4306066
Dubois/ Dubois-030_c18.xml	UNSAT	0.010143	0.010288	4306068
Dubois/ Dubois-040_c18.xml	UNSAT	0.012139	0.012302	4306069
Dubois/ Dubois-050_c18.xml	UNSAT	0.013938	0.014181	4306070
Haystacks/ Haystacks-ext-06_c18.xml	UNSAT	0.014254	0.0146991	4306202
Dubois/ Dubois-075_c18.xml	UNSAT	0.02041	0.02059	4306071
Dubois/ Dubois-100_c18.xml	UNSAT	0.027039	0.027129	4306072
Haystacks/ Haystacks-ext-07_c18.xml	UNSAT	0.038737	0.03908	4306203
Langford/ LangfordBin-06_c18.xml	UNSAT	0.212194	0.213482	4306050
Haystacks/ Haystacks-ext-08_c18.xml	UNSAT	0.2249	0.225343	4306204
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.867377	0.867621	4306039
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f11_c18.xml	UNSAT	1.20148	1.20622	4306238
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f12_c18.xml	UNSAT	1.21246	1.21712	4306234
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f10_c18.xml	UNSAT	1.24845	1.25309	4306237
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f09_c18.xml	UNSAT	1.26887	1.27357	4306240
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f08_c18.xml	UNSAT	1.32867	1.32914	4306243
Haystacks/ Haystacks-ext-09_c18.xml	UNSAT	1.97514	1.97969	4306205
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f07_c18.xml	UNSAT	2.15449	2.15473	4306233
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f06_c18.xml	UNSAT	2.89664	2.89952	4306235
Quasigroups/ QuasiGroup-7-07_c18.xml	UNSAT	3.7038	3.70522	4306118
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	4.44604	4.44678	4306170
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	UNSAT	12.3018	12.3089	4306242
Quasigroups/ QuasiGroup-4-07_c18.xml	UNSAT	16.9406	16.9459	4306110
Haystacks/ Haystacks-ext-10_c18.xml	UNSAT	18.199	18.1981	4306206
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f04_c18.xml	UNSAT	56.3667	56.3625	4306239
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT	87.6401	87.6573	4306161
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	122.996	122.992	4306166
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f03_c18.xml	UNSAT	175.455	175.464	4306236
Haystacks/ Haystacks-ext-11_c18.xml	UNSAT	195.961	195.965	4306207
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	216.092	216.103	4306074
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	404.093	404.07	4306163
Quasigroups/ QuasiGroup-4-08_c18.xml	UNSAT	494.722	494.71	4306111
Quasigroups/ QuasiGroup-7-08_c18.xml	UNSAT	525.579	525.589	4306119
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	628.721	628.687	4306199
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f02_c18.xml	UNSAT	661.857	661.835	4306244
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1247.15	1247.17	4306164
Haystacks/ Haystacks-ext-12_c18.xml	UNSAT	2404.68	2404.7	4306208

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.006755	0.006802	4306038
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.007961	0.00824699	4306040
Eternity/ Eternity-04-04_c18.xml	SAT	0.009195	0.00934202	4306084
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.011028	0.0111761	4306100
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	0.022444	0.0226779	4306099
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.04534	0.045508	4306187
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.060925	0.0610979	4306101
Eternity/ Eternity-05-05_c18.xml	SAT	0.111682	0.111723	4306085
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.120466	0.124992	4306188
Langford/ LangfordBin-07_c18.xml	SAT	0.154359	0.154695	4306051
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT	0.219088	0.21972	4306215
Quasigroups/ QuasiGroup-7-09_c18.xml	SAT	0.230761	0.235227	4306120
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.267621	0.267946	4306189
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	0.34719	0.347508	4306217
Eternity/ Eternity-06-06_c18.xml	SAT	0.612128	0.612262	4306086
Quasigroups/ QuasiGroup-4-09_c18.xml	SAT	0.759659	0.759791	4306112
Frb/ frb-30-15-1_c18.xml	SAT	0.875408	0.875839	4306171
Langford/ LangfordBin-08_c18.xml	SAT	2.46373	2.46404	4306052
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT	3.35921	3.36717	4306216
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	3.53963	4.13408	4306160
Eternity/ Eternity-10-04_c18.xml	SAT	3.71209	3.71642	4306090
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	5.22163	5.22222	4306102
Eternity/ Eternity-07-07_c18.xml	SAT	8.76404	8.76373	4306087
Frb/ frb-35-17-1_c18.xml	SAT	12.2407	12.2408	4306172
Eternity/ Eternity-10-05_c18.xml	SAT	32.8415	32.8451	4306091
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	38.0288	38.0366	4306073
Frb/ frb-40-19-1-mgd_c18.xml	SAT	50.2765	50.2839	4306173
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	84.3527	84.3694	4306104
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	98.7375	98.7516	4306218
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	182.494	182.511	4306075
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	395.867	395.874	4306103
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	682.129	682.095	4306190

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-10_c18.xml	?	2520.01	2519.83	4306043
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	?	2520.01	2519.88	4306106
Langford/ LangfordBin-11_c18.xml	?	2520.01	2520	4306055
Langford/ LangfordBin-14_c18.xml	?	2520.01	2519.88	4306058
Langford/ LangfordBin-15_c18.xml	?	2520.01	2519.94	4306059
Langford/ LangfordBin-13_c18.xml	?	2520.01	2519.83	4306057
Langford/ LangfordBin-09_c18.xml	?	2520.01	2519.84	4306053
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	?	2520.01	2519.83	4306211
ColouredQueens/ ColouredQueens-16_c18.xml	?	2520.01	2519.88	4306049
Quasigroups/ QuasiGroup-7-10_c18.xml	?	2520.01	2519.97	4306121
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	?	2520.02	2519.84	4306107
Quasigroups/ QuasiGroup-7-12_c18.xml	?	2520.02	2519.97	4306122
Quasigroups/ QuasiGroup-7-14_c18.xml	?	2520.03	2519.97	4306123
Eternity/ Eternity-10-06_c18.xml	?	2520.03	2519.95	4306092
Eternity/ Eternity-08-08_c18.xml	?	2520.03	2519.96	4306088
Quasigroups/ QuasiGroup-7-16_c18.xml	?	2520.05	2520.01	4306124
Frb/ frb-50-23-2-mgd_c18.xml	?	2520.05	2519.98	4306176
Frb/ frb-53-24-3-mgd_c18.xml	?	2520.06	2520	4306180
Frb/ frb-53-24-2-mgd_c18.xml	?	2520.06	2519.99	4306179
Frb/ frb-56-25-1-mgd_c18.xml	?	2520.07	2520	4306181
Frb/ frb-56-25-2-mgd_c18.xml	?	2520.07	2520	4306182
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	?	2520.07	2519.9	4306167

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CarSequencing/ CarSequencing-dingbas_c18.xml	? (NS)	0.006464	0.00668991	4306037
SportsScheduling/ SportsScheduling-08_c18.xml	? (NS)	0.007319	0.00771409	4306150
MisteryShopper/ MisteryShopper-04_c18.xml	? (NS)	0.00758	0.00804397	4306223
Bibd/ Bibd-sum-07-03-01_c18.xml	? (NS)	0.00852	0.00884404	4306015
CarSequencing/ CarSequencing-06-76_c18.xml	? (NS)	0.008541	0.00874102	4306022
CarSequencing/ CarSequencing-04-72_c18.xml	? (NS)	0.008547	0.00875706	4306021
SportsScheduling/ SportsScheduling-10_c18.xml	? (NS)	0.008625	0.00883093	4306151
SportsScheduling/ SportsScheduling-12_c18.xml	? (NS)	0.010766	0.011064	4306152
MisteryShopper/ MisteryShopper-10a_c18.xml	? (NS)	0.010816	0.010966	4306228
CarSequencing/ CarSequencing-90-01_c18.xml	? (NS)	0.011058	0.011287	4306035
CarSequencing/ CarSequencing-70-01_c18.xml	? (NS)	0.011097	0.0112649	4306027
CarSequencing/ CarSequencing-80-01_c18.xml	? (NS)	0.011101	0.0115681	4306031
CarSequencing/ CarSequencing-60-01_c18.xml	? (NS)	0.011181	0.011384	4306023
CarSequencing/ CarSequencing-85-01_c18.xml	? (NS)	0.011185	0.011368	4306033
CarSequencing/ CarSequencing-65-01_c18.xml	? (NS)	0.011188	0.011453	4306025
CarSequencing/ CarSequencing-75-01_c18.xml	? (NS)	0.011206	0.0114001	4306029
StripPacking/ StripPacking-1b_c18.xml	? (NS)	0.011206	0.0113929	4306139
CarSequencing/ CarSequencing-80-02_c18.xml	? (NS)	0.011243	0.0114451	4306032
MisteryShopper/ MisteryShopper-06a_c18.xml	? (NS)	0.011243	0.011383	4306224
CarSequencing/ CarSequencing-75-02_c18.xml	? (NS)	0.011347	0.011694	4306030
CarSequencing/ CarSequencing-60-02_c18.xml	? (NS)	0.011587	0.0118729	4306024
CarSequencing/ CarSequencing-90-02_c18.xml	? (NS)	0.011733	0.0119871	4306036
CarSequencing/ CarSequencing-70-02_c18.xml	? (NS)	0.011985	0.012267	4306028
CarSequencing/ CarSequencing-85-02_c18.xml	? (NS)	0.012016	0.012286	4306034
StripPacking/ StripPacking-1a_c18.xml	? (NS)	0.012202	0.0125331	4306138
CarSequencing/ CarSequencing-65-02_c18.xml	? (NS)	0.012254	0.0125	4306026
SportsScheduling/ SportsScheduling-14_c18.xml	? (NS)	0.014159	0.0146149	4306153
StripPacking/ StripPacking-C1P3_c18.xml	? (NS)	0.014238	0.014635	4306142
StripPacking/ StripPacking-C1P1_c18.xml	? (NS)	0.014312	0.0147789	4306140
StripPacking/ StripPacking-C1P2_c18.xml	? (NS)	0.014802	0.014985	4306141
MisteryShopper/ MisteryShopper-06b_c18.xml	? (NS)	0.01548	0.0156971	4306225
StripPacking/ StripPacking-T1a_c18.xml	? (NS)	0.016099	0.01634	4306147
StripPacking/ StripPacking-N1b_c18.xml	? (NS)	0.01612	0.0163701	4306145
StripPacking/ StripPacking-N1a_c18.xml	? (NS)	0.016158	0.0165939	4306144
StripPacking/ StripPacking-T1d_c18.xml	? (NS)	0.016222	0.0164539	4306149
StripPacking/ StripPacking-T1c_c18.xml	? (NS)	0.016235	0.0164749	4306148
StripPacking/ StripPacking-N1c_c18.xml	? (NS)	0.016611	0.016992	4306146
MisteryShopper/ MisteryShopper-10b_c18.xml	? (NS)	0.016883	0.017265	4306229
SportsScheduling/ SportsScheduling-16_c18.xml	? (NS)	0.018789	0.0190539	4306154
StripPacking/ StripPacking-C2P1_c18.xml	? (NS)	0.01916	0.0195049	4306143
MisteryShopper/ MisteryShopper-06c_c18.xml	? (NS)	0.022616	0.0226989	4306226
SportsScheduling/ SportsScheduling-18_c18.xml	? (NS)	0.027987	0.028176	4306155
Bibd/ Bibd-sc-07-03-01_c18.xml	? (NS)	0.028707	0.028777	4306009
MisteryShopper/ MisteryShopper-10c_c18.xml	? (NS)	0.028966	0.0292159	4306230
MisteryShopper/ MisteryShopper-06d_c18.xml	? (NS)	0.034564	0.034674	4306227
MisteryShopper/ MisteryShopper-12_c18.xml	? (NS)	0.038006	0.0383811	4306232
SportsScheduling/ SportsScheduling-20_c18.xml	? (NS)	0.039206	0.0394909	4306156
MisteryShopper/ MisteryShopper-10d_c18.xml	? (NS)	0.049302	0.0498049	4306231
SportsScheduling/ SportsScheduling-22_c18.xml	? (NS)	0.05504	0.0554079	4306157
Bibd/ Bibd-sum-12-06-05_c18.xml	? (NS)	0.067998	0.0682571	4306018
SportsScheduling/ SportsScheduling-24_c18.xml	? (NS)	0.083967	0.084177	4306158
SportsScheduling/ SportsScheduling-26_c18.xml	? (NS)	0.114744	0.115126	4306159
SocialGolfers/ SocialGolfers-4-4-4-cp_c18.xml	? (NS)	0.152713	0.157034	4306126
SocialGolfers/ SocialGolfers-4-4-5-cp_c18.xml	? (NS)	0.256605	0.256996	4306127
Bibd/ Bibd-sc-12-06-05_c18.xml	? (NS)	0.308174	0.308418	4306012
SocialGolfers/ SocialGolfers-4-4-6-cp_c18.xml	? (NS)	0.390822	0.391016	4306128
Bibd/ Bibd-sum-09-03-09_c18.xml	? (NS)	0.431456	0.436023	4306016
SocialGolfers/ SocialGolfers-4-4-7-cp_c18.xml	? (NS)	0.558246	0.558682	4306129
SocialGolfers/ SocialGolfers-5-5-5-cp_c18.xml	? (NS)	0.6771	0.677414	4306130
Bibd/ Bibd-sum-10-03-08_c18.xml	? (NS)	0.796821	0.798571	4306017
SocialGolfers/ SocialGolfers-5-5-6-cp_c18.xml	? (NS)	1.05971	1.06009	4306131
Bibd/ Bibd-sum-22-033-12-08-04_c18.xml	? (NS)	1.27596	1.28068	4306019
Bibd/ Bibd-sc-09-03-09_c18.xml	? (NS)	1.28103	1.28151	4306010
SocialGolfers/ SocialGolfers-5-5-7-cp_c18.xml	? (NS)	1.54463	1.55586	4306132
Bibd/ Bibd-sc-10-03-08_c18.xml	? (NS)	2.10835	2.11935	4306011
SocialGolfers/ SocialGolfers-5-5-8-cp_c18.xml	? (NS)	2.21177	2.21208	4306133
SocialGolfers/ SocialGolfers-6-6-6-cp_c18.xml	? (NS)	2.56359	3.2909	4306134
Bibd/ Bibd-sc-22-033-12-08-04_c18.xml	? (NS)	3.24493	3.27555	4306013
SocialGolfers/ SocialGolfers-6-6-7-cp_c18.xml	? (NS)	3.88957	3.89795	4306135
SocialGolfers/ SocialGolfers-6-6-8-cp_c18.xml	? (NS)	5.82528	5.83253	4306136
SocialGolfers/ SocialGolfers-6-6-9-cp_c18.xml	? (NS)	8.45436	8.45471	4306137
Bibd/ Bibd-sum-34-085-30-12-10_c18.xml	? (NS)	94.9625	94.9981	4306020
Bibd/ Bibd-sc-34-085-30-12-10_c18.xml	? (NS)	166.609	166.653	4306014

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-15_c18.xml	? (TO)	2519.67	2520	4306048
Eternity/ Eternity-14-14_c18.xml	? (TO)	2519.75	2520	4306097
Eternity/ Eternity-11-11_c18.xml	? (TO)	2519.77	2520.01	4306094
Eternity/ Eternity-09-09_c18.xml	? (TO)	2519.77	2520.01	4306089
Langford/ LangfordBin-10_c18.xml	? (TO)	2519.81	2520	4306054
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2519.82	2520.01	4306194
ColouredQueens/ ColouredQueens-13_c18.xml	? (TO)	2519.82	2520.01	4306046
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2519.85	2520.01	4306077
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	? (TO)	2519.87	2520.01	4306210
Langford/ LangfordBin-12_c18.xml	? (TO)	2519.88	2520.01	4306056
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2519.9	2520.01	4306209
ColouredQueens/ ColouredQueens-09_c18.xml	? (TO)	2519.92	2520.01	4306042
Quasigroups/ QuasiGroup-7-20_c18.xml	? (TO)	2519.92	2520	4306125
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2519.93	2520.01	4306184
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2519.94	2520.01	4306178
Quasigroups/ QuasiGroup-4-20_c18.xml	? (TO)	2519.94	2520.01	4306117
Frb/ frb-45-21-1_c18.xml	? (TO)	2519.94	2520.01	4306174
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2519.94	2520.01	4306175
ColouredQueens/ ColouredQueens-12_c18.xml	? (TO)	2519.95	2520.01	4306045
Quasigroups/ QuasiGroup-4-14_c18.xml	? (TO)	2519.95	2520.01	4306115
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.95	2520.01	4306196
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2519.96	2520.01	4306109
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.96	2520.01	4306222
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.96	2520.01	4306195
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.97	2520.01	4306044
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.98	2520.01	4306191
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	? (TO)	2519.98	2520.01	4306162
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2519.98	2520.01	4306214
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.98	2520.01	4306221
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	? (TO)	2519.99	2520.01	4306105
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2519.99	2520.01	4306108
ColouredQueens/ ColouredQueens-14_c18.xml	? (TO)	2519.99	2520	4306047
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	? (TO)	2519.99	2520.01	4306213
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2520	2520.01	4306041
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2520.01	2520.01	4306168
Langford/ LangfordBin-16_c18.xml	? (TO)	2520.01	2520.01	4306060
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	? (TO)	2520.01	2519.9	4306165
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2520.01	2520.01	4306083
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2520.02	2519.9	4306212
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2520.03	2519.9	4306169
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2520.04	2519.9	4306197
Eternity/ Eternity-15-15_c18.xml	? (TO)	2520.04	2520.01	4306098
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2520.05	2519.9	4306193
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2520.05	2519.9	4306198
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.05	2520.01	4306186
Quasigroups/ QuasiGroup-4-10_c18.xml	? (TO)	2520.05	2520.01	4306113
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2520.05	2520.01	4306177
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2520.06	2519.9	4306192
Eternity/ Eternity-12-12_c18.xml	? (TO)	2520.06	2520.01	4306095
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2520.06	2519.9	4306078
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2520.06	2520	4306082
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2520.06	2520.01	4306183
Eternity/ Eternity-13-13_c18.xml	? (TO)	2520.06	2520.01	4306096
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f01_c18.xml	? (TO)	2520.06	2519.9	4306241
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2520.07	2520.01	4306185
Quasigroups/ QuasiGroup-4-12_c18.xml	? (TO)	2520.07	2520.01	4306114
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2520.07	2519.9	4306219
Eternity/ Eternity-10-10_c18.xml	? (TO)	2520.07	2520.01	4306093
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2520.08	2520.01	4306081
Quasigroups/ QuasiGroup-4-16_c18.xml	? (TO)	2520.08	2520.01	4306116
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2520.08	2520.01	4306076
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2520.08	2519.9	4306220
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.1	2519.9	4306080
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2520.1	2519.9	4306079

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver BTD_12 2018.07.27_12 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (45 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (32 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (22 runs) [Show/Hide]

Solver does not handle one of the constraint (73 runs) [Show/Hide]

Solver timed out (no solution given) (64 runs) [Show/Hide]