2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.009678	0.00993706	4305964
Langford/ LangfordBin-06_c18.xml	UNSAT	0.192862	0.197168	4305814
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.64627	0.646748	4305965
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.796574	1.85094	4305803
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f12_c18.xml	UNSAT	1.23234	1.2338	4305998
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f10_c18.xml	UNSAT	1.24668	1.24824	4306001
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f11_c18.xml	UNSAT	1.24857	1.25354	4306002
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f09_c18.xml	UNSAT	1.35673	1.35699	4306004
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f08_c18.xml	UNSAT	1.45033	1.45123	4306007
Quasigroups/ QuasiGroup-7-07_c18.xml	UNSAT	2.95697	3.45947	4305882
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f07_c18.xml	UNSAT	3.28204	3.77868	4305997
Quasigroups/ QuasiGroup-4-07_c18.xml	UNSAT	4.02685	4.02795	4305874
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	4.4338	4.43417	4305934
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f06_c18.xml	UNSAT	5.47449	6.18098	4305999
Dubois/ Dubois-018_c18.xml	UNSAT	17.8732	17.8749	4305825
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	UNSAT	25.7817	25.7823	4306006
Dubois/ Dubois-020_c18.xml	UNSAT	47.8796	47.8832	4305826
Dubois/ Dubois-021_c18.xml	UNSAT	59.7283	59.7386	4305827
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT	88.8121	88.8111	4305925
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f04_c18.xml	UNSAT	90.8882	90.9154	4306003
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	124.28	124.302	4305930
Dubois/ Dubois-022_c18.xml	UNSAT	135.243	135.25	4305828
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	215.353	215.353	4305838
Dubois/ Dubois-023_c18.xml	UNSAT	298.18	298.235	4305829
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f03_c18.xml	UNSAT	325.57	325.653	4306000
Quasigroups/ QuasiGroup-4-08_c18.xml	UNSAT	370.927	370.914	4305875
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	404.588	404.585	4305927
Quasigroups/ QuasiGroup-7-08_c18.xml	UNSAT	567.455	567.504	4305883
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	747.785	747.831	4305963
Dubois/ Dubois-024_c18.xml	UNSAT	757.22	757.226	4305830
Dubois/ Dubois-025_c18.xml	UNSAT	906.527	906.566	4305831
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f02_c18.xml	UNSAT	1156.08	1156.14	4306008
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1255.04	1255.01	4305928

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.006501	0.00670292	4305802
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.007578	0.00780096	4305804
Eternity/ Eternity-04-04_c18.xml	SAT	0.009975	0.0102041	4305848
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.010806	0.0110671	4305864
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	0.022101	0.0580531	4305863
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.028259	0.028504	4305865
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.04562	0.0459609	4305951
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.12003	0.124703	4305952
Eternity/ Eternity-05-05_c18.xml	SAT	0.126453	0.126648	4305849
Langford/ LangfordBin-07_c18.xml	SAT	0.126583	0.131067	4305815
Quasigroups/ QuasiGroup-4-09_c18.xml	SAT	0.202467	0.202827	4305876
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT	0.215757	0.220116	4305979
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.496332	0.500683	4305953
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	0.736179	0.736446	4305981
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	0.773926	0.77941	4305866
Frb/ frb-30-15-1_c18.xml	SAT	0.840146	0.84733	4305935
Eternity/ Eternity-10-04_c18.xml	SAT	1.91396	1.91395	4305854
Langford/ LangfordBin-08_c18.xml	SAT	2.80016	2.8048	4305816
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	3.54232	3.80321	4305924
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT	3.7992	3.80488	4305980
Eternity/ Eternity-06-06_c18.xml	SAT	4.22512	4.22541	4305850
Eternity/ Eternity-10-05_c18.xml	SAT	4.86149	4.86627	4305855
Frb/ frb-35-17-1_c18.xml	SAT	12.7213	12.7213	4305936
Quasigroups/ QuasiGroup-7-09_c18.xml	SAT	14.0445	14.0458	4305884
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	37.8865	37.886	4305837
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	48.7847	48.7915	4305982
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	51.6233	51.6243	4305867
Frb/ frb-40-19-1-mgd_c18.xml	SAT	69.5881	69.6017	4305937
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	183.432	183.431	4305839
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	339.083	339.091	4305868
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	572.951	573.034	4305954
Eternity/ Eternity-07-07_c18.xml	SAT	633.878	633.905	4305851
Quasigroups/ QuasiGroup-4-12_c18.xml	SAT	791.473	791.418	4305878

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Quasigroups/ QuasiGroup-7-10_c18.xml	?	2520.01	2519.82	4305885
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	?	2520.02	2519.98	4305926
Quasigroups/ QuasiGroup-7-14_c18.xml	?	2520.03	2519.86	4305887
Eternity/ Eternity-08-08_c18.xml	?	2520.03	2519.98	4305852
Frb/ frb-50-23-2-mgd_c18.xml	?	2520.05	2520	4305940
Frb/ frb-53-24-2-mgd_c18.xml	?	2520.06	2520	4305943

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CarSequencing/ CarSequencing-dingbas_c18.xml	? (NS)	0.006274	0.00647294	4305801
MisteryShopper/ MisteryShopper-04_c18.xml	? (NS)	0.007297	0.00743896	4305987
SportsScheduling/ SportsScheduling-08_c18.xml	? (NS)	0.007402	0.00763103	4305914
Bibd/ Bibd-sum-07-03-01_c18.xml	? (NS)	0.008394	0.00879392	4305779
CarSequencing/ CarSequencing-06-76_c18.xml	? (NS)	0.008448	0.00860106	4305786
CarSequencing/ CarSequencing-04-72_c18.xml	? (NS)	0.008457	0.00897501	4305785
SportsScheduling/ SportsScheduling-10_c18.xml	? (NS)	0.008566	0.00873592	4305915
CarSequencing/ CarSequencing-60-02_c18.xml	? (NS)	0.010564	0.010799	4305788
MisteryShopper/ MisteryShopper-10a_c18.xml	? (NS)	0.010777	0.0108869	4305992
CarSequencing/ CarSequencing-65-02_c18.xml	? (NS)	0.010778	0.011068	4305790
MisteryShopper/ MisteryShopper-06a_c18.xml	? (NS)	0.010792	0.011024	4305988
CarSequencing/ CarSequencing-65-01_c18.xml	? (NS)	0.010855	0.0112701	4305789
CarSequencing/ CarSequencing-85-01_c18.xml	? (NS)	0.01088	0.0112341	4305797
CarSequencing/ CarSequencing-80-02_c18.xml	? (NS)	0.010894	0.0112609	4305796
CarSequencing/ CarSequencing-85-02_c18.xml	? (NS)	0.0109	0.0112259	4305798
CarSequencing/ CarSequencing-90-01_c18.xml	? (NS)	0.010905	0.011417	4305799
CarSequencing/ CarSequencing-60-01_c18.xml	? (NS)	0.010907	0.011183	4305787
CarSequencing/ CarSequencing-75-02_c18.xml	? (NS)	0.010916	0.011187	4305794
CarSequencing/ CarSequencing-75-01_c18.xml	? (NS)	0.010971	0.0111989	4305793
CarSequencing/ CarSequencing-70-02_c18.xml	? (NS)	0.010975	0.0109899	4305792
CarSequencing/ CarSequencing-80-01_c18.xml	? (NS)	0.010975	0.0112311	4305795
CarSequencing/ CarSequencing-90-02_c18.xml	? (NS)	0.011013	0.011248	4305800
SportsScheduling/ SportsScheduling-12_c18.xml	? (NS)	0.011021	0.011187	4305916
CarSequencing/ CarSequencing-70-01_c18.xml	? (NS)	0.011034	0.011329	4305791
StripPacking/ StripPacking-1b_c18.xml	? (NS)	0.011107	0.0114961	4305903
StripPacking/ StripPacking-1a_c18.xml	? (NS)	0.012263	0.0124759	4305902
StripPacking/ StripPacking-C1P1_c18.xml	? (NS)	0.014102	0.0144669	4305904
StripPacking/ StripPacking-C1P3_c18.xml	? (NS)	0.014105	0.0143481	4305906
StripPacking/ StripPacking-C1P2_c18.xml	? (NS)	0.014493	0.0149389	4305905
SportsScheduling/ SportsScheduling-14_c18.xml	? (NS)	0.014585	0.0149201	4305917
MisteryShopper/ MisteryShopper-06b_c18.xml	? (NS)	0.015083	0.0151939	4305989
StripPacking/ StripPacking-T1c_c18.xml	? (NS)	0.01595	0.016105	4305912
StripPacking/ StripPacking-T1d_c18.xml	? (NS)	0.015964	0.0161699	4305913
StripPacking/ StripPacking-N1c_c18.xml	? (NS)	0.015964	0.0160731	4305910
StripPacking/ StripPacking-N1b_c18.xml	? (NS)	0.015967	0.016134	4305909
StripPacking/ StripPacking-N1a_c18.xml	? (NS)	0.016008	0.016327	4305908
StripPacking/ StripPacking-T1a_c18.xml	? (NS)	0.016073	0.0163991	4305911
MisteryShopper/ MisteryShopper-10b_c18.xml	? (NS)	0.016658	0.0167641	4305993
StripPacking/ StripPacking-C2P1_c18.xml	? (NS)	0.018816	0.019223	4305907
SportsScheduling/ SportsScheduling-16_c18.xml	? (NS)	0.019142	0.0192621	4305918
MisteryShopper/ MisteryShopper-06c_c18.xml	? (NS)	0.021999	0.0221391	4305990
Bibd/ Bibd-sc-07-03-01_c18.xml	? (NS)	0.028127	0.0283131	4305773
MisteryShopper/ MisteryShopper-10c_c18.xml	? (NS)	0.028242	0.028602	4305994
SportsScheduling/ SportsScheduling-18_c18.xml	? (NS)	0.028249	0.0283559	4305919
MisteryShopper/ MisteryShopper-06d_c18.xml	? (NS)	0.033959	0.0342579	4305991
MisteryShopper/ MisteryShopper-12_c18.xml	? (NS)	0.037557	0.03802	4305996
SportsScheduling/ SportsScheduling-20_c18.xml	? (NS)	0.039309	0.039522	4305920
MisteryShopper/ MisteryShopper-10d_c18.xml	? (NS)	0.048266	0.048364	4305995
SportsScheduling/ SportsScheduling-22_c18.xml	? (NS)	0.054951	0.063533	4305921
Bibd/ Bibd-sum-12-06-05_c18.xml	? (NS)	0.067454	0.0677841	4305782
SportsScheduling/ SportsScheduling-24_c18.xml	? (NS)	0.083865	0.0841509	4305922
SportsScheduling/ SportsScheduling-26_c18.xml	? (NS)	0.11423	1.01771	4305923
SocialGolfers/ SocialGolfers-4-4-4-cp_c18.xml	? (NS)	0.148712	0.168496	4305890
SocialGolfers/ SocialGolfers-4-4-5-cp_c18.xml	? (NS)	0.250349	0.250785	4305891
Bibd/ Bibd-sc-12-06-05_c18.xml	? (NS)	0.302784	0.304192	4305776
SocialGolfers/ SocialGolfers-4-4-6-cp_c18.xml	? (NS)	0.382245	0.382597	4305892
Bibd/ Bibd-sum-09-03-09_c18.xml	? (NS)	0.424081	0.424531	4305780
SocialGolfers/ SocialGolfers-4-4-7-cp_c18.xml	? (NS)	0.544489	0.549057	4305893
SocialGolfers/ SocialGolfers-5-5-5-cp_c18.xml	? (NS)	0.659675	0.661223	4305894
Bibd/ Bibd-sum-10-03-08_c18.xml	? (NS)	0.757458	0.758849	4305781
SocialGolfers/ SocialGolfers-5-5-6-cp_c18.xml	? (NS)	1.03495	1.0353	4305895
Bibd/ Bibd-sc-09-03-09_c18.xml	? (NS)	1.25881	1.25916	4305774
Bibd/ Bibd-sum-22-033-12-08-04_c18.xml	? (NS)	1.26263	1.26299	4305783
SocialGolfers/ SocialGolfers-5-5-7-cp_c18.xml	? (NS)	1.5275	1.52787	4305896
Bibd/ Bibd-sc-10-03-08_c18.xml	? (NS)	2.05874	2.05918	4305775
SocialGolfers/ SocialGolfers-5-5-8-cp_c18.xml	? (NS)	2.15334	2.74125	4305897
SocialGolfers/ SocialGolfers-6-6-6-cp_c18.xml	? (NS)	2.50533	2.50968	4305898
Bibd/ Bibd-sc-22-033-12-08-04_c18.xml	? (NS)	3.0813	3.27526	4305777
SocialGolfers/ SocialGolfers-6-6-7-cp_c18.xml	? (NS)	3.83331	3.83666	4305899
SocialGolfers/ SocialGolfers-6-6-8-cp_c18.xml	? (NS)	5.65434	5.65511	4305900
SocialGolfers/ SocialGolfers-6-6-9-cp_c18.xml	? (NS)	8.32781	8.32861	4305901
Bibd/ Bibd-sum-34-085-30-12-10_c18.xml	? (NS)	95.4056	95.4353	4305784
Bibd/ Bibd-sc-34-085-30-12-10_c18.xml	? (NS)	167.578	167.61	4305778

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Quasigroups/ QuasiGroup-4-16_c18.xml	? (TO)	2519.65	2520.01	4305880
Eternity/ Eternity-10-06_c18.xml	? (TO)	2519.67	2520.01	4305856
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2519.74	2520.01	4305961
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.74	2520.01	4305959
Quasigroups/ QuasiGroup-7-12_c18.xml	? (TO)	2519.76	2520.01	4305886
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f01_c18.xml	? (TO)	2519.77	2520	4306005
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.77	2520.01	4305986
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2519.78	2520.01	4305983
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.78	2520.01	4305870
Langford/ LangfordBin-14_c18.xml	? (TO)	2519.79	2520.01	4305822
Eternity/ Eternity-12-12_c18.xml	? (TO)	2519.79	2520.01	4305859
Quasigroups/ QuasiGroup-7-20_c18.xml	? (TO)	2519.8	2520.01	4305889
ColouredQueens/ ColouredQueens-10_c18.xml	? (TO)	2519.8	2520.01	4305807
Haystacks/ Haystacks-ext-07_c18.xml	? (TO)	2519.81	2520.01	4305967
Haystacks/ Haystacks-ext-09_c18.xml	? (TO)	2519.81	2520.01	4305969
Langford/ LangfordBin-13_c18.xml	? (TO)	2519.82	2520.01	4305821
ColouredQueens/ ColouredQueens-12_c18.xml	? (TO)	2519.82	2520.01	4305809
Eternity/ Eternity-09-09_c18.xml	? (TO)	2519.82	2520.01	4305853
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.85	2520.01	4305955
Dubois/ Dubois-040_c18.xml	? (TO)	2519.85	2520.01	4305833
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2519.88	2520	4305962
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.89	2520.01	4305957
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	? (TO)	2519.9	2520.01	4305977
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2519.91	2520.01	4305939
Eternity/ Eternity-10-10_c18.xml	? (TO)	2519.91	2520.01	4305857
Quasigroups/ QuasiGroup-7-16_c18.xml	? (TO)	2519.91	2520.01	4305888
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2519.91	2520.01	4305956
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2519.91	2520.01	4305978
Langford/ LangfordBin-10_c18.xml	? (TO)	2519.91	2520.01	4305818
Haystacks/ Haystacks-ext-11_c18.xml	? (TO)	2519.91	2520.01	4305971
Dubois/ Dubois-050_c18.xml	? (TO)	2519.91	2520.01	4305834
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2519.91	2520.01	4305932
Langford/ LangfordBin-12_c18.xml	? (TO)	2519.91	2520.01	4305820
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2519.92	2520.01	4305942
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	? (TO)	2519.92	2520.01	4305871
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.92	2520.01	4305808
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	? (TO)	2519.93	2520	4305974
Haystacks/ Haystacks-ext-06_c18.xml	? (TO)	2519.94	2520.01	4305966
Eternity/ Eternity-15-15_c18.xml	? (TO)	2519.94	2520.01	4305862
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2519.94	2520.01	4305840
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2519.94	2520.01	4305947
ColouredQueens/ ColouredQueens-16_c18.xml	? (TO)	2519.94	2520.01	4305813
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2519.95	2520.01	4305958
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2519.95	2520.01	4305973
Langford/ LangfordBin-11_c18.xml	? (TO)	2519.95	2520.01	4305819
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2519.96	2520.01	4305933
ColouredQueens/ ColouredQueens-13_c18.xml	? (TO)	2519.97	2520.01	4305810
Haystacks/ Haystacks-ext-10_c18.xml	? (TO)	2519.97	2520.01	4305970
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2519.97	2520.01	4305984
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.97	2520.01	4305985
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.98	2520.01	4305805
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.98	2520.01	4305960
Langford/ LangfordBin-16_c18.xml	? (TO)	2519.98	2520.01	4305824
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	? (TO)	2519.98	2520.01	4305975
Haystacks/ Haystacks-ext-08_c18.xml	? (TO)	2519.99	2520.01	4305968
Dubois/ Dubois-030_c18.xml	? (TO)	2519.99	2520.01	4305832
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2519.99	2520.01	4305945
ColouredQueens/ ColouredQueens-15_c18.xml	? (TO)	2519.99	2520	4305812
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2519.99	2520.01	4305873
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.99	2520.01	4305976
Langford/ LangfordBin-09_c18.xml	? (TO)	2519.99	2520.01	4305817
ColouredQueens/ ColouredQueens-09_c18.xml	? (TO)	2519.99	2520.01	4305806
Dubois/ Dubois-100_c18.xml	? (TO)	2520	2520.01	4305836
Dubois/ Dubois-075_c18.xml	? (TO)	2520	2520.01	4305835
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	? (TO)	2520	2520.01	4305869
ColouredQueens/ ColouredQueens-14_c18.xml	? (TO)	2520	2520.01	4305811
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2520	2520.01	4305872
Langford/ LangfordBin-15_c18.xml	? (TO)	2520.01	2520.01	4305823
Haystacks/ Haystacks-ext-12_c18.xml	? (TO)	2520.01	2520.01	4305972
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	? (TO)	2520.02	2520.01	4305929
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2520.02	2520.01	4305948
Quasigroups/ QuasiGroup-4-10_c18.xml	? (TO)	2520.03	2519.9	4305877
Eternity/ Eternity-14-14_c18.xml	? (TO)	2520.03	2519.9	4305861
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2520.03	2520.01	4305946
Frb/ frb-53-24-3-mgd_c18.xml	? (TO)	2520.04	2520.01	4305944
Frb/ frb-45-21-1_c18.xml	? (TO)	2520.04	2520.01	4305938
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2520.04	2520.01	4305847
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2520.04	2520.01	4305845
Eternity/ Eternity-13-13_c18.xml	? (TO)	2520.05	2519.9	4305860
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2520.05	2520.01	4305931
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2520.05	2520.01	4305941
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2520.05	2520.01	4305949
Eternity/ Eternity-11-11_c18.xml	? (TO)	2520.05	2519.9	4305858
Quasigroups/ QuasiGroup-4-20_c18.xml	? (TO)	2520.05	2520.01	4305881
Quasigroups/ QuasiGroup-4-14_c18.xml	? (TO)	2520.05	2520.01	4305879
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2520.06	2520.01	4305843
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2520.06	2520.01	4305841
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.06	2520.01	4305950
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.07	2520.01	4305844
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2520.07	2520.01	4305842
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2520.07	2520.01	4305846

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver macht 2018.07.27 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (33 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (33 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (6 runs) [Show/Hide]

Solver does not handle one of the constraint (73 runs) [Show/Hide]

Solver timed out (no solution given) (91 runs) [Show/Hide]