2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.009299	0.00960497	4294745
Quasigroups/ QuasiGroup-7-08_c18.xml	UNSAT	0.018722	0.0190199	4295937
Quasigroups/ QuasiGroup-7-07_c18.xml	UNSAT	0.040546	0.0407519	4295865
Quasigroups/ QuasiGroup-7-10_c18.xml	UNSAT	0.047863	0.0480969	4295919
Quasigroups/ QuasiGroup-7-12_c18.xml	UNSAT	0.097319	0.0975161	4295829
Quasigroups/ QuasiGroup-7-14_c18.xml	UNSAT	0.17361	0.17406	4295910
Langford/ LangfordBin-06_c18.xml	UNSAT	0.195304	0.196627	4294246
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.616595	0.616933	4294700
Quasigroups/ QuasiGroup-7-20_c18.xml	UNSAT	0.625437	0.625739	4295847
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.815246	0.815658	4292787
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f11_c18.xml	UNSAT	1.23719	1.23734	4293445
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f10_c18.xml	UNSAT	1.24083	1.2455	4293490
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f12_c18.xml	UNSAT	1.24235	1.24247	4293535
Quasigroups/ QuasiGroup-7-16_c18.xml	UNSAT	1.28381	1.28439	4295874
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f09_c18.xml	UNSAT	1.351	1.35125	4293472
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f08_c18.xml	UNSAT	1.45468	1.80254	4293544
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f07_c18.xml	UNSAT	3.24528	3.24546	4293481
Quasigroups/ QuasiGroup-4-07_c18.xml	UNSAT	4.03029	4.0351	4295901
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	4.40478	4.40641	4295236
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f06_c18.xml	UNSAT	5.49454	5.49454	4293517
Dubois/ Dubois-018_c18.xml	UNSAT	17.7884	17.7903	4294655
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	UNSAT	26.0478	26.0511	4293526
Dubois/ Dubois-020_c18.xml	UNSAT	50.295	50.2973	4294619
Dubois/ Dubois-021_c18.xml	UNSAT	61.9858	61.9924	4294610
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	UNSAT	87.6747	87.6822	4295263
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f04_c18.xml	UNSAT	93.1112	93.1475	4293508
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	124.528	124.527	4295290
Dubois/ Dubois-022_c18.xml	UNSAT	136.168	136.172	4294646
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	215.288	215.299	4295550
Dubois/ Dubois-023_c18.xml	UNSAT	306.19	306.244	4294601
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f03_c18.xml	UNSAT	329.17	329.224	4293463
Quasigroups/ QuasiGroup-4-08_c18.xml	UNSAT	362.113	362.123	4295892
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	404.351	404.369	4295227
Dubois/ Dubois-024_c18.xml	UNSAT	741.778	741.799	4294664
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	749.849	749.984	4294837
Dubois/ Dubois-025_c18.xml	UNSAT	906.646	906.713	4294673
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f02_c18.xml	UNSAT	1168.6	1168.68	4293454
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1255.85	1255.83	4295281

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.00722	0.00737704	4292859
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.00846	0.00856099	4292796
Eternity/ Eternity-04-04_c18.xml	SAT	0.010093	0.010255	4296080
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.010801	0.0109499	4293382
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	0.022013	0.022268	4293409
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.029517	0.0297259	4293346
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.045309	0.045662	4294855
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.120974	0.125322	4294873
Eternity/ Eternity-05-05_c18.xml	SAT	0.127409	0.128742	4296161
Langford/ LangfordBin-07_c18.xml	SAT	0.130054	0.130305	4294219
Quasigroups/ QuasiGroup-4-09_c18.xml	SAT	0.201643	0.201925	4295838
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	SAT	0.214913	0.219079	4293718
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.499503	0.504095	4294882
Frb/ frb-30-15-1_c18.xml	SAT	0.720313	0.720832	4295685
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	0.739757	0.741074	4293781
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	0.776255	0.776471	4293355
Eternity/ Eternity-10-04_c18.xml	SAT	1.93592	1.93629	4296125
Langford/ LangfordBin-08_c18.xml	SAT	2.82532	2.82574	4294210
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	3.53924	5.24153	4295245
Eternity/ Eternity-06-06_c18.xml	SAT	4.41929	4.42435	4296071
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	SAT	4.59194	4.59265	4293709
Eternity/ Eternity-10-05_c18.xml	SAT	4.67325	4.67346	4296089
Frb/ frb-35-17-1_c18.xml	SAT	10.9762	10.9767	4295613
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	37.9517	37.9574	4295568
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	52.1896	52.1865	4293364
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	54.1802	54.1771	4293754
Frb/ frb-40-19-1-mgd_c18.xml	SAT	58.7492	58.7604	4295703
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	183.746	183.758	4295532
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	335.846	335.883	4293418
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	576.168	576.207	4294918
Eternity/ Eternity-07-07_c18.xml	SAT	614.124	614.112	4296197
Quasigroups/ QuasiGroup-4-12_c18.xml	SAT	790.071	790.066	4295820

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-15_c18.xml	?	2520.01	2519.86	4292778
ColouredQueens/ ColouredQueens-12_c18.xml	?	2520.01	2519.86	4292868
ColouredQueens/ ColouredQueens-09_c18.xml	?	2520.01	2519.89	4292805
ColouredQueens/ ColouredQueens-13_c18.xml	?	2520.01	2519.86	4292832
ColouredQueens/ ColouredQueens-11_c18.xml	?	2520.01	2519.89	4292850
ColouredQueens/ ColouredQueens-14_c18.xml	?	2520.01	2519.89	4292841
Langford/ LangfordBin-11_c18.xml	?	2520.01	2519.92	4294183
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	?	2520.01	2519.87	4293772
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	?	2520.01	2519.87	4293790
Langford/ LangfordBin-12_c18.xml	?	2520.01	2519.86	4294174
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	?	2520.02	2519.9	4293373
Eternity/ Eternity-08-08_c18.xml	?	2520.03	2519.98	4296179
Frb/ frb-45-21-1_c18.xml	?	2520.04	2520.01	4295658
Eternity/ Eternity-09-09_c18.xml	?	2520.05	2520.01	4296143
Quasigroups/ QuasiGroup-4-10_c18.xml	?	2520.05	2519.99	4295811
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	?	2520.07	2519.96	4293799

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CarSequencing/ CarSequencing-dingbas_c18.xml	? (NS)	0.006247	0.00645802	4295026
MisteryShopper/ MisteryShopper-04_c18.xml	? (NS)	0.007262	0.00755802	4294556
SportsScheduling/ SportsScheduling-08_c18.xml	? (NS)	0.007354	0.00763998	4295784
Bibd/ Bibd-sum-07-03-01_c18.xml	? (NS)	0.008309	0.00852703	4294066
CarSequencing/ CarSequencing-06-76_c18.xml	? (NS)	0.008314	0.00869994	4294990
CarSequencing/ CarSequencing-04-72_c18.xml	? (NS)	0.008342	0.00869511	4295035
SportsScheduling/ SportsScheduling-10_c18.xml	? (NS)	0.008513	0.00895904	4295757
MisteryShopper/ MisteryShopper-10a_c18.xml	? (NS)	0.010542	0.0107761	4294502
CarSequencing/ CarSequencing-60-02_c18.xml	? (NS)	0.010573	2.17	4295071
CarSequencing/ CarSequencing-65-02_c18.xml	? (NS)	0.010602	0.010823	4295089
SportsScheduling/ SportsScheduling-12_c18.xml	? (NS)	0.010615	0.010904	4295802
CarSequencing/ CarSequencing-80-02_c18.xml	? (NS)	0.010743	0.0109931	4294972
CarSequencing/ CarSequencing-70-02_c18.xml	? (NS)	0.010751	0.0108569	4295080
CarSequencing/ CarSequencing-65-01_c18.xml	? (NS)	0.010765	0.010957	4294999
CarSequencing/ CarSequencing-75-02_c18.xml	? (NS)	0.010773	0.010995	4295098
MisteryShopper/ MisteryShopper-06a_c18.xml	? (NS)	0.010775	0.010975	4294565
CarSequencing/ CarSequencing-85-01_c18.xml	? (NS)	0.010783	0.0111949	4295017
CarSequencing/ CarSequencing-90-02_c18.xml	? (NS)	0.010783	0.0110411	4295062
CarSequencing/ CarSequencing-80-01_c18.xml	? (NS)	0.010804	0.011017	4295053
CarSequencing/ CarSequencing-70-01_c18.xml	? (NS)	0.01081	0.011012	4295008
CarSequencing/ CarSequencing-90-01_c18.xml	? (NS)	0.010844	0.010993	4295044
CarSequencing/ CarSequencing-75-01_c18.xml	? (NS)	0.010863	0.0110861	4294981
CarSequencing/ CarSequencing-85-02_c18.xml	? (NS)	0.010901	0.0111989	4294963
CarSequencing/ CarSequencing-60-01_c18.xml	? (NS)	0.010921	0.0112679	4294954
StripPacking/ StripPacking-1b_c18.xml	? (NS)	0.011371	0.0115811	4293141
StripPacking/ StripPacking-1a_c18.xml	? (NS)	0.01285	0.0130111	4293186
SportsScheduling/ SportsScheduling-14_c18.xml	? (NS)	0.013834	0.014053	4295730
StripPacking/ StripPacking-C1P3_c18.xml	? (NS)	0.014357	0.0145689	4293123
StripPacking/ StripPacking-C1P1_c18.xml	? (NS)	0.014363	0.01445	4293168
MisteryShopper/ MisteryShopper-06b_c18.xml	? (NS)	0.014884	0.015135	4294511
StripPacking/ StripPacking-C1P2_c18.xml	? (NS)	0.014953	0.0152169	4293114
StripPacking/ StripPacking-T1c_c18.xml	? (NS)	0.01613	0.0163291	4293132
StripPacking/ StripPacking-N1c_c18.xml	? (NS)	0.016509	0.0167951	4293213
MisteryShopper/ MisteryShopper-10b_c18.xml	? (NS)	0.016514	0.016975	4294538
StripPacking/ StripPacking-T1a_c18.xml	? (NS)	0.016721	0.0170289	4293150
StripPacking/ StripPacking-N1b_c18.xml	? (NS)	0.016899	0.017141	4293204
StripPacking/ StripPacking-N1a_c18.xml	? (NS)	0.016995	0.0171969	4293177
StripPacking/ StripPacking-T1d_c18.xml	? (NS)	0.017	0.017228	4293195
SportsScheduling/ SportsScheduling-16_c18.xml	? (NS)	0.018588	0.0191439	4295766
StripPacking/ StripPacking-C2P1_c18.xml	? (NS)	0.019703	0.01985	4293159
MisteryShopper/ MisteryShopper-06c_c18.xml	? (NS)	0.022189	0.0223379	4294520
SportsScheduling/ SportsScheduling-18_c18.xml	? (NS)	0.02765	0.027971	4295748
Bibd/ Bibd-sc-07-03-01_c18.xml	? (NS)	0.028032	0.0282011	4294111
MisteryShopper/ MisteryShopper-10c_c18.xml	? (NS)	0.028192	0.0283879	4294574
MisteryShopper/ MisteryShopper-06d_c18.xml	? (NS)	0.034027	0.0341481	4294529
MisteryShopper/ MisteryShopper-12_c18.xml	? (NS)	0.037579	0.0377291	4294547
SportsScheduling/ SportsScheduling-20_c18.xml	? (NS)	0.038767	0.039321	4295793
MisteryShopper/ MisteryShopper-10d_c18.xml	? (NS)	0.048037	0.0484171	4294493
SportsScheduling/ SportsScheduling-22_c18.xml	? (NS)	0.054164	0.0543641	4295721
Bibd/ Bibd-sum-12-06-05_c18.xml	? (NS)	0.067203	0.067396	4294165
SportsScheduling/ SportsScheduling-24_c18.xml	? (NS)	0.082492	0.082807	4295739
SportsScheduling/ SportsScheduling-26_c18.xml	? (NS)	0.113098	0.11756	4295775
SocialGolfers/ SocialGolfers-4-4-4-cp_c18.xml	? (NS)	0.149424	0.153905	4294394
SocialGolfers/ SocialGolfers-4-4-5-cp_c18.xml	? (NS)	0.248322	0.248777	4294466
Bibd/ Bibd-sc-12-06-05_c18.xml	? (NS)	0.302715	0.302882	4294156
SocialGolfers/ SocialGolfers-4-4-6-cp_c18.xml	? (NS)	0.378344	0.383841	4294403
Bibd/ Bibd-sum-09-03-09_c18.xml	? (NS)	0.427909	0.438328	4294075
SocialGolfers/ SocialGolfers-4-4-7-cp_c18.xml	? (NS)	0.542028	0.546603	4294475
SocialGolfers/ SocialGolfers-5-5-5-cp_c18.xml	? (NS)	0.655753	0.65602	4294385
Bibd/ Bibd-sum-10-03-08_c18.xml	? (NS)	0.761844	0.762249	4294102
SocialGolfers/ SocialGolfers-5-5-6-cp_c18.xml	? (NS)	1.0375	1.03906	4294439
Bibd/ Bibd-sc-09-03-09_c18.xml	? (NS)	1.27333	1.27385	4294084
Bibd/ Bibd-sum-22-033-12-08-04_c18.xml	? (NS)	1.41114	1.41123	4294129
SocialGolfers/ SocialGolfers-5-5-7-cp_c18.xml	? (NS)	1.52019	1.52079	4294448
Bibd/ Bibd-sc-10-03-08_c18.xml	? (NS)	2.07375	2.07941	4294147
SocialGolfers/ SocialGolfers-5-5-8-cp_c18.xml	? (NS)	2.21864	2.22282	4294457
SocialGolfers/ SocialGolfers-6-6-6-cp_c18.xml	? (NS)	2.50109	2.54287	4294430
Bibd/ Bibd-sc-22-033-12-08-04_c18.xml	? (NS)	3.27307	3.27306	4294138
SocialGolfers/ SocialGolfers-6-6-7-cp_c18.xml	? (NS)	3.80652	3.81132	4294484
SocialGolfers/ SocialGolfers-6-6-8-cp_c18.xml	? (NS)	5.69149	5.69428	4294412
SocialGolfers/ SocialGolfers-6-6-9-cp_c18.xml	? (NS)	8.1403	8.14416	4294421
Bibd/ Bibd-sum-34-085-30-12-10_c18.xml	? (NS)	94.6343	94.6555	4294120
Bibd/ Bibd-sc-34-085-30-12-10_c18.xml	? (NS)	167.798	167.819	4294093

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2519.46	2520.01	4294909
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.5	2520	4294891
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.51	2520.01	4294936
Dubois/ Dubois-050_c18.xml	? (TO)	2519.61	2520.01	4294583
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2519.66	2520.01	4295631
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.76	2520.01	4294846
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.77	2520.01	4292877
Haystacks/ Haystacks-ext-12_c18.xml	? (TO)	2519.77	2520.01	4294763
Eternity/ Eternity-13-13_c18.xml	? (TO)	2519.77	2520.01	4296134
Langford/ LangfordBin-13_c18.xml	? (TO)	2519.78	2520.01	4294255
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2519.78	2520.01	4293436
Langford/ LangfordBin-14_c18.xml	? (TO)	2519.8	2520.01	4294192
Haystacks/ Haystacks-ext-06_c18.xml	? (TO)	2519.81	2520.01	4294736
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2519.81	2520.01	4294718
Haystacks/ Haystacks-ext-11_c18.xml	? (TO)	2519.82	2520.01	4294691
Dubois/ Dubois-030_c18.xml	? (TO)	2519.83	2520.01	4294637
Langford/ LangfordBin-10_c18.xml	? (TO)	2519.84	2520.01	4294228
ColouredQueens/ ColouredQueens-16_c18.xml	? (TO)	2519.87	2520.01	4292814
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2519.87	2520.01	4294927
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.88	2520.01	4294900
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	? (TO)	2519.88	2520.01	4293400
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.88	2520.01	4293808
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2519.89	2520.01	4294864
Haystacks/ Haystacks-ext-10_c18.xml	? (TO)	2519.91	2520.01	4294772
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	? (TO)	2519.91	2520	4295317
Dubois/ Dubois-075_c18.xml	? (TO)	2519.91	2520.01	4294592
Langford/ LangfordBin-16_c18.xml	? (TO)	2519.91	2520.01	4294237
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2519.92	2520.01	4295649
Eternity/ Eternity-10-06_c18.xml	? (TO)	2519.92	2520.01	4296098
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2519.92	2520	4295577
Langford/ LangfordBin-15_c18.xml	? (TO)	2519.93	2520.01	4294201
Haystacks/ Haystacks-ext-07_c18.xml	? (TO)	2519.93	2520.01	4294754
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.93	2520.01	4293391
Eternity/ Eternity-11-11_c18.xml	? (TO)	2519.94	2520.01	4296116
Langford/ LangfordBin-09_c18.xml	? (TO)	2519.94	2520.01	4294264
Dubois/ Dubois-040_c18.xml	? (TO)	2519.94	2520.01	4294628
Haystacks/ Haystacks-ext-09_c18.xml	? (TO)	2519.94	2520.01	4294709
Haystacks/ Haystacks-ext-08_c18.xml	? (TO)	2519.94	2520.01	4294727
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2519.94	2520	4295640
Dubois/ Dubois-100_c18.xml	? (TO)	2519.94	2520.01	4294682
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	? (TO)	2519.95	2520.01	4295308
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.95	2520.01	4293817
ColouredQueens/ ColouredQueens-10_c18.xml	? (TO)	2519.96	2520.01	4292823
Eternity/ Eternity-10-10_c18.xml	? (TO)	2519.96	2520.01	4296152
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.99	2520.01	4293745
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2519.99	2520	4295299
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2520	2520.01	4293427
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2520.02	2520	4295272
Eternity/ Eternity-14-14_c18.xml	? (TO)	2520.02	2520.01	4296170
Quasigroups/ QuasiGroup-4-16_c18.xml	? (TO)	2520.02	2520	4295928
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2520.02	2520.01	4294945
Frb/ frb-53-24-3-mgd_c18.xml	? (TO)	2520.03	2520	4295595
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2520.03	2520	4295496
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2520.03	2519.9	4293763
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2520.03	2520.01	4295712
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f01_c18.xml	? (TO)	2520.03	2519.9	4293499
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2520.03	2520	4295622
Eternity/ Eternity-12-12_c18.xml	? (TO)	2520.04	2520.01	4296188
Quasigroups/ QuasiGroup-4-20_c18.xml	? (TO)	2520.04	2520.01	4295946
Frb/ frb-50-23-2-mgd_c18.xml	? (TO)	2520.04	2520.01	4295667
Frb/ frb-53-24-2-mgd_c18.xml	? (TO)	2520.04	2520	4295694
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2520.04	2519.9	4293736
Eternity/ Eternity-15-15_c18.xml	? (TO)	2520.04	2520.01	4296107
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2520.04	2520	4295541
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2520.05	2520	4295254
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2520.05	2520	4295514
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2520.05	2520.01	4295676
Quasigroups/ QuasiGroup-4-14_c18.xml	? (TO)	2520.05	2520.01	4295883
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2520.06	2520	4295505
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2520.06	2520.01	4295604
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2520.06	2520	4295487
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.06	2520.01	4295586
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2520.06	2520	4295478
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2520.07	2520.01	4295559
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2520.07	2520.01	4295523
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2520.11	2520.01	4293727

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver macht 2018.06.11 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (38 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (32 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (16 runs) [Show/Hide]

Solver does not handle one of the constraint (73 runs) [Show/Hide]

Solver timed out (no solution given) (76 runs) [Show/Hide]

Solver wrongly proved unsatitisfiability (1 run) [Show/Hide]