2018 XCSP3 competition: fast COP track: benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Auction/Auction-sum/ Auction-sum-example_c18.xml	OPT	54	5.99747	3.3035	4302935
Auction/Auction-cnt/ Auction-cnt-example_c18.xml	OPT	54	6.08432	3.24433	4302924
SumColoring/ SumColoring-myciel3_c18.xml	OPT	10	6.70273	3.54585	4302841
PseudoBoolean-opt/ Pb-garden-4x4_c18.xml	OPT	4	7.08905	3.65102	4302743
GraphColoring/ GraphColoring-queen5-5_c18.xml	OPT	4	7.14146	3.62192	4302644
TemplateDesign/ TemplateDesign-m1s-1_c18.xml	OPT	2	7.3997	3.8236	4302822
Rcpsp/ Rcpsp-j30-01-02_c18.xml	OPT	47	7.55478	3.68867	4302716
GolombRuler/ GolombRuler-a3v18-07_c18.xml	OPT	25	7.75792	3.74253	4302698
Rcpsp/ Rcpsp-j30-01-04_c18.xml	OPT	62	7.88266	3.81016	4302718
Mario/ Mario-easy-2_c18.xml	OPT	628	7.89476	4.19423	4302846
TemplateDesign/ TemplateDesign-m1-1_c18.xml	OPT	2	7.95411	3.89035	4302817
TemplateDesign/ TemplateDesign-m2-1_c18.xml	OPT	2	7.98032	3.91021	4302827
Rcpsp/ Rcpsp-j30-01-01_c18.xml	OPT	43	8.07512	3.88592	4302715
Rcpsp/ Rcpsp-j30-01-03_c18.xml	OPT	47	8.36212	4.32248	4302717
TemplateDesign/ TemplateDesign-m1s-2_c18.xml	OPT	2	8.73845	4.13755	4302823
Rcpsp/ Rcpsp-j60-01-04_c18.xml	OPT	91	9.03158	4.26725	4302722
Bacp/Bacp-m1/ Bacp-m1-05_c18.xml	OPT	9	9.11489	4.72834	4302881
Rcpsp/ Rcpsp-j60-01-01_c18.xml	OPT	77	9.37225	5.44367	4302719
TemplateDesign/ TemplateDesign-m2-2_c18.xml	OPT	2	9.37679	4.51914	4302828
Rcpsp/ Rcpsp-j60-01-02_c18.xml	OPT	68	9.41261	4.39388	4302720
SteelMillSlab/ SteelMillSlab-m2-simple_c18.xml	OPT	0	9.44936	4.52324	4302806
Rcpsp/ Rcpsp-j60-01-03_c18.xml	OPT	68	9.50078	4.26412	4302721
CrosswordDesign/ CrosswordDesign-03-4-rom_c18.xml	OPT	12	9.60983	4.34842	4302645
TemplateDesign/ TemplateDesign-m1-2_c18.xml	OPT	2	9.62595	4.3568	4302818
SteelMillSlab/ SteelMillSlab-m1-simple_c18.xml	OPT	0	9.62847	4.36532	4302795
QuadraticAssignment/ QuadraticAssignment-qap_c18.xml	OPT	4776	9.96581	5.0004	4302761
Fapp/Fapp-m2s/ Fapp-m2s-ex1_c18.xml	OPT	523	10.035	4.60364	4302951
Tal/ Tal-01_c18.xml	OPT	6	10.0541	4.35689	4302807
Fapp/Fapp-m2s/ Fapp-m2s-ex2_c18.xml	OPT	13871	10.3106	4.51021	4302939
GolombRuler/ GolombRuler-a3v18-08_c18.xml	OPT	34	10.4095	5.15103	4302699
TemplateDesign/ TemplateDesign-m1-catfood_c18.xml	OPT	2	10.7628	4.83828	4302819
Rcpsp/ Rcpsp-j90-01-02_c18.xml	OPT	92	10.9549	5.25151	4302724
TemplateDesign/ TemplateDesign-m1s-catfood_c18.xml	OPT	2	11.5912	4.85914	4302824
TemplateDesign/ TemplateDesign-m2-catfood_c18.xml	OPT	2	11.7116	5.05917	4302829
Bacp/Bacp-m2/ Bacp-m2-05_c18.xml	OPT	9	12.0405	5.10709	4302886
Knapsack/ Knapsack-30-100-01_c18.xml	OPT	871	12.1902	5.7701	4302621
Rcpsp/ Rcpsp-j90-01-03_c18.xml	OPT	66	13.0295	5.64366	4302725
TravellingSalesman/ TravellingSalesman-10-20-00_c18.xml	OPT	47	13.0852	6.33199	4302687
Rcpsp/ Rcpsp-j90-01-01_c18.xml	OPT	73	13.5632	5.62259	4302723
Mario/ Mario-easy-5_c18.xml	OPT	445	14.2538	6.386	4302848
CrosswordDesign/ CrosswordDesign-04-4-rom_c18.xml	OPT	24	14.6377	6.37482	4302646
Knapsack/ Knapsack-30-100-00_c18.xml	OPT	709	14.8474	7.63063	4302620
PeacableArmies/ PeacableArmies-m1-05_c18.xml	OPT	4	15.6156	6.40731	4302658
SumColoring/ SumColoring-myciel4_c18.xml	OPT	22	17.0656	10.0092	4302842
Mario/ Mario-easy-4_c18.xml	OPT	545	17.1522	7.61092	4302847
GraphColoring/ GraphColoring-5-fullins-3_c18.xml	OPT	7	18.3278	8.17004	4302638
TravelingTournament/ TravelingTournament-a3-galaxy04_c18.xml	OPT	416	18.784	8.51975	4302679
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	19.1224	11.5154	4302700
PseudoBoolean-opt/ Pb-circ4-3_c18.xml	OPT	20	20.2401	8.79957	4302738
LowAutocorrelation/ LowAutocorrelation-015_c18.xml	OPT	15	20.4326	11.2267	4302856
PizzaVoucher/ PizzaVoucher-10a_c18.xml	OPT	210	21.9812	12.0676	4302727
Tal/ Tal-02_c18.xml	OPT	86	22.1656	8.92141	4302808
Rlfap/Rlfap-opt/ Rlfap-scen-05-opt_c18.xml	OPT	792	22.3027	8.44215	4302899
SumColoring/ SumColoring-1-fullins-3_c18.xml	OPT	24	24.528	17.0947	4302832
StillLife/ StillLife-wastage-08_c18.xml	OPT	36	25.7738	13.9539	4302607
Rlfap/Rlfap-opt/ Rlfap-graph-03-opt_c18.xml	OPT	380	26.5235	12.5687	4302917
Bacp/Bacp-m1/ Bacp-m1-06_c18.xml	OPT	10	28.117	18.9431	4302879
PseudoBoolean-opt/ Pb-garden-7x7_c18.xml	OPT	12	28.3557	18.9567	4302744
Rlfap/Rlfap-opt/ Rlfap-scen-04-opt_c18.xml	OPT	46	30.1353	13.2866	4302898
Mario/ Mario-t-hard-1_c18.xml	OPT	4783	32.7116	18.8422	4302853
Mario/ Mario-t-hard-2_c18.xml	OPT	4850	33.1028	18.658	4302854
Mario/ Mario-t-hard-5_c18.xml	OPT	4482	33.3608	18.74	4302855
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	OPT	2	34.0331	15.1991	4302830
PeacableArmies/ PeacableArmies-m2-05_c18.xml	OPT	4	36.1192	25.3333	4302665
Bacp/Bacp-m2/ Bacp-m2-06_c18.xml	OPT	10	36.4133	24.9172	4302882
Rlfap/Rlfap-opt/ Rlfap-graph-04-opt_c18.xml	OPT	394	38.3776	20.4396	4302904
QuadraticAssignment/ QuadraticAssignment-esc16d_c18.xml	OPT	8	52.9065	43.3119	4302752
NurseRostering/ NurseRostering-00_c18.xml	OPT	1202	56.5436	44.9707	4302769
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	59.3304	39.4917	4302894
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	60.6634	50.7106	4302729
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	OPT	63832030	62.7948	39.2727	4302946
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	68.6595	60.1615	4302701
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	OPT	162507055	69.7891	44.0613	4302947
TemplateDesign/ TemplateDesign-m1s-herbs_c18.xml	OPT	2	70.127	44.9713	4302825
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	OPT	506362597	93.0681	63.5356	4302952
Rcpsp/ Rcpsp-j90-01-04_c18.xml	OPT	86	95.9426	84.8575	4302726
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	OPT	130971634	102.594	60.392	4302955
StillLife/ StillLife-wastage-09_c18.xml	OPT	43	106.979	87.9035	4302608
PizzaVoucher/ PizzaVoucher-10b_c18.xml	OPT	28	113.029	102.119	4302728
Knapsack/ Knapsack-40-150-01_c18.xml	OPT	1128	117.04	100.767	4302623
CrosswordDesign/ CrosswordDesign-05-4-rom_c18.xml	OPT	38	139.779	125.314	4302647
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	209.951	199.46	4302708
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	229.383	213.337	4302770

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
TravelingTournament/ TravelingTournament-a2-galaxy04_c18.xml	SAT	517	15.3231	6.37996	4302672

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
NurseRostering/ NurseRostering-05_c18.xml	SAT (TO)	4990	252.042	227.049	4302774
PizzaVoucher/ PizzaVoucher-22a_c18.xml	SAT (TO)	74	252.043	237.536	4302735
Mario/ Mario-n-medium-5_c18.xml	SAT (TO)	771	252.045	236.147	4302852
Bacp/Bacp-m1/ Bacp-m1-07a_c18.xml	SAT (TO)	12	252.05	233.236	4302870
PseudoBoolean-opt/ Pb-radar-10-10-45-050-100_c18.xml	SAT (TO)	16	252.05	232.15	4302746
Rcpsp/ Rcpsp-j120-01-02_c18.xml	SAT (TO)	113	252.051	238.436	4302712
Tal/ Tal-06_c18.xml	SAT (TO)	106	252.052	231.647	4302812
Knapsack/ Knapsack-50-200-00_c18.xml	SAT (TO)	960	252.052	234.633	4302624
TravelingTournament/ TravelingTournament-a3-galaxy12_c18.xml	SAT (TO)	9935	252.052	221.057	4302683
PizzaVoucher/ PizzaVoucher-18b_c18.xml	SAT (TO)	60	252.052	236.939	4302734
TravellingSalesman/ TravellingSalesman-75-50-00_c18.xml	SAT (TO)	647	252.053	235.044	4302697
LowAutocorrelation/ LowAutocorrelation-035_c18.xml	SAT (TO)	165	252.053	229.238	4302867
StillLife/ StillLife-wastage-15_c18.xml	SAT (TO)	107	252.053	228.049	4302614
Tal/ Tal-03_c18.xml	SAT (TO)	96	252.054	232.638	4302809
Bacp/Bacp-m2/ Bacp-m2-07a_c18.xml	SAT (TO)	12	252.056	233.341	4302883
Knapsack/ Knapsack-40-150-00_c18.xml	SAT (TO)	932	252.056	235.054	4302622
Knapsack/ Knapsack-60-250-00_c18.xml	SAT (TO)	1404	252.056	234.449	4302626
Bacp/Bacp-m2/ Bacp-m2-08b_c18.xml	SAT (TO)	17	252.059	231.75	4302885
Tal/ Tal-04_c18.xml	SAT (TO)	142	252.06	232.75	4302810
SumColoring/ SumColoring-1-fullins-4_c18.xml	SAT (TO)	73	252.06	238.236	4302833
Auction/Auction-cnt/ Auction-cnt-decay400_c18.xml	SAT (TO)	1605517	252.061	223.051	4302926
TravellingSalesman/ TravellingSalesman-100-50-00_c18.xml	SAT (TO)	790	252.062	235.154	4302686
Auction/Auction-cnt/ Auction-cnt-matching040_c18.xml	SAT (TO)	8233961	252.063	224.341	4302927
TravellingSalesman/ TravellingSalesman-50-30-00_c18.xml	SAT (TO)	262	252.065	238.734	4302696
NurseRostering/ NurseRostering-04_c18.xml	SAT (TO)	3169	252.066	228.941	4302773
TravellingSalesman/ TravellingSalesman-40-30-00_c18.xml	SAT (TO)	237	252.067	239.742	4302694
LowAutocorrelation/ LowAutocorrelation-040_c18.xml	SAT (TO)	220	252.067	226.147	4302868
Knapsack/ Knapsack-70-300-00_c18.xml	SAT (TO)	1425	252.068	231.151	4302628
Bacp/Bacp-m1/ Bacp-m1-08a_c18.xml	SAT (TO)	17	252.068	232.836	4302878
Bacp/Bacp-m2/ Bacp-m2-10a_c18.xml	SAT (TO)	14	252.069	230.837	4302891
Auction/Auction-cnt/ Auction-cnt-decay200_c18.xml	SAT (TO)	880139	252.07	225.942	4302922
GolombRuler/ GolombRuler-a3v18-14_c18.xml	SAT (TO)	148	252.071	240.736	4302705
Bacp/Bacp-m1/ Bacp-m1-10a-nodv_c18.xml	SAT (TO)	14	252.072	231.837	4302875
Fapp/Fapp-m2s/ Fapp-m2s-04-0300_c18.xml	SAT (TO)	27270670	252.074	178.854	4302943
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	SAT (TO)	61	252.074	240.338	4302709
Knapsack/ Knapsack-80-350-01_c18.xml	SAT (TO)	1668	252.076	231.846	4302631
Rcpsp/ Rcpsp-j120-01-03_c18.xml	SAT (TO)	129	252.076	238.336	4302713
Rlfap/Rlfap-opt/ Rlfap-scen-06-opt_c18.xml	SAT (TO)	31750	252.076	208.556	4302912
PizzaVoucher/ PizzaVoucher-15b_c18.xml	SAT (TO)	44	252.077	236.738	4302732
Bacp/Bacp-m1/ Bacp-m1-07b_c18.xml	SAT (TO)	13	252.079	233.337	4302872
QuadraticAssignment/ QuadraticAssignment-esc16a_c18.xml	SAT (TO)	34	252.079	238.733	4302751
Tal/ Tal-05_c18.xml	SAT (TO)	16	252.079	233.342	4302811
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	91591	252.079	160.179	4302896
SumColoring/ SumColoring-dsjc-125-5_c18.xml	SAT (TO)	1814	252.079	234.655	4302836
Rlfap/Rlfap-opt/ Rlfap-graph-02-opt_c18.xml	SAT (TO)	16	252.08	229.653	4302901
StillLife/ StillLife-wastage-12_c18.xml	SAT (TO)	73	252.082	230.058	4302611
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	8881534	252.082	198.659	4302936
GraphColoring/ GraphColoring-2-fullins-5_c18.xml	SAT (TO)	6	252.082	220.244	4302634
Bacp/Bacp-m1/ Bacp-m1-08b_c18.xml	SAT (TO)	17	252.082	232.434	4302876
Knapsack/ Knapsack-80-350-00_c18.xml	SAT (TO)	1564	252.082	232.25	4302630
Auction/Auction-sum/ Auction-sum-decay500_c18.xml	SAT (TO)	2164068	252.083	195.455	4302929
QuadraticAssignment/ QuadraticAssignment-esc32d_c18.xml	SAT (TO)	108	252.084	235.336	4302754
TravellingSalesman/ TravellingSalesman-35-30-00_c18.xml	SAT (TO)	194	252.085	238.934	4302693
PizzaVoucher/ PizzaVoucher-18a_c18.xml	SAT (TO)	55	252.086	237.137	4302733
PeacableArmies/ PeacableArmies-m1-10_c18.xml	SAT (TO)	12	252.086	221.863	4302660
QuadraticAssignment/ QuadraticAssignment-sko42_c18.xml	SAT (TO)	9412	252.089	233.06	4302762
TravelingTournament/ TravelingTournament-a2-galaxy12_c18.xml	SAT (TO)	10904	252.089	219.545	4302676
SumColoring/ SumColoring-dsjc-250-1_c18.xml	SAT (TO)	2951	252.089	235.151	4302838
LowAutocorrelation/ LowAutocorrelation-028_c18.xml	SAT (TO)	86	252.089	229.148	4302865
QuadraticAssignment/ QuadraticAssignment-had16_c18.xml	SAT (TO)	1883	252.089	238.639	4302758
LowAutocorrelation/ LowAutocorrelation-027_c18.xml	SAT (TO)	69	252.09	230.047	4302864
QuadraticAssignment/ QuadraticAssignment-had18_c18.xml	SAT (TO)	2763	252.09	238.847	4302759
PseudoBoolean-opt/ Pb-garden-9x9_c18.xml	SAT (TO)	21	252.09	237.149	4302745
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	31051	252.09	210.446	4302902
QuadraticAssignment/ QuadraticAssignment-had12_c18.xml	SAT (TO)	830	252.09	238.236	4302756
Knapsack/ Knapsack-70-300-01_c18.xml	SAT (TO)	1465	252.09	232.335	4302629
Mario/ Mario-n-medium-2_c18.xml	SAT (TO)	990	252.09	235.737	4302849
LowAutocorrelation/ LowAutocorrelation-024_c18.xml	SAT (TO)	36	252.093	231.837	4302861
TravelingTournament/ TravelingTournament-a3-galaxy08_c18.xml	SAT (TO)	2970	252.093	231.938	4302681
SumColoring/ SumColoring-myciel6_c18.xml	SAT (TO)	122	252.094	238.54	4302844
NurseRostering/ NurseRostering-09_c18.xml	SAT (TO)	6134	252.095	217.056	4302778
QuadraticAssignment/ QuadraticAssignment-esc32a_c18.xml	SAT (TO)	86	252.097	236.434	4302753
GraphColoring/ GraphColoring-qg-order60_c18.xml	SAT (TO)	3578	252.097	181.876	4302643
TravelingTournament/ TravelingTournament-a3-galaxy16_c18.xml	SAT (TO)	22508	252.098	193.358	4302685
Rlfap/Rlfap-opt/ Rlfap-graph-06-opt_c18.xml	SAT (TO)	76341	252.098	184.462	4302906
LowAutocorrelation/ LowAutocorrelation-025_c18.xml	SAT (TO)	36	252.099	230.145	4302862
SumColoring/ SumColoring-myciel7_c18.xml	SAT (TO)	780	252.099	237.239	4302845
GolombRuler/ GolombRuler-a3v18-16_c18.xml	SAT (TO)	213	252.099	239.251	4302707
TravellingSalesman/ TravellingSalesman-15-30-00_c18.xml	SAT (TO)	93	252.102	237.235	4302689
PeacableArmies/ PeacableArmies-m1-15_c18.xml	SAT (TO)	24	252.102	195.469	4302661
QuadraticAssignment/ QuadraticAssignment-had14_c18.xml	SAT (TO)	1386	252.102	237.747	4302757
Mario/ Mario-n-medium-4_c18.xml	SAT (TO)	832	252.102	235.244	4302851
StillLife/ StillLife-wastage-25_c18.xml	SAT (TO)	271	252.103	218.946	4302618
QuadraticAssignment/ QuadraticAssignment-esc64a_c18.xml	SAT (TO)	60	252.105	235.936	4302755
Auction/Auction-cnt/ Auction-cnt-decay100_c18.xml	SAT (TO)	465551	252.105	227.949	4302923
TravelingTournament/ TravelingTournament-a2-galaxy16_c18.xml	SAT (TO)	25239	252.106	190.45	4302678
Knapsack/ Knapsack-60-250-01_c18.xml	SAT (TO)	1323	252.107	233.533	4302627
NurseRostering/ NurseRostering-02_c18.xml	SAT (TO)	1638	252.107	234.737	4302771
LowAutocorrelation/ LowAutocorrelation-050_c18.xml	SAT (TO)	361	252.107	225.249	4302869
LowAutocorrelation/ LowAutocorrelation-020_c18.xml	SAT (TO)	26	252.107	232.046	4302857
Rlfap/Rlfap-opt/ Rlfap-scen-07-opt_c18.xml	SAT (TO)	60195808	252.108	159.365	4302910
Tal/ Tal-09_c18.xml	SAT (TO)	208	252.108	230.241	4302815
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	121	252.109	240.345	4302704
Bacp/Bacp-m1/ Bacp-m1-12b_c18.xml	SAT (TO)	17	252.109	234.335	4302877
SumColoring/ SumColoring-dsjc-125-1_c18.xml	SAT (TO)	641	252.109	239.635	4302835
PseudoBoolean-opt/ Pb-radar-10-20-45-050-100_c18.xml	SAT (TO)	37	252.111	208.346	4302747
LowAutocorrelation/ LowAutocorrelation-022_c18.xml	SAT (TO)	39	252.111	231.642	4302859
TravelingTournament/ TravelingTournament-a3-galaxy14_c18.xml	SAT (TO)	15786	252.112	209.749	4302684
Rcpsp/ Rcpsp-j120-01-01_c18.xml	SAT (TO)	113	252.112	238.642	4302711
Tal/ Tal-07_c18.xml	SAT (TO)	190	252.112	231.15	4302813
TravellingSalesman/ TravellingSalesman-25-30-00_c18.xml	SAT (TO)	115	252.114	239.332	4302691
TravellingSalesman/ TravellingSalesman-45-30-00_c18.xml	SAT (TO)	223	252.115	238.337	4302695
LowAutocorrelation/ LowAutocorrelation-023_c18.xml	SAT (TO)	51	252.115	230.149	4302860
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	34	252.115	227.16	4302915
GraphColoring/ GraphColoring-5-fullins-4_c18.xml	SAT (TO)	8	252.117	215.349	4302639
PizzaVoucher/ PizzaVoucher-22b_c18.xml	SAT (TO)	73	252.118	235.536	4302736
NurseRostering/ NurseRostering-03_c18.xml	SAT (TO)	2368	252.119	231.542	4302772
LowAutocorrelation/ LowAutocorrelation-021_c18.xml	SAT (TO)	34	252.119	231.939	4302858
TravelingTournament/ TravelingTournament-a3-galaxy06_c18.xml	SAT (TO)	1453	252.12	235.048	4302680
CrosswordDesign/ CrosswordDesign-07-4-rom_c18.xml	SAT (TO)	50	252.121	235.844	4302649
Fapp/Fapp-m2s/ Fapp-m2s-02-0250_c18.xml	SAT (TO)	60605762	252.121	212.062	4302941
Mario/ Mario-n-medium-3_c18.xml	SAT (TO)	943	252.122	234.048	4302850
Bacp/Bacp-m1/ Bacp-m1-12a_c18.xml	SAT (TO)	17	252.122	233.639	4302880
Auction/Auction-sum/ Auction-sum-decay400_c18.xml	SAT (TO)	1775875	252.123	196.159	4302931
TravellingSalesman/ TravellingSalesman-30-30-00_c18.xml	SAT (TO)	152	252.124	238.336	4302692
GolombRuler/ GolombRuler-a3v18-nodv-11_c18.xml	SAT (TO)	80	252.125	240.737	4302710
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	72	252.125	238.845	4302702
TravellingSalesman/ TravellingSalesman-20-30-00_c18.xml	SAT (TO)	104	252.126	239.043	4302690
StillLife/ StillLife-wastage-19_c18.xml	SAT (TO)	159	252.126	227.352	4302616
SumColoring/ SumColoring-1-fullins-5_c18.xml	SAT (TO)	333	252.126	236.637	4302834
Bacp/Bacp-m2/ Bacp-m2-08a_c18.xml	SAT (TO)	17	252.127	232.848	4302892
Bacp/Bacp-m1/ Bacp-m1-10b_c18.xml	SAT (TO)	14	252.127	234.546	4302873
Bacp/Bacp-m2/ Bacp-m2-07b_c18.xml	SAT (TO)	13	252.127	236.238	4302889
StillLife/ StillLife-wastage-10_c18.xml	SAT (TO)	51	252.127	230.337	4302609
StillLife/ StillLife-wastage-11_c18.xml	SAT (TO)	61	252.128	230.338	4302610
StillLife/ StillLife-wastage-21_c18.xml	SAT (TO)	194	252.128	221.344	4302617
Knapsack/ Knapsack-90-400-01_c18.xml	SAT (TO)	1681	252.129	231.735	4302633
Auction/Auction-cnt/ Auction-cnt-matching080_c18.xml	SAT (TO)	32451413	252.129	215.643	4302921
GraphColoring/ GraphColoring-4-fullins-4_c18.xml	SAT (TO)	7	252.131	231.848	4302636
GraphColoring/ GraphColoring-qg-order40_c18.xml	SAT (TO)	1429	252.131	225.342	4302642
Bacp/Bacp-m1/ Bacp-m1-10a_c18.xml	SAT (TO)	14	252.132	234.435	4302871
PseudoBoolean-opt/ Pb-garden-15x15_c18.xml	SAT (TO)	67	252.132	233.941	4302742
CrosswordDesign/ CrosswordDesign-06-4-rom_c18.xml	SAT (TO)	44	252.132	237.96	4302648
SumColoring/ SumColoring-myciel5_c18.xml	SAT (TO)	50	252.132	241.544	4302843
PeacableArmies/ PeacableArmies-m1-07_c18.xml	SAT (TO)	7	252.133	233.845	4302659
TravelingTournament/ TravelingTournament-a2-galaxy10_c18.xml	SAT (TO)	6426	252.133	226.541	4302675
PizzaVoucher/ PizzaVoucher-12b_c18.xml	SAT (TO)	40	252.133	237.846	4302730
GolombRuler/ GolombRuler-a3v18-15_c18.xml	SAT (TO)	173	252.133	239.748	4302706
TravelingTournament/ TravelingTournament-a2-galaxy06_c18.xml	SAT (TO)	1613	252.135	236.15	4302673
Rcpsp/ Rcpsp-j120-01-04_c18.xml	SAT (TO)	97	252.136	238.434	4302714
Knapsack/ Knapsack-50-200-01_c18.xml	SAT (TO)	1297	252.136	234.734	4302625
Rlfap/Rlfap-opt/ Rlfap-graph-01-opt_c18.xml	SAT (TO)	20	252.137	230.873	4302897
QuadraticAssignment/ QuadraticAssignment-had20_c18.xml	SAT (TO)	3685	252.138	237.737	4302760
LowAutocorrelation/ LowAutocorrelation-030_c18.xml	SAT (TO)	99	252.139	228.64	4302866
Fapp/Fapp-m2s/ Fapp-m2s-test03-0400_c18.xml	SAT (TO)	163903545	252.14	179.06	4302950
PizzaVoucher/ PizzaVoucher-15a_c18.xml	SAT (TO)	43	252.142	238.145	4302731
Auction/Auction-cnt/ Auction-cnt-decay300_c18.xml	SAT (TO)	1280816	252.143	224.74	4302925
StillLife/ StillLife-wastage-13_c18.xml	SAT (TO)	83	252.143	229.048	4302612
TravellingSalesman/ TravellingSalesman-150-50-00_c18.xml	SAT (TO)	989	252.143	236.635	4302688
LowAutocorrelation/ LowAutocorrelation-026_c18.xml	SAT (TO)	69	252.143	229.848	4302863
GraphColoring/ GraphColoring-3-fullins-5_c18.xml	SAT (TO)	1830	252.145	198.953	4302635
Rlfap/Rlfap-opt/ Rlfap-graph-07-opt_c18.xml	SAT (TO)	68255	252.147	195.068	4302895
TravelingTournament/ TravelingTournament-a2-galaxy08_c18.xml	SAT (TO)	3302	252.147	231.047	4302674
Bacp/Bacp-m2/ Bacp-m2-12a-nodv_c18.xml	SAT (TO)	17	252.147	220.676	4302888
GolombRuler/ GolombRuler-a3v18-12_c18.xml	SAT (TO)	96	252.148	240.537	4302703
Auction/Auction-cnt/ Auction-cnt-decay500_c18.xml	SAT (TO)	1865380	252.149	221.163	4302928
StillLife/ StillLife-wastage-30_c18.xml	SAT (TO)	371	252.15	192.364	4302619
Auction/Auction-sum/ Auction-sum-decay200_c18.xml	SAT (TO)	1001781	252.15	194.655	4302933
StillLife/ StillLife-wastage-14_c18.xml	SAT (TO)	97	252.15	229.848	4302613
PseudoBoolean-opt/ Pb-circ6-3_c18.xml	SAT (TO)	76	252.151	219.177	4302739
QuadraticAssignment/ QuadraticAssignment-esc128_c18.xml	SAT (TO)	48	252.152	236.948	4302750
TravelingTournament/ TravelingTournament-a3-galaxy10_c18.xml	SAT (TO)	6033	252.152	227.441	4302682
QuadraticAssignment/ QuadraticAssignment-sko49_c18.xml	SAT (TO)	13528	252.152	232.644	4302763
Bacp/Bacp-m2/ Bacp-m2-10b_c18.xml	SAT (TO)	14	252.153	231.941	4302884
Bacp/Bacp-m2/ Bacp-m2-10a-nodv_c18.xml	SAT (TO)	14	252.154	228.539	4302887
GraphColoring/ GraphColoring-qg-order30_c18.xml	SAT (TO)	497	252.155	229.846	4302641
Fapp/Fapp-m2s/ Fapp-m2s-test02-0250_c18.xml	SAT (TO)	89790668	252.157	199.56	4302956
Knapsack/ Knapsack-90-400-00_c18.xml	SAT (TO)	1505	252.158	230.846	4302632
QuadraticAssignment/ QuadraticAssignment-sko56_c18.xml	SAT (TO)	19730	252.158	232.143	4302764
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1425801	252.159	197.053	4302932
Bacp/Bacp-m1/ Bacp-m1-12a-nodv_c18.xml	SAT (TO)	18	252.16	228.54	4302874
Bacp/Bacp-m2/ Bacp-m2-12a_c18.xml	SAT (TO)	17	252.161	226.861	4302890
StillLife/ StillLife-wastage-17_c18.xml	SAT (TO)	134	252.163	226.051	4302615
Fapp/Fapp-m2s/ Fapp-m2s-test01-0150_c18.xml	SAT (TO)	50572912	252.163	191.451	4302948
Rlfap/Rlfap-opt/ Rlfap-scen-03-opt_c18.xml	SAT (TO)	18	252.166	228.052	4302905
Rlfap/Rlfap-opt/ Rlfap-scen-02-opt_c18.xml	SAT (TO)	14	252.169	231.697	4302909
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	252.174	227.065	4302893
Fapp/Fapp-m2s/ Fapp-m2s-01-0200_c18.xml	SAT (TO)	98990615	252.206	171.433	4302940
PeacableArmies/ PeacableArmies-m1-20_c18.xml	SAT (TO)	32	252.213	186.701	4302662
Fapp/Fapp-m2s/ Fapp-m2s-03-0300_c18.xml	SAT (TO)	295057490	252.224	195.749	4302945
Fapp/Fapp-m2s/ Fapp-m2s-16-0260_c18.xml	SAT (TO)	376869124	252.243	167.092	4302942
SteelMillSlab/ SteelMillSlab-m2s-4-0_c18.xml	SAT (TO)	203	252.26	139.669	4302805
Fapp/Fapp-m2s/ Fapp-m2s-05-0350_c18.xml	SAT (TO)	524900968	252.272	159.87	4302949
Auction/Auction-sum/ Auction-sum-matching080_c18.xml	SAT (TO)	34430993	252.387	185.346	4302937
CrosswordDesign/ CrosswordDesign-08-4-rom_c18.xml	SAT (TO)	56	252.402	229.619	4302650
SteelMillSlab/ SteelMillSlab-m2s-3-2_c18.xml	SAT (TO)	330	252.509	148.618	4302804
Auction/Auction-sum/ Auction-sum-decay100_c18.xml	SAT (TO)	422809	252.573	196.63	4302934
TravelingTournament/ TravelingTournament-a2-galaxy14_c18.xml	SAT (TO)	17590	252.666	213.704	4302677
Rlfap/Rlfap-opt/ Rlfap-graph-11-opt_c18.xml	SAT (TO)	107313	257.833	140.81	4302911

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Tal/ Tal-08_c18.xml	? (TO)	252.062	232.76	4302814
SteelMillSlab/ SteelMillSlab-m2-3-2_c18.xml	? (TO)	252.066	210.446	4302799
PeacableArmies/ PeacableArmies-m2-20_c18.xml	? (TO)	252.069	192.447	4302669
NurseRostering/ NurseRostering-13_c18.xml	? (TO)	252.071	190.849	4302782
NurseRostering/ NurseRostering-19_c18.xml	? (TO)	252.071	216.646	4302788
PeacableArmies/ PeacableArmies-m2-15_c18.xml	? (TO)	252.072	221.547	4302668
PseudoBoolean-opt/ Pb-circ8-3_c18.xml	? (TO)	252.074	207.345	4302740
PeacableArmies/ PeacableArmies-m2-10_c18.xml	? (TO)	252.074	233.339	4302667
Tal/ Tal-10_c18.xml	? (TO)	252.077	231.335	4302816
NurseRostering/ NurseRostering-14_c18.xml	? (TO)	252.077	225.743	4302783
NurseRostering/ NurseRostering-11_c18.xml	? (TO)	252.081	224.841	4302780
NurseRostering/ NurseRostering-15_c18.xml	? (TO)	252.087	221.743	4302784
NurseRostering/ NurseRostering-20_c18.xml	? (TO)	252.09	160.364	4302789
SteelMillSlab/ SteelMillSlab-m2-3-0_c18.xml	? (TO)	252.091	209.944	4302798
NurseRostering/ NurseRostering-07_c18.xml	? (TO)	252.097	229.74	4302776
NurseRostering/ NurseRostering-12_c18.xml	? (TO)	252.102	218.342	4302781
NurseRostering/ NurseRostering-06_c18.xml	? (TO)	252.103	227.44	4302775
NurseRostering/ NurseRostering-17_c18.xml	? (TO)	252.103	225.935	4302786
TemplateDesign/ TemplateDesign-m1-herbs_c18.xml	? (TO)	252.105	222.461	4302820
SteelMillSlab/ SteelMillSlab-m1-4-0_c18.xml	? (TO)	252.117	214.561	4302794
NurseRostering/ NurseRostering-08_c18.xml	? (TO)	252.119	225.051	4302777
NurseRostering/ NurseRostering-16_c18.xml	? (TO)	252.127	226.045	4302785
SteelMillSlab/ SteelMillSlab-m2-4-0_c18.xml	? (TO)	252.128	211.752	4302800
Rlfap/Rlfap-opt/ Rlfap-graph-09-opt_c18.xml	? (TO)	252.129	227.653	4302900
PeacableArmies/ PeacableArmies-m2-07_c18.xml	? (TO)	252.129	237.939	4302666
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	252.13	222.337	4302787
SteelMillSlab/ SteelMillSlab-m2-2-2_c18.xml	? (TO)	252.131	200.655	4302797
TemplateDesign/ TemplateDesign-m2-magazine_c18.xml	? (TO)	252.142	218.345	4302831
Fapp/Fapp-m2s/ Fapp-m2s-06-0500_c18.xml	? (TO)	252.146	165.977	4302954
NurseRostering/ NurseRostering-10_c18.xml	? (TO)	252.147	221.153	4302779
QuadraticAssignment/ QuadraticAssignment-sko64_c18.xml	? (TO)	252.15	241.267	4302765
Rlfap/Rlfap-opt/ Rlfap-scen-01-opt_c18.xml	? (TO)	252.154	228.843	4302913
SteelMillSlab/ SteelMillSlab-m2-2-0_c18.xml	? (TO)	252.154	208.454	4302796
QuadraticAssignment/ QuadraticAssignment-sko72_c18.xml	? (TO)	252.157	238.315	4302766
Rlfap/Rlfap-opt/ Rlfap-scen-11-opt_c18.xml	? (TO)	252.172	228.854	4302914
TemplateDesign/ TemplateDesign-m1s-magazine_c18.xml	? (TO)	252.173	190.067	4302826
SteelMillSlab/ SteelMillSlab-m1-3-2_c18.xml	? (TO)	252.173	214.093	4302793
QuadraticAssignment/ QuadraticAssignment-sko90_c18.xml	? (TO)	252.214	200.883	4302768
TemplateDesign/ TemplateDesign-m1-magazine_c18.xml	? (TO)	252.237	219.14	4302821
Rlfap/Rlfap-opt/ Rlfap-graph-14-opt_c18.xml	? (TO)	252.304	230.328	4302918
SteelMillSlab/ SteelMillSlab-m1-2-2_c18.xml	? (TO)	252.46	219.068	4302791
SteelMillSlab/ SteelMillSlab-m1-3-0_c18.xml	? (TO)	252.516	215.61	4302792
Rlfap/Rlfap-opt/ Rlfap-graph-13-opt_c18.xml	? (TO)	252.757	135.642	4302916
QuadraticAssignment/ QuadraticAssignment-sko81_c18.xml	? (TO)	253.149	227.121	4302767
SteelMillSlab/ SteelMillSlab-m1-2-0_c18.xml	? (TO)	254.016	214.336	4302790
CrosswordDesign/ CrosswordDesign-09-4-rom_c18.xml	? (TO)	254.078	213.736	4302651
PeacableArmies/ PeacableArmies-m2-30_c18.xml	? (TO)	254.084	233.035	4302670
CrosswordDesign/ CrosswordDesign-11-4-rom_c18.xml	? (TO)	254.109	184.638	4302653
PseudoBoolean-opt/ Pb-circ10-3_c18.xml	? (TO)	254.125	214.321	4302737
Fapp/Fapp-m2s/ Fapp-m2s-07-0600_c18.xml	? (TO)	254.128	151.154	4302953
SumColoring/ SumColoring-dsjc-250-5_c18.xml	? (TO)	254.131	240.726	4302839
PeacableArmies/ PeacableArmies-m1-30_c18.xml	? (TO)	254.135	222.327	4302663
GraphColoring/ GraphColoring-4-fullins-5_c18.xml	? (TO)	254.16	205.049	4302637
SumColoring/ SumColoring-dsjc-250-9_c18.xml	? (TO)	254.182	239.727	4302840
SumColoring/ SumColoring-dsjc-125-9_c18.xml	? (TO)	254.2	243.326	4302837
PeacableArmies/ PeacableArmies-m1-50_c18.xml	? (TO)	254.205	159.432	4302664
CrosswordDesign/ CrosswordDesign-12-4-rom_c18.xml	? (TO)	254.483	150.536	4302654
PseudoBoolean-opt/ Pb-radar-30-30-45-050-100_c18.xml	? (TO)	254.56	174.816	4302748
PeacableArmies/ PeacableArmies-m2-50_c18.xml	? (TO)	254.609	235.428	4302671
Rlfap/Rlfap-opt/ Rlfap-scen-10-opt_c18.xml	? (TO)	255.108	160.244	4302908
SteelMillSlab/ SteelMillSlab-m2s-2-2_c18.xml	? (TO)	255.32	148.443	4302802
CrosswordDesign/ CrosswordDesign-13-4-rom_c18.xml	? (TO)	255.413	139.244	4302655
SteelMillSlab/ SteelMillSlab-m2s-3-0_c18.xml	? (TO)	255.46	147.549	4302803
Rlfap/Rlfap-opt/ Rlfap-graph-12-opt_c18.xml	? (TO)	255.894	139.256	4302903
Rlfap/Rlfap-opt/ Rlfap-scen-08-opt_c18.xml	? (TO)	256.255	142.244	4302907
CrosswordDesign/ CrosswordDesign-10-4-rom_c18.xml	? (TO)	256.505	192.262	4302652
GraphColoring/ GraphColoring-qg-order100_c18.xml	? (TO)	259.914	199.432	4302640
CrosswordDesign/ CrosswordDesign-15-4-rom_c18.xml	? (TO)	260.063	152.457	4302657
SteelMillSlab/ SteelMillSlab-m2s-2-0_c18.xml	? (TO)	260.206	138.458	4302801
PseudoBoolean-opt/ Pb-garden-100x100_c18.xml	? (TO)	260.216	106.563	4302741
CrosswordDesign/ CrosswordDesign-14-4-rom_c18.xml	? (TO)	260.283	140.056	4302656
Fapp/Fapp-m2s/ Fapp-m2s-08-0700_c18.xml	? (TO)	260.344	140.081	4302944
PseudoBoolean-opt/ Pb-radar-30-70-45-050-100_c18.xml	? (TO)	261.635	95.1222	4302749

2018 XCSP3 competition: fast COP track: benchmarks results per solver

Result page for solver Concrete 3.9.2-SuperNG (complete)

Category "optimization problem" (COP)

Solver found optimum (OPTIMUM FOUND) (83 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) but this may not be the optimal solution (1 run) [Show/Hide]

Solver timed out but found at least a solution (189 runs) [Show/Hide]

Solver timed out (no solution given) (73 runs) [Show/Hide]