2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		223.613	182.715	4392013

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	6.5577	3.03239	4391982
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	9.08234	3.82349	4391991
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	9.36437	3.91671	4392019
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	9.37345	3.95048	4391962
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	9.66844	3.87562	4391983
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	9.91545	4.10194	4391972
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	10.2292	4.02893	4391973
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	10.549	4.28868	4392000
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	13.405	5.61146	4392089
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	14.4478	5.76546	4392091
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	14.5496	6.07645	4392001
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	14.8669	5.91325	4391981
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	17.2365	8.92444	4392049
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	17.238	7.03869	4392104
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	17.8213	8.42668	4392101
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	17.866	7.51933	4391965
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	20.5946	8.92723	4392055
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	21.8531	11.755	4391963
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	21.9796	11.0698	4392112
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	22.2146	10.811	4392082
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	22.771	11.3987	4391984
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	23.4074	10.5527	4392002
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	OPT	48	23.5556	12.2667	4392259
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	24.8484	13.3207	4392093
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	OPT	12	25.9136	14.1507	4392041
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	26.4093	16.6695	4392020
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	27.007	16.5353	4392050
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	27.1101	13.9003	4391976
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	31.0419	19.3778	4391964
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	31.4387	19.9928	4391985
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	OPT	24	32.3143	18.1712	4392246
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	32.4668	21.7389	4391974
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	40.3632	23.4404	4392111
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	41.7811	28.22	4391986
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	43.0993	20.0682	4392145
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	43.8923	25.1499	4392036
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	44.0235	26.5618	4391970
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	47.8497	37.4038	4392158
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	49.3963	33.3162	4392106
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	53.9018	39.5422	4392090
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	OPT	63832030	55.9293	33.6841	4391993
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	56.098	44.7513	4392092
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	59.1453	47.6238	4392095
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	OPT	162507055	63.1384	37.7462	4392022
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	65.4927	51.2767	4391967
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	65.8062	52.219	4392012
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	66.1119	51.3631	4392100
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	67.09	46.133	4392087
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	73.1529	61.1985	4392058
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	74.5386	60.2415	4391977
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	76.479	64.2165	4392086
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	78.0237	65.5476	4391980
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	78.2873	64.8899	4391968
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	79.8785	65.0021	4391987
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	OPT	13	82.9172	61.2835	4392206
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	85.7758	75.2106	4392056
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	91.4321	74.0668	4391969
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	OPT	130971634	92.5752	52.6931	4392074
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	97.5506	80.2035	4391966
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	98.5031	81.9898	4392107
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	101.081	86.9112	4391971
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	101.853	82.8447	4391989
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	104.006	78.7394	4392060
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	OPT	2	105.774	86.7242	4392072
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	105.789	84.2446	4392097
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	108.067	86.109	4392163
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	132.421	122.173	4392098
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	132.708	118.257	4392021
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	134.752	119.211	4391978
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	137.637	120.779	4391979
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	OPT	506362597	140.978	72.9147	4392052
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	155.775	130.487	4392061
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	161.096	142.215	4392044
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	174.301	157.53	4392067
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	175.722	159.19	4391994
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	180.457	165.09	4392030
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	184.395	159.311	4392029
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	192.664	168.758	4392080
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	199.99	178.088	4392083
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	201.323	181.088	4391990
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	204.159	191.583	4392126
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	220.529	198.966	4392068
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	225.233	213.27	4392133
Tal/ Tal-05_c18.xml	OPT	16	245.924	227.912	4392114
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	263.02	236.23	4392103
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	287.192	269.777	4392004
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	292.708	273.841	4392143
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	296.437	256.035	4392179
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	301.965	277.494	4392075
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	323.872	303.359	4392141
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	324.713	294.946	4392159
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	335.862	313.278	4392040
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	345.312	318.943	4392078
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	345.989	332.411	4392042
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	346.833	320.659	4392177
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	350.407	329.543	4392073
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	358.645	344.349	4392127
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	367.831	347.276	4392088
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	378.721	360.482	4392038
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	382.23	362.692	4391992
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	457.342	435.16	4392079
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	482.159	466.541	4392153
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	485.821	463.928	4392039
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	514.017	490.229	4392084
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	539.614	516.842	4392142
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	552.549	523.519	4391995
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	552.953	536.669	4392137
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	556.497	526.463	4392070
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	574.569	552.637	4392174
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	584.389	553.241	4391975
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	670.235	650.217	4392140
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	686.76	653.822	4392094
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	OPT	2	727.774	700.683	4392180
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	740.893	714.111	4392043
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	740.932	713.95	4392023
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	755.898	731.096	4391988
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	783.317	758.299	4392057
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	835.998	808.253	4392062
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	850.098	821.142	4392037
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	901.281	874.15	4392016
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	OPT	98	901.799	878.257	4392139
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	930.188	897.59	4392035
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	933.751	899.814	4392167
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	972.171	950.156	4392138
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	1003.99	972.41	4392051
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	1043	1019.98	4392129
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	1076.41	1059.11	4392155
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	1135.13	1116.88	4392154
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	1139.32	1103.83	4392164
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	1158.13	1122.85	4392160
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	1171.3	1146.08	4392136
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	1215.76	1176.97	4392165
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	1273.15	1247.92	4392131
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	1286.87	1252.03	4392006
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	1355.84	1328.22	4392025
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	OPT	116	1429.84	1395.91	4392018
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	OPT	93	1501.71	1466	4392118
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	1528.96	1482.24	4392175
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	1649.66	1600.98	4392064
Tal/ Tal-03_c18.xml	OPT	96	1710.83	1674.5	4392069
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	1736.3	1694.87	4392007
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	1753.84	1715.7	4392184
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	1756.74	1724.11	4392134
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	OPT	105	1782.33	1742.57	4392116
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	1801.23	1761.77	4392117
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	OPT	91	1812.74	1773.64	4392115
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	1824.73	1790.41	4392173
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	1943.82	1906.54	4392250
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	1948.92	1900.52	4392008
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	1982.84	1946.3	4392135
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	1994.31	1949.11	4392005
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	2058.91	2013.83	4392003
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	2132.22	2084.2	4392015
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	2210.61	2160.23	4392032
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	2267.12	2226.86	4392130
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	2342.46	2293.25	4391996

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	39	2400.04	2347.63	4392119
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	310	2400.04	2350.93	4392027
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	158	2400.04	2360.73	4392217
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2400.05	2346.33	4392120
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	10	2400.05	2339.43	4392054
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	120	2400.05	2339.53	4392207
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	115	2400.05	2356.43	4392258
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	38	2400.06	2346.83	4392121
Opd/Opd-sum-small/ Opd-10-038-010.xml	SAT (TO)	3	2400.06	2340.34	4392077
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	SAT (TO)	1241	2400.06	2347.43	4392170
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	326	2400.06	2348.43	4392063
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	303	2400.07	2348.93	4392014
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	314	2400.07	2332.56	4392215
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	476	2400.07	2337.74	4392178
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	SAT (TO)	-944	2400.07	2376.74	4392009
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1448	2400.07	2325.73	4392245
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	382	2400.07	2336.94	4392208
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	787	2400.07	2360.43	4392202
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	70	2400.07	2345.04	4392194
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	300	2400.07	2349.53	4392066
Opd/Opd-sum-small/ Opd-10-037-014.xml	SAT (TO)	6	2400.08	2341.43	4392047
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	208	2400.08	2331.95	4392210
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1174	2400.08	2362.33	4392214
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	83	2400.08	2342.04	4392261
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	655	2400.09	2330.95	4392235
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	43	2400.09	2347.33	4392123
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	4	2400.09	2340.33	4392161
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.09	2346.63	4392203
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1179	2400.09	2328.53	4392256
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	SAT (TO)	1289	2400.09	2349.23	4392017
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	SAT (TO)	-924	2400.09	2377.54	4392151
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	294	2400.09	2332.25	4392209
Opd/Opd-sum-small/ Opd-09-024-008.xml	SAT (TO)	3	2400.09	2343.93	4392096
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	SAT (TO)	4	2400.09	2344.83	4392028
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	2400.09	2343.43	4392172
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	437	2400.09	2331.35	4392234
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	4	2400.1	2337.33	4392218
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2400.1	2344.54	4392176
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	18	2400.1	2352.19	4392248
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	32420	2400.1	2349.05	4392191
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	129	2400.1	2356.73	4392249
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	SAT (TO)	14	2400.1	2340.53	4392255
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	SAT (TO)	1121	2400.1	2349.14	4392168
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	SAT (TO)	89	2400.1	2358.63	4392132
Opd/Opd-sum-small/ Opd-15-015-004.xml	SAT (TO)	2	2400.1	2342.83	4392048
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	54045	2400.1	2349.23	4392242
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	10632725	2400.11	2334.83	4392211
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	353	2400.11	2350.14	4392045
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.11	2328.83	4392147
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2400.11	2338.63	4392257
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	1041	2400.11	2334.44	4392223
Opd/Opd-sum-small/ Opd-10-030-009.xml	SAT (TO)	3	2400.11	2341.54	4392166
Opd/Opd-sum-large/ Opd-09-350-100.xml	SAT (TO)	69	2400.11	2336.85	4392238
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	SAT (TO)	1105	2400.11	2348.04	4392031
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1352	2400.11	2332.35	4392220
Opd/Opd-sum-small/ Opd-10-015-006.xml	SAT (TO)	3	2400.11	2344.83	4392034
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2400.11	2335.33	4392197
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	664	2400.12	2339.74	4392232
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	836	2400.12	2365.33	4392219
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1128	2400.12	2350.53	4392011
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	123	2400.12	2358.04	4392213
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	SAT (TO)	5	2400.12	2347.43	4392144
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	463	2400.12	2345.33	4392125
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	SAT (TO)	1427	2400.12	2350.34	4392169
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	196	2400.12	2332.25	4392228
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1470	2400.12	2334.53	4392231
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	SAT (TO)	139	2400.12	2357.73	4392128
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	SAT (TO)	718	2400.12	2337.24	4392148
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	SAT (TO)	992	2400.12	2348.34	4391998
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1366556	2400.12	2339.64	4392222
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	72	2400.12	2346.34	4392243
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT (TO)	529170024	2400.12	2051.99	4392187
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.12	2347.33	4392212
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	312	2400.12	2348.63	4392024
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	402	2400.12	2331.95	4392229
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	151	2400.12	2359.73	4392216
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	209400	2400.13	2302.35	4392240
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1487	2400.13	2328.65	4392233
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	141	2400.13	2354.04	4392260
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	SAT (TO)	14	2400.13	2341.33	4392162
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	SAT (TO)	1003	2400.13	2348.44	4392171
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2400.13	2357.64	4392241
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31539	2400.14	2337.63	4392237
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	326	2400.14	2347.63	4392046
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	269	2400.14	2333.06	4392226
Opd/Opd-sum-large/ Opd-15-035-010.xml	SAT (TO)	4	2400.14	2337.84	4392053
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	189	2400.14	2331.76	4392225
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	367	2400.14	2332.35	4392236
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	212	2400.14	2327.46	4392227
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.14	2338.05	4392224
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.14	2366.94	4392221
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	40	2400.14	2346.04	4392124
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	259	2400.14	2332.17	4392205
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1789	2400.15	2326.63	4392189
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	936	2400.15	2330.05	4392252
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2400.15	2347.74	4392122
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.16	2329.45	4392146
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	429	2400.16	2333.35	4392186
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	536	2400.17	2331.07	4392230

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	? (TO)	2400.05	2367.63	4392156
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	? (TO)	2400.05	2373.44	4392152
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.06	2361.04	4392192
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	? (TO)	2400.07	2374.33	4392150
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.07	2336.74	4392188
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.08	2341.23	4392244
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.08	2345.83	4392198
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.08	2344.43	4392199
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	2400.08	2340.33	4392113
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	? (TO)	2400.08	2366.23	4391997
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	? (TO)	2400.08	2381.94	4392149
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	? (TO)	2400.08	2367.44	4391999
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.09	2347.93	4392181
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.09	2353.14	4392193
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2400.09	2346.74	4392247
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.1	2337.83	4392200
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	? (TO)	2400.11	2352.93	4392183
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.12	2361.83	4392190
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.12	2327.73	4392239
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.13	2290.56	4392254
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	? (TO)	2400.14	2352.63	4392182
PeacableArmies/ PeacableArmies-m2-07_c18.xml	? (TO)	2400.14	2354.54	4392108
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.15	2330.34	4392253
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	? (TO)	2400.15	2358.16	4392195
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	? (TO)	2400.15	2364.44	4392157
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.16	2348.35	4392201
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.17	2348.16	4392196
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.22	2337.43	4392204
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2402.06	2326.14	4392185
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2402.15	2346.03	4392251

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	Wrong Opt.	152	7.59251	3.55643	4392099
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	Wrong Opt.	150	8.55431	3.80754	4392102
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	Wrong Opt.	176	8.89616	3.89997	4392081
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	Wrong Opt.	180	9.12403	4.1479	4392105
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	Wrong Opt.	204	10.3485	4.2106	4392071
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	Wrong Opt.	175	10.5018	4.37244	4392026
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	Wrong Opt.	159	10.696	4.31434	4392010
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	Wrong Opt.	199	11.5133	4.67356	4392109
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	Wrong Opt.	180	12.2126	5.11887	4392065
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	Wrong Opt.	189	18.4465	8.70673	4392076
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	Wrong Opt.	175	22.1802	11.594	4392033
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	Wrong Opt.	190	32.123	20.1254	4392110
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	Wrong Opt.	205	57.8082	42.5762	4392085
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	Wrong Opt.	190	60.8222	47.0454	4392059

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver Concrete 3.10 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (156 runs) [Show/Hide]

Solver timed out but found at least a solution (99 runs) [Show/Hide]

Solver timed out (no solution given) (30 runs) [Show/Hide]

Solver found a wrong optimum (14 runs) [Show/Hide]