2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		69.0571	9.88574	4404873
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	UNSAT		786.446	99.2146	4405041

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	1.63146	0.849483	4404842
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	2.76186	0.987447	4404900
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	3.05869	0.928991	4404822
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	3.2513	0.942221	4404832
Opd/Opd-sum-small/ Opd-15-015-004.xml	OPT	1	3.42524	0.980901	4404908
Opd/Opd-sum-small/ Opd-09-024-008.xml	OPT	2	4.25081	1.05396	4404956
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	4.67169	1.10312	4404951
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	5.5378	1.29272	4404894
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	5.55796	1.23125	4404823
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	5.81808	1.26274	4404825
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	6.15392	1.3053	4404964
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	7.72303	1.63792	4404844
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	7.77665	1.62218	4404846
Opd/Opd-sum-small/ Opd-10-038-010.xml	OPT	2	9.8215	1.78242	4404937
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	10.0376	1.97736	4404833
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	11.1062	1.94545	4404915
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	11.1968	2.07476	4404836
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	11.2622	2.149	4404880
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	11.3725	1.97184	4404845
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	12.5283	2.17412	4404841
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	13.0021	3.63277	4404896
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	13.0072	2.2917	4404824
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	13.394	2.70241	4404942
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	13.9186	2.29311	4405025
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	14.3337	2.68455	4404849
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	14.6696	2.68022	4404834
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	14.7501	4.20886	4404829
Opd/Opd-sum-small/ Opd-10-030-009.xml	OPT	2	14.9522	2.41728	4405026
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	15.0951	2.46354	4404862
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	15.8466	2.53766	4404861
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	16.8791	2.84618	4404839
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	17.5702	2.76297	4404907
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	17.9043	3.12059	4404843
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	18.1997	4.45275	4404904
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	18.4288	3.21561	4404826
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	19.3952	3.04379	4404909
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	20.1651	3.39678	4405018
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	20.2958	3.12165	4404958
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	20.7164	3.14366	4404961
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	21.3548	3.37394	4404918
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	24.9563	4.04805	4404835
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	29.6821	5.52512	4404947
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	30.1932	5.53901	4404830
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	30.5626	4.43008	4404879
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	31.7322	5.72795	4405019
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	31.9634	5.79818	4405023
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	32.07	5.37516	4404864
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	32.5237	5.05406	4404837
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	33.0494	4.73363	4404952
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	33.9494	4.99654	4404872
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	35.7096	5.34483	4404890
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	37.138	5.71965	4404827
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	37.7582	5.51309	4404888
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	38.8492	5.91098	4404852
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	39.905	5.82845	4404895
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	41.3277	5.87992	4404910
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	42.3252	5.9955	4404950
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	44.1729	6.46232	4404938
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	OPT	10	44.8382	6.49594	4404914
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	44.9975	6.26876	4404889
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	45.2048	9.7394	4404898
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	45.2407	6.78615	4404966
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	48.1968	6.91315	4404866
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	49.6824	6.76384	4405044
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	51.1692	7.48335	4404883
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	52.1399	7.25905	4404927
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	54.0821	9.95469	4405034
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	54.471	8.25434	4404891
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	58.3396	8.2779	4404968
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	62.9555	9.23257	4404875
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	66.2902	8.93402	4404885
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	67.8775	9.48517	4404838
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	68.739	9.84534	4404847
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	68.9347	9.41824	4404916
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	69.9898	9.49429	4404850
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	75.9148	10.8053	4405013
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	81.6603	11.647	4405012
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	OPT	98	83.4953	11.2736	4404999
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	85.6679	12.232	4405030
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	85.7128	11.6375	4404831
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	96.5581	12.6575	4404828
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	97.5728	12.7846	4404957
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	OPT	161	99.5933	13.4815	4405036
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	100.594	13.242	4404913
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	101.517	13.4383	4404986
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	OPT	353	106.706	14.0922	4404905
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	106.884	14.6883	4404857
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	113.897	14.9269	4404922
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	117.125	15.3391	4404967
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	117.358	16.3182	4404877
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	120.067	16.5145	4404859
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	120.205	15.7969	4404902
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	120.563	16.4397	4405016
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	123.093	16.0898	4404993
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	126.769	17.2939	4404869
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	127.975	17.2382	4404943
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	129.643	17.2482	4404855
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	131.115	17.7855	4405015
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	138.855	18.0861	4404990
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	138.955	19.0848	4404856
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	OPT	2	141.425	18.3211	4405043
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	144.331	18.8793	4404933
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	147.409	19.3585	4404881
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	OPT	326	150.806	19.73	4404906
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	152.189	19.8341	4404848
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	152.578	20.8041	4405005
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	161.33	21.8254	4404865
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	161.389	21.1877	4404840
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	168.631	22.4682	4405017
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	172.827	22.9886	4405014
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	OPT	3	174.3	22.4379	4405042
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	175.955	22.8509	4405003
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	178.933	23.2379	4404903
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	181.415	23.4484	4404944
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	189.127	24.4484	4405000
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	OPT	310	193.569	25.0217	4404887
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	199.261	27.2947	4405028
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	OPT	300	204.383	26.3594	4404926
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	207.412	27.9587	4405031
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	207.864	27.9682	4405029
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	212.026	28.5629	4404867
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	218.768	28.8435	4405011
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	OPT	14	218.896	28.3066	4405115
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	OPT	14	223.751	29.2598	4405022
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	229.377	29.5955	4404911
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	250.961	32.1501	4404991
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	262.115	35.0421	4404858
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	266.334	34.1827	4405024
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	269.796	34.6686	4404897
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	OPT	1120	300.361	38.8101	4404871
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	309.601	40.2282	4405010
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	326.891	43.9995	4404924
Tal/ Tal-03_c18.xml	OPT	96	343.411	66.8193	4404929
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	346.023	44.4058	4405002
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	352.81	44.9916	4404997
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	361.273	45.9657	4405001
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	OPT	312	365.98	46.7966	4404884
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	391.351	49.7391	4404963
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	391.601	49.7311	4404996
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	OPT	303	392.523	50.087	4404874
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	406.114	51.8043	4405004
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	407.926	51.9742	4405020
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	OPT	139	409.292	52.0797	4404988
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	411.258	52.3618	4404863
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	414.213	54.1495	4404940
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	416.403	52.8168	4404899
Tal/ Tal-05_c18.xml	OPT	16	421.489	62.1598	4404974
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	433.295	56.4855	4404921
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	446.623	56.7115	4404854
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	OPT	326	467.894	59.4925	4404923
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	477.84	60.628	4404989
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	OPT	331	504.43	64.3895	4405007
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	511.7	64.8165	4404920
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	544.216	69.1249	4404960
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	550.951	69.8527	4405037
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	559.967	71.2387	4404949
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	583.146	73.7766	4404954
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	586.53	76.3001	4405033
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	587.592	76.1542	4404868
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	621.215	83.5344	4404955
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	621.464	78.6804	4404971
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	637.123	80.535	4404994
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	OPT	4	671.289	85.178	4405021
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	689.923	87.395	4405035
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	695.946	89.3201	4405009
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	700.327	88.4171	4404998
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	744.365	93.9963	4404939
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	765.744	96.6976	4404948
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	835.035	106.254	4404892
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	OPT	39	932.458	118.368	4404980
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	961.195	121.2	4404987
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	1123.97	142.713	4404851
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	1141.25	143.856	4404995
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1147.28	144.9	4404917
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	OPT	89	1231.64	155.305	4404992
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	1254.62	158.268	4404977
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	OPT	34	1296.74	164.273	4404982
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	OPT	718	1350.42	170.237	4405008
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	OPT	40	1362.28	172.855	4404979
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	OPT	40	1399.24	177.051	4404984
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1486.8	187.57	4404876
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	1823.11	230.166	4405110
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	OPT	310	1896.71	238.884	4405006

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	189069313	405.744	252.117	4404853
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	234848176	441.243	252.126	4404882
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	381548184	473.851	252.144	4404934
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	589424576	564.365	252.165	4404912
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1841782	1305.21	252.105	4405082
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	17387	1446.82	252.111	4405051
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31244	1686.84	252.118	4405097
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	34	1708.03	252.05	4405108
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	22662	1713.3	252.134	4405100
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	77	1743.51	252.136	4405103
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1294	1794.7	252.13	4405074
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	5	1823.97	252.13	4405078
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	1882.47	252.116	4405040
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	795	1899.89	252.111	4405116
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	1930.55	252.108	4404932
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	941	1939.13	252.129	4405049
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1828	1941.54	252.126	4405105
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	855	1955.21	252.111	4405093
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12882352	1968.12	252.125	4405071
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	1968.88	252.135	4405081
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	600	1973.24	252.111	4405112
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	305	1981.87	252.153	4405086
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	318	1982.02	252.088	4405068
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	346	1982.09	252.139	4405094
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	6	1983.81	252.106	4405117
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	1985.2	252.121	4405066
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	105	1991.83	252.133	4405065
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	459	1992.76	252.094	4404985
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	1993.18	252.103	4404901
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	223	1993.93	252.175	4405087
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1336	1994.31	252.148	4405080
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	316	1994.7	252.161	4405089
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	132	1994.73	252.129	4405070
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	338	1994.81	252.154	4405096
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	1995.47	252.103	4405106
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	38	1995.49	252.117	4404981
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	1995.6	252.102	4405119
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	70	1995.88	252.104	4405054
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	453	1995.88	252.144	4405095
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	269	1995.94	252.172	4405069
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	685	1996.02	252.09	4405092
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	597	1996.03	252.127	4405090
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	337	1996.13	252.164	4405075
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	138	1996.2	252.153	4405085
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	133	1996.3	252.151	4405088
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	43	1996.43	252.111	4404983
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	408	1996.94	252.151	4405046
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	1997.04	252.105	4404975
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	1997.18	252.109	4405063
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	135	1997.64	252.103	4405120
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	563	1997.93	252.106	4405083
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	1998.04	252.096	4404978
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	1998.18	252.103	4404976
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	47255	1998.47	252.102	4405102
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	500	1998.51	252.104	4405079
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	1998.79	252.117	4405032
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	467	1999.16	252.124	4405062
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	1999.61	252.096	4404878
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	1999.77	252.095	4405072
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	110	1999.96	252.094	4405118
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	966	2000.82	252.086	4405107
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	108	2001	252.095	4405067
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	884	2001.23	252.103	4405091
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	132	2001.24	252.062	4405109
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	SAT (TO)	581	2001.36	252.126	4405039
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	SAT (TO)	21	2001.6	252.104	4404973
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	140	2001.65	252.099	4405101
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	83	2001.69	252.102	4405121
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	142	2003.16	252.094	4405076
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2003.85	252.112	4405057
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	142	2003.97	252.105	4405073
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	156	2005.13	252.093	4405077
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2005.62	252.1	4405084
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	SAT (TO)	0	2005.87	252.082	4405058

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	? (TO)	731.706	252.182	4405047
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	? (TO)	1244.71	254.635	4404860
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	1247.44	252.385	4405056
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	? (TO)	1386.76	254.506	4404946
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	1972.52	252.108	4405052
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	1977.45	252.122	4405048
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	1982.55	252.12	4405050
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	1983.87	252.119	4405061
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	1987.29	252.116	4405104
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	1997.15	252.123	4405045
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	1997.66	252.101	4405111
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2000.49	252.107	4405114
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2000.66	252.096	4405059
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2002.17	252.097	4405053
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	? (TO)	2003.25	252.093	4405038
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2003.66	252.105	4405113
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2003.68	252.117	4405099
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	2003.7	252.118	4405098
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2003.96	252.105	4405064
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2006.83	252.097	4405060

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	Wrong Opt.	175	4.81159	1.34057	4404959
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	Wrong Opt.	223	6.6465	1.71974	4404965
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	Wrong Opt.	240	7.67229	1.97153	4404931
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	Wrong Opt.	235	8.65269	2.1447	4404870
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	Wrong Opt.	256	10.239	2.54561	4404925
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	Wrong Opt.	293	11.6657	2.8779	4404893
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	Wrong Opt.	308	15.5907	3.77618	4404970

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	Wrong UNSAT	2.91205	0.938302	4404935
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	Wrong UNSAT	2.91298	0.926092	4404930
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	Wrong UNSAT	3.12583	0.958266	4404928
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	Wrong UNSAT	3.172	0.959584	4405027
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	Wrong UNSAT	5.1797	1.43851	4404962
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	Wrong UNSAT	6.33469	1.98913	4404972
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	Wrong UNSAT	6.47781	1.56079	4404953
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	Wrong UNSAT	6.52264	1.70281	4404941
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	Wrong UNSAT	6.93076	1.84734	4404886
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	Wrong UNSAT	8.43048	2.46106	4404936
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	Wrong UNSAT	8.69275	2.27598	4404969
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	Wrong UNSAT	12.2956	3.73491	4404919
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	Wrong UNSAT	19.5234	4.81732	4404945

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver choco-solver 2019-09-20 parallel (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (2 runs) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (183 runs) [Show/Hide]

Solver timed out but found at least a solution (74 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (1 run) [Show/Hide]

Solver timed out (no solution given) (20 runs) [Show/Hide]

Solver found a wrong optimum (7 runs) [Show/Hide]

Solver wrongly proved unsatitisfiability (13 runs) [Show/Hide]