2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		26.2784	7.07484	4403973
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	UNSAT		663.154	167.094	4404141

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	1.27049	0.604083	4403942
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	1.835	1.01025	4404000
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	2.13132	0.846018	4404051
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	2.21226	0.872853	4403922
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	2.26315	1.58444	4403932
Opd/Opd-sum-small/ Opd-15-015-004.xml	OPT	1	2.29843	0.89741	4404008
Opd/Opd-sum-small/ Opd-09-024-008.xml	OPT	2	2.73933	0.983532	4404056
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	3.45819	1.18664	4404064
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	3.50218	1.17687	4403994
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	3.51149	1.19789	4403925
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	3.76027	1.25141	4403923
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	3.85228	1.2868	4403933
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	4.32204	1.41481	4403944
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	5.73491	1.77343	4403945
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	5.73644	1.77005	4403946
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	6.58358	2.34094	4403943
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	6.75931	2.01882	4403941
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	6.91219	2.37219	4403924
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	7.20762	2.13953	4404125
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	7.25047	2.12977	4403962
Opd/Opd-sum-small/ Opd-10-030-009.xml	OPT	2	7.57208	2.21901	4404126
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	7.64668	2.26571	4403980
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	8.01277	2.34402	4403939
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	8.18079	2.40324	4403936
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	8.68404	2.92099	4403996
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	8.87673	2.571	4404015
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	8.89752	2.60958	4403949
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	9.07436	2.59726	4403934
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	9.74071	3.14658	4403929
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	9.74407	3.46485	4404058
Opd/Opd-sum-small/ Opd-10-038-010.xml	OPT	2	9.95891	2.81478	4404037
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	10.6583	3.06168	4403935
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	11.1193	3.26145	4404009
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	11.7803	3.28911	4404007
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	11.9905	3.35895	4404018
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	12.1224	3.38482	4404144
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	12.2393	3.3908	4403926
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	12.7937	3.55142	4404013
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	13.0573	4.02851	4403930
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	13.2137	4.247	4404004
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	13.2373	3.69081	4404118
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	13.3957	3.74018	4403995
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	13.7374	4.32434	4403972
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	15.3026	4.17385	4403979
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	15.4069	4.21532	4403989
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	15.5912	4.22964	4403961
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	18.7649	5.04753	4404061
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	19.8038	5.33312	4404052
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	21.2961	5.84982	4403952
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	21.3642	5.74879	4403988
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	21.3725	5.80848	4404071
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	22.4521	6.22329	4403991
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	23.933	7.49406	4403998
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	24.1323	6.52599	4403937
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	24.3561	7.02628	4404119
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	24.5484	6.53521	4403990
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	24.7807	7.17861	4404123
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	25.3385	6.73885	4404038
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	OPT	10	25.7977	6.82111	4404014
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	26.1021	7.08094	4403983
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	27.2781	7.21295	4404068
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	27.5311	7.26333	4403975
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	27.6175	7.32481	4404010
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	27.9369	8.37914	4404134
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	OPT	98	29.3511	7.73465	4404099
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	30.1037	7.91264	4404027
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	30.5095	8.09199	4403985
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	31.4228	8.23479	4404016
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	33.1442	8.88511	4403966
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	34.6904	9.09386	4403950
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	42.0407	11.1563	4404112
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	44.7201	11.5691	4404057
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	45.1292	11.668	4403956
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	45.238	11.7951	4404002
Tal/ Tal-05_c18.xml	OPT	16	45.414	15.178	4404074
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	45.8861	11.9689	4404043
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	47.2513	12.2641	4403977
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	47.8939	12.5688	4404113
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	48.2783	12.4743	4404130
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	51.7776	13.3048	4403928
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	53.4838	13.7724	4404042
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	57.2971	15.0842	4403938
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	57.6323	14.8355	4404090
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	58.1627	15.0228	4403927
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	60.3427	15.5491	4404022
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	63.2782	16.2848	4403947
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	63.637	16.3153	4403965
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	OPT	161	63.6877	16.3587	4404136
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	65.6083	17.2771	4404047
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	67.3757	17.3536	4403955
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	70.0485	17.9858	4403981
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	71.5466	18.306	4404093
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	OPT	326	73.7571	18.9225	4404006
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	73.7893	19.1026	4404105
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	74.1987	19.0226	4404033
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	75.3747	19.3076	4404128
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	77.4295	19.915	4403940
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	79.2921	20.2967	4404044
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	OPT	2	80.2171	20.4663	4404143
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	81.1632	20.7817	4404100
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	82.5134	21.0993	4403931
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	82.6564	21.3558	4404066
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	83.0046	21.208	4404086
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	84.409	21.7319	4403959
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	88.1827	22.8186	4403967
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	OPT	353	88.4279	22.6257	4404005
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	88.6462	22.6037	4404050
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	89.8191	22.9786	4404003
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	92.3863	23.8255	4404103
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	OPT	3	92.7071	23.6197	4404142
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	92.9116	23.7663	4403948
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	93.7214	24.0156	4404131
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	OPT	1120	98.6036	25.2314	4403971
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	99.272	25.4374	4403957
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	OPT	300	103.232	26.3804	4404026
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	109.827	27.9435	4404129
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	OPT	4	110.326	28.1314	4404121
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	OPT	14	118.076	30.0402	4404122
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	119.381	30.3844	4403963
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	OPT	14	120.307	30.5898	4404215
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	123.618	31.4025	4404091
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	124.054	31.7527	4403958
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	127.255	32.4443	4404115
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	127.774	32.5187	4403997
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	129.318	32.9477	4404011
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	OPT	310	150.003	38.1577	4403987
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	154.591	39.4462	4404102
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	OPT	312	156.546	39.7844	4403984
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	157.692	40.2161	4403969
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	OPT	139	158.432	40.1598	4404088
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	164.071	41.7857	4404111
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	164.394	41.847	4404116
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	174.372	44.3422	4404114
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	175.694	45.2442	4404024
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	188.634	47.9359	4404117
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	189.306	47.9879	4404063
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	190.807	48.3465	4404124
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	192.345	48.7411	4404120
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	192.953	48.8717	4404097
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	204.174	52.0228	4404133
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	215.499	54.5484	4404020
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	229.517	58.2603	4404110
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	OPT	303	230.164	58.3177	4403974
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	243.718	61.6123	4404087
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	262.104	66.222	4404101
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	264.103	66.8537	4404049
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	264.453	66.8298	4403954
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	266.31	70.0787	4404021
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	269.576	68.115	4404054
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	278.282	70.3223	4404060
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	282.711	73.1067	4404040
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	283.432	71.6297	4404137
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	284.82	71.8994	4404096
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	310.465	79.3163	4403968
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	312.253	79.0445	4404135
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	318.842	80.4669	4404098
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	322.58	81.4574	4404094
Tal/ Tal-03_c18.xml	OPT	96	333.96	93.5845	4404029
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	339.654	86.134	4404109
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	370.656	93.496	4404089
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	389.668	98.6613	4403992
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	405.087	102.14	4404048
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	OPT	89	408.978	103.11	4404092
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	413.362	104.245	4404039
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	OPT	39	438.17	110.906	4404080
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	453.867	117.729	4404055
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	468.522	118.678	4403951
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	OPT	34	559.846	141.637	4404082
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	566.814	142.862	4404017
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	665.771	167.694	4404077
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	666.972	167.904	4404095
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	OPT	718	678.572	170.919	4404108
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	714.075	180.123	4404104
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	OPT	40	731.646	184.922	4404079
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	765.752	192.96	4403976
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	OPT	40	786.333	198.685	4404084
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	848.885	213.88	4404139
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	865.977	218.162	4404210
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	OPT	458	1181.35	298.396	4404085
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	OPT	116	1239.7	312.393	4403978
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	OPT	93	1297.36	326.85	4404078
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	OPT	105	1345.21	339.11	4404076
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	OPT	91	1756.54	442.784	4404075
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	OPT	476	1850.84	465.58	4404138
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	OPT	38	1905.97	480.49	4404081
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	OPT	43	2089.4	526.625	4404083
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	OPT	331	2346.94	590.016	4404107

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	380987079	2400.06	2322.16	4404034
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	234149418	2400.12	2322.88	4403982
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	143	2400.27	603.869	4404177
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	589221978	2400.31	2307.49	4404012
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	188879719	2400.32	2334.74	4403953
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	957	2400.33	616.89	4404149
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	2400.34	604.574	4404132
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	143	2400.35	603.885	4404176
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2400.35	606.155	4404219
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	519	2400.35	603.879	4404183
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	134	2400.35	604.674	4404220
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	2400.36	611.194	4404032
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.36	603.191	4404184
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	935	2400.36	606.099	4404207
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	2400.38	604.195	4404166
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	24644	2400.39	620.534	4404200
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.39	603.391	4404172
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	12293	2400.39	692.698	4404151
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.41	605.003	4404181
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	668	2400.41	604.699	4404192
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	912	2400.43	609.702	4404205
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	110	2400.44	604.187	4404218
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12968875	2400.44	608.491	4404171
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	5	2400.44	722.985	4404178
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.45	604.696	4404163
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	887	2400.46	606.602	4404193
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	435	2400.46	603.93	4404195
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	69	2400.47	605.13	4404185
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	476	2400.47	604.294	4404162
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	70	2400.48	605.163	4404154
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	SAT (TO)	0	2400.48	603.388	4404158
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2400.49	604.192	4404201
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	36	2400.49	665.201	4404208
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	328	2400.5	611.08	4404194
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.5	615.999	4404140
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	126	2400.51	604.289	4404209
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	554	2400.51	604.296	4404179
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	811	2400.52	605.399	4404216
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	SAT (TO)	11	2400.52	603.311	4404073
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	78	2400.52	618.779	4404203
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	6	2400.53	721.522	4404217
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2400.55	604.698	4404206
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	100	2400.55	604.018	4404188
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2400.55	605.97	4404001
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	290	2400.59	603.66	4404196
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	222	2400.61	603.773	4404187
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	15	2400.61	603.77	4404157
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31216	2400.61	630.192	4404197
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	409	2400.62	604.613	4404146
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	306	2400.63	605.773	4404168
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	46630	2400.64	603.776	4404202
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	845	2400.64	604.278	4404191
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	67	2400.64	603.686	4404221
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	103	2400.65	603.833	4404170
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.67	603.486	4404106
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	105	2400.68	603.713	4404165
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	482	2400.68	603.839	4404190
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	119	2400.71	604.182	4404173
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	96	2400.71	604.093	4404167
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1244	2400.73	620.112	4404174
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	306	2400.78	603.543	4404169
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1348	2400.81	603.765	4404180
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	291	2400.82	605.324	4404189
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	267	2400.83	603.764	4404186
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	330	2401.75	603.993	4404175

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	SAT (MO)	33951	2.29029	0.867796	4403999
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	SAT (MO)	12491	2.83349	1.08152	4404067
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	SAT (MO)	2397	4.56643	1.48681	4403964
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (MO)	313596	6.06877	2.04902	4404182
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (MO)	63820	13.7846	4.79004	4404212
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (MO)	345	16.4591	4.64978	4404023

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	?	127.703	47.7246	4404155
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	?	279.331	105.812	4404046
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	?	324.997	131.182	4403960
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	?	1806.58	565.7	4404147

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.32	604.598	4404150
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.34	603.587	4404213
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.34	604.186	4404199
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.46	604.252	4404159
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2400.47	603.793	4404145
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.48	605.033	4404152
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.54	607.406	4404148
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.55	603.584	4404153
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.62	603.096	4404160
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.67	603.79	4404204
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	2400.67	603.788	4404198
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.68	603.596	4404164
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2400.69	603.504	4404211
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.74	603.795	4404214
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.74	605.74	4404161
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2401.16	651.719	4404156

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	Wrong Opt.	175	3.27772	1.15535	4404059
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	Wrong Opt.	223	4.64161	1.59655	4404065
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	Wrong Opt.	235	6.04996	2.05763	4403970
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	Wrong Opt.	240	6.15652	2.09115	4404031
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	Wrong Opt.	256	7.76158	2.6198	4404025
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	Wrong Opt.	293	8.90909	2.98942	4403993
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	Wrong Opt.	308	11.3061	3.6921	4404070

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver choco-solver 2019-09-20 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (2 runs) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (187 runs) [Show/Hide]

Solver timed out but found at least a solution (65 runs) [Show/Hide]

Solver exceeded the memory limit but found at least a solution (6 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (4 runs) [Show/Hide]

Solver timed out (no solution given) (16 runs) [Show/Hide]

Solver found a wrong optimum (7 runs) [Show/Hide]

Solver wrongly proved unsatitisfiability (13 runs) [Show/Hide]

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	Wrong UNSAT	1.95837	0.785347	4404028
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	Wrong UNSAT	1.96104	0.793257	4404035
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	Wrong UNSAT	2.05495	1.12466	4404030
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	Wrong UNSAT	2.08741	0.818709	4404127
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	Wrong UNSAT	3.28544	1.17683	4404062
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	Wrong UNSAT	3.65228	1.21967	4404072
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	Wrong UNSAT	3.90641	1.31375	4404053
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	Wrong UNSAT	3.93433	1.40081	4404041
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	Wrong UNSAT	4.27901	1.48815	4403986
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	Wrong UNSAT	4.94196	1.70191	4404069
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	Wrong UNSAT	5.06194	1.75019	4404036
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	Wrong UNSAT	5.31925	1.96992	4404019
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	Wrong UNSAT	6.90565	2.74432	4404045