2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		420.574	420.543	4390213

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	0.012578	0.012949	4390182
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	0.027254	0.0275529	4390219
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	0.040849	0.041987	4390289
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	0.059417	0.0596389	4390183
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	0.076002	0.0764009	4390162
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	0.087535	0.0892071	4390172
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	0.103448	0.109664	4390173
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	0.111983	0.112249	4390299
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	0.150585	0.150447	4390302
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	0.189143	0.193355	4390305
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	0.217018	0.21849	4390281
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	0.250179	0.250205	4390210
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	0.251194	0.252491	4390226
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	0.25816	0.300539	4390300
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	0.276381	0.319428	4390290
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	0.315281	0.318094	4390265
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	0.317093	0.317884	4390200
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	0.326088	0.330425	4390271
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	0.330595	0.335851	4390286
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	0.35928	0.359635	4390309
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	0.555451	0.555707	4390233
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	0.692329	0.692777	4390276
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	1.03784	1.03831	4390259
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	1.14826	1.15023	4390181
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	1.16899	1.16936	4390170
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	1.32046	1.32203	4390169
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	1.40633	1.4068	4390184
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	1.76864	1.76911	4390310
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	1.83648	1.83774	4390163
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	1.93663	1.93756	4390244
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	2.0694	2.07004	4390285
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	2.20472	2.21075	4390236
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	2.50447	2.506	4390164
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	4.62752	8.03389	4390255
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	4.8186	4.81846	4390312
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	5.32391	5.32426	4390249
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	5.69025	5.69606	4390287
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	6.2231	6.22283	4390180
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	6.98429	6.9858	4390179
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	7.75327	7.75576	4390174
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	8.24524	8.24715	4390186
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	9.23042	9.23139	4390212
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	9.69151	9.69086	4390185
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	9.69526	9.69584	4390308
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	OPT	2	9.78332	11.3023	4390272
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	10.0514	10.0521	4390166
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	10.2339	10.2362	4390177
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	OPT	221	10.6779	10.6797	4390391
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	11.0043	11.0074	4390304
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	15.1765	15.178	4390167
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	16.6481	16.6575	4390293
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	19.2947	19.3101	4390165
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	20.7885	20.7893	4390187
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	22.8672	22.8734	4390301
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	23.0685	23.0691	4390178
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	26.062	26.0641	4390298
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	29.2057	29.2042	4390171
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	29.3892	29.391	4390223
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	29.3899	29.3924	4390192
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	30.4461	30.4476	4390282
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	30.6443	30.6448	4390168
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	37.8957	37.8987	4390231
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	39.1808	39.1904	4390204
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	40.8388	40.8369	4390221
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	48.0645	48.0662	4390206
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	49.8432	49.8471	4390250
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	50.8121	50.811	4390176
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	60.3181	60.3203	4390190
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	63.3342	63.3268	4390256
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	65.0997	65.1048	4390292
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	65.8963	65.8964	4390307
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	68.9174	68.917	4390238
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	70.6407	70.6445	4390345
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	74.7653	74.7682	4390215
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	80.4049	80.4049	4390374
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	84.459	84.4662	4390191
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	87.3117	87.3319	4390370
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	87.3691	87.3717	4390196
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	107.792	107.791	4390217
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	123.358	123.362	4390207
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	126.569	126.592	4390267
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	134.567	134.573	4390273
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	147.73	147.735	4390283
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	147.813	147.831	4390208
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	181.03	181.032	4390368
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	222.157	222.165	4390198
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	OPT	4	233.796	233.825	4390372
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	235.061	235.102	4390268
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	245.073	245.061	4390371
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	281.165	281.167	4390275
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	302.691	302.692	4390288
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	302.991	303.024	4390279
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	313.461	313.474	4390205
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	317.093	317.101	4390341
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	319.635	319.693	4390369
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	320.676	320.739	4390377
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	340.302	340.33	4390264
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	343.572	343.597	4390262
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	358.219	358.231	4390243
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	382.954	382.97	4390237
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	418.143	418.171	4390203
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	426.681	426.696	4390270
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	559.623	559.616	4390367
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	571.545	571.566	4390284
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	632.063	632.033	4390242
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	730.524	730.524	4390239
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	860.848	860.836	4390343
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	871.506	871.455	4390225
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	1158.35	1158.5	4390344
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	1192.52	1192.55	4390342
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1279.78	1279.75	4390257
Tal/ Tal-03_c18.xml	OPT	96	1327.75	1327.96	4390269
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	1516.15	1516.4	4390251
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	1793	1792.98	4390450
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	1945.69	1945.75	4390260
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1969.29	1969.3	4390216

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	6	2400.01	2400.01	4390360
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.01	2400.01	4390412
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	206	2400.01	2400.3	4390441
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.01	2399.9	4390347
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	387	2400.01	2400.2	4390245
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	SAT (TO)	-25000	2400.01	2399.7	4390350
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2400.01	2400.11	4390318
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	221	2400.01	2399.9	4390413
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	SAT (TO)	-24000	2400.01	2400.01	4390353
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	317	2400.01	2400.2	4390266
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	SAT (TO)	276	2400.01	2399.9	4390188
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2400.01	2400.01	4390241
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	SAT (TO)	-6986	2400.01	2400.2	4390220
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	1209	2400.01	2400.11	4390423
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	SAT (TO)	-24000	2400.02	2399.9	4390197
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	SAT (TO)	-24000	2400.02	2400.11	4390355
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	SAT (TO)	-28000	2400.02	2400.11	4390349
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	113	2400.02	2399.9	4390458
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	SAT (TO)	-25000	2400.02	2399.8	4390352
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2400.02	2399.9	4390446
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.02	2399.9	4390380
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1131	2400.02	2400.2	4390456
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	6	2400.02	2400.11	4390364
PizzaVoucher/ PizzaVoucher-12a_c18.xml	SAT (TO)	40	2400.02	2400.3	4390258
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	11	2400.02	2400.11	4390254
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	41	2400.02	2400.11	4390323
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2400.02	2399.9	4390322
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	SAT (TO)	450	2400.02	2399.9	4390232
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	349	2400.02	2400.11	4390263
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2400.03	2399.9	4390373
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2400.03	2400.1	4390457
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.03	2400.2	4390421
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	SAT (TO)	4	2400.03	2400.11	4390235
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2400.03	2400.11	4390317
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2400.03	2399.7	4390211
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	SAT (TO)	-24000	2400.03	2399.9	4390354
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	816	2400.03	2399.7	4390419
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	312	2400.03	2400.11	4390214
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	SAT (TO)	1	2400.03	2400.11	4390306
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	276	2400.04	2399.9	4390417
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	40	2400.04	2400.2	4390319
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	SAT (TO)	-25000	2400.04	2400.2	4390209
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	SAT (TO)	1015	2400.04	2400.11	4390195
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	SAT (TO)	4	2400.04	2400.11	4390228
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	9	2400.04	2400.4	4390361
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1967	2400.04	2400.11	4390431
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31710	2400.04	2400.11	4390437
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	SAT (TO)	8	2400.04	2400.11	4390189
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	SAT (TO)	-19000	2400.04	2400.11	4390358
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	11182902	2400.04	2400.11	4390411
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	2400.04	2400.01	4390406
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	40	2400.04	2400.01	4390324
Opd/Opd-sum-small/ Opd-11-011-005.xml	SAT (TO)	3	2400.04	2399.9	4390240
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	2400.04	2399.9	4390321
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	137	2400.05	2400.11	4390460
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	398	2400.05	2400.11	4390408
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.05	2400.11	4390346
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2400.05	2400.01	4390376
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1876	2400.05	2400.5	4390445
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	SAT (TO)	6	2400.05	2400.11	4390392
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT (TO)	529692396	2400.05	2400.22	4390387
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	SAT (TO)	48	2400.05	2400.01	4390297
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	17	2400.05	2400.2	4390397
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	58361	2400.05	2401.4	4390440
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2400.05	2400.11	4390316
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	SAT (TO)	-24000	2400.05	2400.11	4390357
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	967	2400.05	2400.01	4390402
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1300	2400.05	2400.2	4390414
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	229229905	2400.06	2400.2	4390222
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	11	2400.06	2400.01	4390278
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	578394884	2400.06	2400.21	4390252
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	SAT (TO)	-15984	2400.06	2400.01	4390230
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	75	2400.06	2400.01	4390461
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	SAT (TO)	-24000	2400.06	2400.11	4390356
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	4	2400.06	2400.3	4390418
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	20	2400.06	2400.3	4390448
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1541	2400.06	2400.01	4390389
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	SAT (TO)	-24000	2400.06	2400.01	4390199
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	SAT (TO)	3078	2400.06	2400.01	4390194
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2400.06	2400.01	4390315
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	231	2400.06	2400.11	4390416
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	96	2400.06	2400.2	4390407
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1495	2400.06	2400.2	4390433
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	348	2400.06	2400.3	4390246
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	202	2400.07	2400.01	4390449
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	SAT (TO)	47	2400.07	2400.01	4390280
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	374253920	2400.07	2400.31	4390274
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	SAT (TO)	-25000	2400.07	2400.01	4390351
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1695417	2400.08	2400.2	4390422
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	66	2400.08	2400.01	4390394
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2400.08	2400.11	4390320
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	338	2400.08	2400.11	4390224
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	SAT (TO)	0	2400.08	2400.1	4390395
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	SAT (TO)	139	2400.08	2400.2	4390294
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	59555	2400.08	2400.3	4390442
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	SAT (TO)	13	2400.08	2400.2	4390359
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	SAT (TO)	13	2400.08	2400.2	4390363
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	SAT (TO)	47	2400.08	2400.11	4390261
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2400.09	2400.2	4390459
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	996	2400.09	2400.11	4390452
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	SAT (TO)	125	2400.09	2400.2	4390303
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	321	2400.09	2400.2	4390227
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2400.09	2399.9	4390218
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	498	2400.1	2400.01	4390378
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.1	2400.11	4390403
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	SAT (TO)	8	2400.1	2399.8	4390175
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	181624473	2400.1	2400.3	4390193

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	? (NS)	0.026479	0.026929	4390336
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	? (NS)	0.02659	0.0268141	4390338
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	? (NS)	0.026602	0.0264479	4390337
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	? (NS)	0.029988	0.0304569	4390334
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	? (NS)	0.030322	0.030615	4390335
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	? (NS)	0.046568	0.046967	4390332
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	? (NS)	0.046801	0.0471539	4390330
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	? (NS)	0.047234	0.047644	4390331
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	? (NS)	0.047809	0.0482991	4390333
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	? (NS)	0.053683	0.0540251	4390329
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	? (NS)	0.053861	0.0551979	4390328
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	? (NS)	0.054445	0.054923	4390327
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	? (NS)	0.056815	0.057312	4390326
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	? (NS)	0.102166	0.108486	4390340
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	? (NS)	0.10323	0.10371	4390339

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.02	2400.11	4390381
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	? (TO)	2400.02	2400.5	4390382
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	? (TO)	2400.03	2399.9	4390348
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	? (TO)	2400.03	2400.3	4390375
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.03	2400.11	4390388
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	? (TO)	2400.04	2400.2	4390379
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.04	2400.2	4390399
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2400.04	2400.3	4390451
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	? (TO)	2400.04	2400.11	4390383
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	? (TO)	2400.04	2400.11	4390201
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.05	2400.11	4390453
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2400.05	2400.4	4390447
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	? (TO)	2400.05	2400.01	4390362
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.07	2400.01	4390398
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	? (TO)	2400.07	2400.11	4390325
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	? (TO)	2400.07	2400.01	4390432
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.07	2400.2	4390390
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.07	2399.9	4390444
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.08	2399.9	4390400
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.08	2400.11	4390401
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	? (TO)	2400.09	2400.01	4390455
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.09	2400.21	4390454
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.09	2400.5	4390393
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.1	2400.5	4390396
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.1	2400.01	4390404
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	? (TO)	2400.1	2400.4	4390384
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2400.1	2400.02	4390385
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.12	2400.01	4390439

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	? (MO)	287.198	289.032	4390443
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	? (MO)	287.674	290.137	4390295
Tal/ Tal-05_c18.xml	? (MO)	542.531	544.463	4390314
Opd/Opd-sum-small/ Opd-19-020-009.xml	? (MO)	1117.74	1119.82	4390424
Opd/Opd-sum-small/ Opd-15-015-004.xml	? (MO)	1163.5	1165.61	4390248
Opd/Opd-sum-small/ Opd-10-015-006.xml	? (MO)	1180.28	1182.16	4390234
Opd/Opd-sum-small/ Opd-10-030-009.xml	? (MO)	1271.28	1273.15	4390366
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (MO)	1277.08	1279.07	4390313
Opd/Opd-sum-small/ Opd-10-031-009.xml	? (MO)	1318.7	1320.69	4390365
Opd/Opd-sum-small/ Opd-10-032-009.xml	? (MO)	1370.58	1372.33	4390202
Opd/Opd-sum-small/ Opd-09-024-008.xml	? (MO)	1429.96	1432.08	4390296
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	? (MO)	1513.4	1515.23	4390420
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	? (MO)	1513.71	1515.81	4390405
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	? (MO)	1514.44	1516.85	4390430
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	? (MO)	1514.64	1516.75	4390435
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	? (MO)	1515.33	1517.77	4390415
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	? (MO)	1516.79	1518.63	4390434
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	? (MO)	1519.8	1521.07	4390386
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	? (MO)	1519.9	1522.16	4390425
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	? (MO)	1522.84	1524.59	4390428
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	? (MO)	1523.19	1525.23	4390409
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	? (MO)	1526.73	1528.46	4390427
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	? (MO)	1527.38	1529.51	4390426
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	? (MO)	1528.05	1530.23	4390436
Opd/Opd-sum-large/ Opd-15-035-010.xml	? (MO)	1531.27	1533.45	4390253
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	? (MO)	1533.14	1534.86	4390410
Opd/Opd-sum-large/ Opd-16-035-010.xml	? (MO)	1541.91	1543.88	4390229
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	? (MO)	1564.48	1567	4390429
Opd/Opd-sum-small/ Opd-10-037-014.xml	? (MO)	1679.91	1682.04	4390247
Opd/Opd-sum-small/ Opd-10-038-010.xml	? (MO)	1696.24	1698.44	4390277
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (MO)	2043.17	2045.33	4390438
Opd/Opd-sum-large/ Opd-03-350-100.xml	? (MO)	2053.34	2055.03	4390291
Opd/Opd-sum-large/ Opd-04-350-100.xml	? (MO)	2067.55	2069.86	4390311

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver cosoco 2 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (116 runs) [Show/Hide]

Solver timed out but found at least a solution (107 runs) [Show/Hide]

Solver does not handle one of the constraint (15 runs) [Show/Hide]

Solver timed out (no solution given) (28 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (33 runs) [Show/Hide]