2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		65.65	9.4555	4407273
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	UNSAT		792.598	100.087	4407441

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	1.62416	0.669895	4407242
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	2.49541	0.821284	4407300
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	3.00549	0.919189	4407222
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	3.49893	0.972012	4407232
Opd/Opd-sum-small/ Opd-15-015-004.xml	OPT	1	3.87761	1.05564	4407308
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	5.14049	1.17982	4407223
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	5.29161	1.17081	4407351
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	5.80858	1.28162	4407364
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	6.05124	1.286	4407225
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	6.21197	1.56689	4407359
Opd/Opd-sum-small/ Opd-09-024-008.xml	OPT	2	6.59615	1.3803	4407356
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	6.97074	1.45661	4407294
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	7.38231	1.80829	4407362
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	7.38649	1.55059	4407244
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	7.80913	1.62535	4407246
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	7.93389	1.96715	4407365
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	8.98348	2.11246	4407341
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	9.26062	2.20202	4407270
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	9.30407	1.71083	4407315
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	10.2088	2.35104	4407286
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	10.2411	1.82953	4407307
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	10.2575	1.98439	4407233
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	10.6836	2.49905	4407331
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	10.9189	2.04055	4407236
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	11.403	1.98244	4407245
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	12.4712	2.10618	4407241
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	12.7783	3.59441	4407296
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	12.8182	2.34877	4407280
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	12.9478	2.16978	4407425
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	13.3538	3.01035	4407369
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	13.5439	3.1934	4407325
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	13.9662	2.41396	4407239
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	14.2486	3.36104	4407293
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	14.3293	2.44534	4407279
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	14.6681	2.40009	4407234
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	15.0072	2.44816	4407262
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	15.1474	2.40629	4407261
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	15.3119	2.57037	4407224
Opd/Opd-sum-small/ Opd-10-030-009.xml	OPT	2	15.6848	2.51622	4407426
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	16.3103	2.88379	4407243
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	16.7808	2.63962	4407358
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	17.0891	4.69756	4407229
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	18.7927	3.0846	4407309
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	19.6599	3.99593	4407336
Opd/Opd-sum-small/ Opd-10-038-010.xml	OPT	2	20.0084	3.06115	4407337
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	20.0366	3.4119	4407418
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	20.037	3.45831	4407235
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	20.0655	3.53827	4407249
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	20.3748	4.48466	4407319
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	20.4157	4.63186	4407304
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	21.3332	5.69129	4407372
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	21.4564	3.22325	4407361
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	22.7485	3.56009	4407226
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	23.2022	3.57105	4407318
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	24.4389	5.07932	4407370
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	25.8702	3.93101	4407272
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	27.8483	7.17082	4407353
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	28.278	4.62037	4407288
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	29.076	5.93209	4407230
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	30.6929	6.80327	4407345
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	31.3533	5.75789	4407419
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	31.8651	5.74803	4407347
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	32.8557	4.99281	4407290
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	33.444	5.51626	4407264
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	34.0486	5.16313	4407237
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	34.8969	4.98614	4407352
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	37.4797	6.48485	4407423
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	38.2872	5.60611	4407295
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	38.8899	5.50901	4407313
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	39.1636	5.45101	4407444
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	39.4231	5.48411	4407310
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	39.9122	5.98426	4407252
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	40.3229	7.60769	4407298
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	44.8839	6.90721	4407366
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	46.3305	6.5129	4407289
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	46.9729	6.46683	4407327
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	47.3273	7.35209	4407434
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	OPT	10	49.3462	7.06864	4407314
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	51.2612	8.08413	4407266
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	52.4416	7.45666	4407338
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	52.6607	7.9981	4407368
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	52.9967	12.31	4407342
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	56.104	8.17802	4407283
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	58.7539	8.19153	4407291
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	62.1016	9.15025	4407413
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	68.9009	9.29035	4407285
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	68.9575	9.26338	4407316
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	69.4215	10.1328	4407275
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	72.0085	9.77301	4407250
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	73.4732	10.1449	4407247
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	OPT	98	80.996	10.9107	4407399
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	83.6851	11.4933	4407227
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	89.1798	11.7831	4407357
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	90.188	12.7309	4407430
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	94.5007	13.308	4407412
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	94.6319	12.8257	4407238
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	97.5524	13.0271	4407228
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	98.1418	13.6944	4407256
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	OPT	4	101.52	13.963	4407421
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	101.573	13.3559	4407322
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	OPT	161	102.745	13.5612	4407436
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	103.972	14.3475	4407277
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	104.011	13.8217	4407231
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	105.742	13.9815	4407390
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	109.778	14.6797	4407302
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	112.867	14.7919	4407367
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	121.618	16.3628	4407343
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	123.193	16.7812	4407257
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	125.322	17.0437	4407259
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	125.754	16.7889	4407281
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	128.29	17.1114	4407255
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	OPT	326	132.018	17.3378	4407306
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	132.067	17.9138	4407415
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	OPT	353	137.047	17.8934	4407305
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	OPT	2	142.492	18.3944	4407443
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	151.897	19.8134	4407333
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	152.129	19.811	4407386
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	154.542	20.3406	4407240
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	157.071	21.0721	4407416
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	158.121	20.6563	4407400
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	162.339	22.3511	4407265
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	163.51	21.2837	4407344
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	OPT	3	164.047	21.1582	4407442
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	167.044	22.3755	4407269
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	167.102	21.6757	4407350
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	OPT	310	168.394	21.9093	4407287
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	172.263	22.9774	4407417
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	174.483	22.5525	4407330
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	177.243	23.5593	4407414
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	180.126	24.249	4407405
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	180.305	23.2692	4407328
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	183.253	23.6386	4407335
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	187.988	24.3508	4407403
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	191.2	24.8032	4407303
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	191.399	26.5473	4407431
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	201.224	27.3324	4407428
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	229.206	29.3847	4407393
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	OPT	1120	230.416	29.7302	4407271
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	234.589	30.2276	4407297
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	235.86	32.1005	4407267
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	236.097	31.7769	4407429
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	239.548	30.7793	4407248
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	240.863	31.6507	4407411
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	243.175	31.1577	4407391
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	OPT	14	243.936	31.5002	4407422
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	252.16	33.6355	4407258
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	OPT	300	257.337	33.0765	4407326
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	275.493	35.7536	4407263
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	285.913	36.6661	4407311
Tal/ Tal-05_c18.xml	OPT	16	293.921	46.1114	4407374
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	294.222	37.5633	4407394
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	OPT	14	305.051	39.2438	4407515
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	312.695	39.944	4407360
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	331.904	42.2936	4407401
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	340.111	48.233	4407321
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	340.865	44.1063	4407410
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	342.594	43.6703	4407387
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	OPT	312	348.57	44.5206	4407284
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	355.494	47.3121	4407324
Tal/ Tal-03_c18.xml	OPT	96	357.275	68.2763	4407329
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	362.759	46.6037	4407402
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	364.768	46.405	4407254
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	370.712	47.2125	4407427
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	378.73	48.1313	4407398
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	387.221	49.3309	4407420
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	399.599	50.7537	4407397
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	404.329	51.3519	4407320
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	405.178	51.4133	4407299
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	415.905	52.835	4407363
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	OPT	303	436.975	55.62	4407274
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	437.004	55.7308	4407424
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	439.542	55.8317	4407396
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	OPT	326	439.811	56.0784	4407323
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	OPT	139	492.885	62.526	4407388
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	496.837	65.9298	4407340
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	496.976	65.7894	4407433
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	499.002	65.0773	4407268
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	571.718	72.5559	4407354
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	575.961	72.9068	4407389
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	595.92	79.5782	4407355
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	OPT	331	604.484	76.9183	4407407
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	642.242	81.3134	4407437
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	644.784	81.5131	4407371
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	715.262	90.3822	4407339
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	725.165	91.5829	4407348
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	731.148	92.656	4407435
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	788.315	100.14	4407292
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	796.116	100.507	4407395
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	836.264	106.273	4407349
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	879.094	112.37	4407409
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	OPT	458	898.189	114.056	4407385
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	OPT	39	915.05	116.06	4407380
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	1113.25	141.243	4407251
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	OPT	40	1145.73	145.15	4407379
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	OPT	89	1150.7	144.975	4407392
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1157.27	146.061	4407317
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	1218.14	153.662	4407377
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	OPT	34	1222.18	154.667	4407382
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	OPT	718	1325.45	167.109	4407408
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	OPT	40	1504.83	190.066	4407384
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	1549.13	195.857	4407404
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1582.61	199.561	4407276
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	OPT	4	1910.26	241.067	4407432
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	OPT	310	1934.9	243.581	4407406
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	1956.05	246.631	4407510
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	1957.43	246.69	4407439

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	189081953	394.105	252.093	4407253
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	234833906	428.106	252.176	4407282
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	381548184	509.705	252.108	4407334
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	589447078	634.337	252.107	4407312
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	6	711.004	252.108	4407517
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	20631	1645.35	252.129	4407451
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	5	1653.31	252.12	4407478
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	21220	1758.41	252.133	4407500
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31258	1760.66	252.108	4407497
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1362	1829.29	252.131	4407474
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	935	1836.99	252.14	4407493
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1898058	1900.59	252.115	4407482
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	1901.22	252.111	4407440
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	1934.94	252.117	4407332
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	941	1941.24	252.122	4407449
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	22	1946.73	252.124	4407508
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1828	1951.83	252.118	4407505
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	1965.63	252.116	4407481
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12882352	1968.83	252.126	4407471
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	684	1970.55	252.116	4407512
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	1980.71	252.103	4407466
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	297	1987.64	252.118	4407486
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	883	1988.1	252.126	4407516
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	311	1988.91	252.16	4407489
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	346	1989.69	252.157	4407494
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	394	1990.41	252.109	4407468
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	110	1994.42	252.091	4407518
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	1994.95	252.101	4407506
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	224	1994.96	252.144	4407487
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	43	1995.02	252.095	4407383
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	138	1995.21	252.173	4407485
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	1995.22	252.104	4407301
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	77	1995.36	252.112	4407503
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	70	1995.63	252.11	4407454
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	1995.77	252.1	4407381
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	597	1996.03	252.109	4407490
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	337	1996.08	252.15	4407475
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	135	1996.24	252.175	4407470
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	339	1996.37	252.159	4407496
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	133	1996.44	252.14	4407488
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	408	1996.45	252.159	4407446
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	269	1996.48	252.137	4407469
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	1996.84	252.104	4407519
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	453	1997.07	252.153	4407495
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	242	1997.18	252.148	4407465
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	1997.48	252.089	4407375
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1336	1997.76	252.169	4407480
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	1998.12	252.102	4407376
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	1998.41	252.099	4407463
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	47945	1998.74	252.12	4407502
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	459	1998.86	252.117	4407462
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	1998.95	252.106	4407378
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	708	1999.92	252.105	4407492
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	1999.93	252.095	4407278
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	140	1999.96	252.114	4407501
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	84	2000.21	252.099	4407467
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	500	2000.33	252.141	4407479
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	135	2000.48	252.027	4407520
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	932	2000.51	252.099	4407491
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	960	2001.5	252.098	4407507
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	132	2001.87	252.113	4407509
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	79	2001.94	252.098	4407521
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	SAT (TO)	14	2002.25	252.096	4407373
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	555	2002.3	252.116	4407483
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	SAT (TO)	0	2003.68	252.045	4407453
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	142	2003.83	252.104	4407473
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	158	2003.89	252.094	4407477
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	15	2004	252.104	4407457
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2005.73	252.116	4407484
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2005.78	252.086	4407472
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	141	2006.12	252.108	4407476
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	SAT (TO)	0	2006.26	252.084	4407458

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	?		564.607	105.868	4407455
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	?		890.937	180.301	4407346

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	? (TO)	760.997	252.166	4407447
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	? (TO)	1161.64	254.113	4407260
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	1271.75	252.188	4407456
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	1970.21	252.111	4407448
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	1971.01	252.113	4407452
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	1979.58	252.12	4407461
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	1980.34	252.113	4407450
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	1983.86	252.13	4407504
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	1996.73	252.105	4407445
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	1997.03	252.103	4407511
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2000.76	252.107	4407459
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2000.84	252.114	4407514
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2001.41	252.112	4407499
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2001.82	252.097	4407513
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	? (TO)	2003.38	252.101	4407438
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2003.74	252.101	4407464
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	2004.02	252.104	4407498
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2006.32	252.068	4407460

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver choco-solver 2019-09-24 parallel (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (2 runs) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (206 runs) [Show/Hide]

Solver timed out but found at least a solution (72 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (2 runs) [Show/Hide]

Solver timed out (no solution given) (18 runs) [Show/Hide]