2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		146.408	138.569	4401273

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	7.0103	3.21721	4401242
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	8.90609	3.81835	4401222
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	9.55499	4.74967	4401232
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	9.69705	4.05306	4401359
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	10.0093	3.95561	4401243
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	10.1126	4.48148	4401365
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	10.1714	4.21043	4401279
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	10.3497	4.12252	4401362
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	10.5034	4.44654	4401251
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	10.6335	4.30962	4401341
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	11.0673	4.47443	4401270
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	11.0953	4.26258	4401233
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	11.3675	4.71631	4401286
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	11.388	4.61035	4401369
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	11.7458	4.98777	4401260
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	11.885	4.53639	4401331
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	13.9381	5.42596	4401325
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	14.0364	5.58209	4401293
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	14.6288	6.91398	4401349
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	15.0765	6.25215	4401225
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	15.2547	6.00755	4401319
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	16.7339	9.35571	4401223
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	16.8149	7.19813	4401364
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	17.4258	8.91054	4401241
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	OPT	48	18.8373	8.6559	4401519
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	19.0257	8.60599	4401336
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	20.2057	9.77298	4401315
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	20.5783	9.06095	4401345
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	21.5899	14.0103	4401309
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	21.6581	10.5427	4401370
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	23.3526	12.5466	4401361
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	27.6544	16.8186	4401236
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	OPT	12	29.5994	18.9142	4401301
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	30.0302	22.6188	4401234
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	32.535	23.4687	4401244
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	OPT	24	33.4634	20.6589	4401506
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	35.2777	25.3222	4401280
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	36.1787	25.2302	4401310
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	40.1255	32.2332	4401245
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	41.2947	31.8986	4401224
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	41.7184	24.6107	4401347
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	42.5476	26.5208	4401372
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	43.7576	32.025	4401320
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	45.8381	34.2325	4401360
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	49.2464	38.4756	4401237
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	50.8934	38.3494	4401437
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	52.613	37.2518	4401230
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	53.7045	36.5105	4401353
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	53.8989	45.7661	4401316
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	55.0142	38.1958	4401366
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	56.2045	46.5737	4401240
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	58.3041	40.2671	4401342
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	OPT	63832030	59.952	35.3642	4401253
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	65.1133	53.9852	4401307
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	66.3059	56.8263	4401261
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	OPT	162507055	67.2894	40.3741	4401282
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	68.4885	42.7107	4401321
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	70.9736	59.6648	4401228
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	71.0318	61.055	4401355
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	74.4505	66.1716	4401352
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	74.8251	68.1355	4401226
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	83.5294	68.1669	4401296
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	83.8037	68.6939	4401304
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	OPT	2	84.1807	67.9819	4401332
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	85.8447	75.2947	4401272
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	OPT	13	89.0133	70.335	4401466
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	90.9481	82.8775	4401318
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	91.4646	79.1484	4401354
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	92.8002	81.3851	4401238
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	97.1305	73.5985	4401340
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	98.9129	87.6952	4401247
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	102.71	91.4191	4401227
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	OPT	130971634	108.16	56.9279	4401334
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	124.199	108.511	4401229
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	128.304	119.021	4401327
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	OPT	506362597	131.185	75.6536	4401312
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	131.926	116.99	4401367
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	141.433	129.99	4401262
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	148.364	141.759	4401239
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	148.833	137.104	4401231
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	154.164	146.51	4401358
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	166.735	152.503	4401351
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	185.184	168.032	4401249
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	224.823	203.129	4401423
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	225.451	214.488	4401346
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	225.707	213.097	4401350
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	226.712	213.316	4401343
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	229.557	216.874	4401281
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	234.461	223.714	4401250
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	237.787	227.117	4401386
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	251.306	237.786	4401298
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	265.481	255.252	4401302
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	274.392	260.442	4401264
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	298.233	288.178	4401403
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	310.762	294.083	4401328
Tal/ Tal-05_c18.xml	OPT	16	330.59	315.195	4401374
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	341.209	327.271	4401434
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	388.859	362.929	4401405
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	391.622	373.441	4401335
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	395.768	382.734	4401412
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	398.553	378.641	4401295
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	425.535	407.611	4401401
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	432.166	415.893	4401252
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	441.054	424.617	4401363
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	450.25	437.122	4401387
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	468.231	455.536	4401402
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	469.489	456.04	4401322
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	502.218	482.028	4401288
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	515.196	499.219	4401339
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	OPT	2	517.321	494.933	4401440
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	524.967	503.031	4401254
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	537.389	520.965	4401348
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	620.46	603.457	4401333
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	647.101	626.265	4401299
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	676.386	644.976	4401419
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	681.008	658.811	4401330
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	685.203	667.998	4401357
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	724.194	706.928	4401397
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	746.788	728.841	4401311
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	779.452	749.31	4401255
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	787.795	768.193	4401303
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	797.676	770.068	4401248
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	966.654	947.497	4401283
Tal/ Tal-03_c18.xml	OPT	96	1071.29	1047.78	4401329
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1090.34	1062.7	4401276
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	1097.87	1084.51	4401259
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1114.72	1087.39	4401317
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	1114.84	1092.49	4401389
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	1130.06	1105.85	4401444
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	1203.21	1178.13	4401393
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	1203.52	1180.73	4401396
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	1282.43	1255.72	4401344
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	1342.82	1318.74	4401267
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	1395.49	1357.92	4401235
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	1405.77	1372.89	4401427
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	1417.2	1379.42	4401435
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	1442.08	1412.54	4401400
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	1499.13	1466.03	4401377
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	1596.15	1580.38	4401414
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	1709.86	1683.06	4401391
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	1737.2	1706.87	4401395
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	1770.93	1741.72	4401390
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	1775.96	1747.29	4401275
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	1845.48	1814.18	4401266
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	1852.8	1820.09	4401291
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	OPT	105	1931.02	1892.62	4401376
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	1933.53	1913.01	4401415
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	1966.55	1933.17	4401265
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	OPT	93	2001.22	1959.45	4401378
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	2046.08	2007.38	4401292
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	2246.82	2209.45	4401398
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	2265.67	2225.77	4401285
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	2272.21	2252.4	4401416
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	2396.34	2355.7	4401430

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	55660	2400.04	2351.53	4401502
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	SAT (TO)	992	2400.04	2359.93	4401258
Opd/Opd-sum-small/ Opd-10-038-010.xml	SAT (TO)	3	2400.04	2350.33	4401337
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	SAT (TO)	82	2400.05	2364.74	4401394
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	246	2400.05	2344.85	4401487
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	38	2400.05	2356.83	4401379
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	980	2400.05	2340.43	4401512
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	10	2400.05	2349.43	4401314
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	5	2400.05	2347.34	4401424
Opd/Opd-sum-small/ Opd-10-030-009.xml	SAT (TO)	3	2400.06	2353.23	4401426
Opd/Opd-sum-small/ Opd-10-031-009.xml	SAT (TO)	3	2400.06	2352.53	4401425
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	134	2400.06	2351.43	4401509
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2400.06	2351.24	4401436
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	SAT (TO)	2	2400.06	2355.73	4401443
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	SAT (TO)	-4936	2400.06	2374.04	4401417
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.06	2352.14	4401463
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	114	2400.06	2359.43	4401518
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	293	2400.07	2345.15	4401486
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	SAT (TO)	89	2400.07	2359.64	4401392
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1773	2400.07	2336.64	4401449
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	SAT (TO)	718	2400.07	2340.04	4401408
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	378	2400.07	2343.73	4401468
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	303	2400.07	2346.93	4401274
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	326	2400.07	2350.84	4401306
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2400.07	2362.33	4401271
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	5	2400.07	2345.23	4401420
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	223	2400.07	2345.25	4401488
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	87	2400.07	2353.43	4401521
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2400.07	2359.23	4401380
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31539	2400.07	2340.93	4401497
Opd/Opd-sum-small/ Opd-11-011-005.xml	SAT (TO)	3	2400.07	2355.24	4401300
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	985	2400.07	2346.93	4401483
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	956	2400.07	2344.93	4401474
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	72	2400.07	2359.43	4401510
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2400.07	2340.93	4401517
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	72	2400.08	2350.84	4401503
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	40	2400.08	2357.23	4401384
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	SAT (TO)	1003	2400.08	2359.53	4401431
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2400.08	2354.23	4401278
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	273	2400.08	2343.06	4401465
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	94383	2400.08	2301.95	4401500
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2400.08	2353.44	4401501
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	SAT (TO)	8	2400.08	2345.64	4401268
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	174	2400.08	2354.14	4401477
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	SAT (TO)	98	2400.08	2358.73	4401399
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	206	2400.08	2342.35	4401485
Opd/Opd-sum-small/ Opd-10-015-006.xml	SAT (TO)	3	2400.08	2353.63	4401294
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1356	2400.08	2343.75	4401480
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	126	2400.08	2351.63	4401476
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	326	2400.08	2349.53	4401323
Opd/Opd-sum-large/ Opd-15-035-010.xml	SAT (TO)	4	2400.08	2344.84	4401313
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	864	2400.08	2355.23	4401462
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	36553	2400.09	2359.05	4401451
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2400.09	2358.93	4401457
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	10	2400.09	2349.23	4401338
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	385	2400.09	2344.15	4401496
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	8	2400.09	2348.73	4401432
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	2400.09	2356.14	4401381
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2400.09	2357.63	4401382
Opd/Opd-sum-small/ Opd-09-024-008.xml	SAT (TO)	3	2400.09	2354.73	4401356
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	435	2400.1	2341.75	4401489
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	457	2400.1	2347.44	4401494
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.1	2355.84	4401406
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	SAT (TO)	34	2400.1	2354.93	4401246
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	139	2400.1	2355.94	4401520
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	827	2400.1	2356.43	4401479
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	SAT (TO)	6	2400.1	2342.43	4401324
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	462	2400.1	2344.75	4401446
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	124	2400.11	2352.63	4401467
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	466	2400.11	2343.43	4401385
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	SAT (TO)	5	2400.11	2349.85	4401404
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	SAT (TO)	1427	2400.11	2360.23	4401429
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	310	2400.11	2348.73	4401287
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	SAT (TO)	867	2400.11	2304.36	4401514
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	4	2400.11	2340.54	4401421
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.11	2347.93	4401484
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1500	2400.11	2346.85	4401491
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2400.11	2358.73	4401433
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	11873564	2400.11	2344.24	4401471
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1422557	2400.11	2348.75	4401482
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	SAT (TO)	26	2400.12	2359.53	4401297
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	SAT (TO)	1289	2400.12	2359.83	4401277
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	353	2400.12	2349.53	4401305
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	122	2400.12	2352.83	4401473
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	4	2400.12	2341.73	4401478
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1543	2400.12	2337.08	4401493
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	SAT (TO)	54	2400.12	2364.33	4401263
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	SAT (TO)	141	2400.12	2359.04	4401388
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	SAT (TO)	3	2400.12	2353.23	4401442
Opd/Opd-sum-large/ Opd-16-035-010.xml	SAT (TO)	4	2400.12	2344.53	4401289
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	671	2400.12	2338.23	4401492
Opd/Opd-sum-small/ Opd-15-015-004.xml	SAT (TO)	2	2400.13	2350.04	4401308
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.13	2355.14	4401472
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.13	2349.65	4401407
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	SAT (TO)	14	2400.13	2346.63	4401515
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.13	2367.53	4401481
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	312	2400.13	2348.73	4401284
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1299	2400.13	2340.63	4401516
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	301	2400.13	2347.23	4401326
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	985	2400.13	2349.73	4401507
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	71	2400.13	2353.23	4401454
Opd/Opd-sum-large/ Opd-04-350-100.xml	SAT (TO)	49	2400.14	2345.84	4401371
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	42	2400.14	2356.54	4401383
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	SAT (TO)	595	2400.14	2344.24	4401439
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	SAT (TO)	1049	2400.14	2359.93	4401256
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	SAT (TO)	1121	2400.14	2360.03	4401428
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	293	2400.14	2345.64	4401469
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	SAT (TO)	14	2400.14	2347.15	4401422
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2400.14	2352.93	4401375
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	477	2400.14	2350.83	4401438
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	169	2400.14	2342.25	4401470
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	344	2400.15	2344.35	4401475
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	482	2400.15	2344.35	4401490
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	669	2400.15	2345.34	4401495
Opd/Opd-sum-large/ Opd-09-350-100.xml	SAT (TO)	63	2400.15	2341.65	4401498
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1600	2400.16	2338.85	4401505
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT (TO)	525314977	2400.18	2098.48	4401447

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	? (TO)	2400.05	2366.04	4401257
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	? (TO)	2400.05	2369.14	4401410
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	? (TO)	2400.07	2365.23	4401413
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.07	2343.23	4401460
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.08	2345.45	4401464
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	? (TO)	2400.08	2363.84	4401409
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	? (TO)	2400.08	2357.55	4401455
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.08	2354.23	4401453
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	? (TO)	2400.09	2363.53	4401269
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	? (TO)	2400.09	2372.14	4401290
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.09	2349.24	4401459
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.1	2368.33	4401452
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.1	2359.93	4401441
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.11	2361.73	4401504
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	? (TO)	2400.11	2371.83	4401418
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	? (TO)	2400.11	2362.54	4401411
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.11	2367.64	4401450
PeacableArmies/ PeacableArmies-m2-07_c18.xml	? (TO)	2400.11	2355.93	4401368
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.13	2351.03	4401458
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.13	2336.25	4401513
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.13	2357.65	4401461
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.14	2326.03	4401499
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	2400.14	2346.04	4401373
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.15	2343.16	4401456
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.17	2344.07	4401448
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2402.07	2365.33	4401511
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2402.14	2376.42	4401445

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver Concrete 3.12.2 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (154 runs) [Show/Hide]

Solver timed out but found at least a solution (117 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (1 run) [Show/Hide]

Solver timed out (no solution given) (27 runs) [Show/Hide]