2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		701.468	687.711	4396393

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	7.12664	3.30665	4396362
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	9.43216	3.98187	4396342
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	9.92982	4.03752	4396479
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	10.7549	4.33336	4396363
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	10.8974	5.41722	4396352
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	11.6396	4.56826	4396482
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	12.6499	4.81087	4396353
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	12.7701	4.95082	4396406
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	13.2557	5.064	4396485
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	13.7702	5.27353	4396390
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	13.8174	5.46202	4396461
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	15.6389	5.91349	4396451
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	15.7943	8.61759	4396371
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	OPT	2	15.8703	6.03731	4396493
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	16.2582	6.42227	4396380
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	16.2774	6.6105	4396489
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	17.7657	7.36918	4396445
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	18.64	8.45223	4396413
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	19.4996	11.9537	4396343
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	22.1928	14.9867	4396429
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	22.4255	12.2184	4396381
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	24.9217	12.7158	4396465
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	26.7854	18.3561	4396399
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	27.8718	16.422	4396481
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	28.5314	15.737	4396439
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	28.956	16.3159	4396456
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	31.3114	19.3676	4396400
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	34.0871	24.2846	4396435
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	36.8897	23.0579	4396490
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	39.4638	28.2681	4396484
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	42.1932	29.8466	4396430
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	46.8585	37.8634	4396361
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	47.0977	35.5183	4396345
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	50.5166	39.8595	4396364
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	64.8208	53.4841	4396469
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	71.6987	63.219	4396354
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	81.4847	70.4247	4396344
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	83.4998	61.9193	4396473
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	OPT	162507055	89.1041	57.2622	4396402
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	92.5705	80.9112	4396366
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	101.52	91.0848	4396475
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	108.873	95.2836	4396538
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	113.197	91.3731	4396492
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	113.393	100.487	4396557
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	115.657	90.8942	4396462
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	118.433	109.351	4396365
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	121.295	112.516	4396436
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	OPT	63832030	130.256	101.745	4396373
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	139.995	130.12	4396507
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	OPT	130971634	141.276	94.86	4396454
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	145.299	133.964	4396356
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	154.673	137.546	4396487
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	162.22	147.429	4396348
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	165.697	152.957	4396440
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	171.797	162.298	4396472
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	172.14	160.564	4396420
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	181.103	167.493	4396357
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	184.878	176.848	4396346
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	194.952	173.249	4396467
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	202.745	187.538	4396347
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	206.954	177.691	4396460
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	217.314	198.918	4396433
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	OPT	12	227.613	213.691	4396421
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	229.325	219.541	4396478
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	241.62	230.745	4396506
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	252.392	236.964	4396358
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	316.773	301.378	4396367
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	319.272	296.391	4396539
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	325.579	313.097	4396447
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	355.379	338.744	4396427
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	358.694	338.62	4396355
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	391.576	375.188	4396372
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	396.673	380.526	4396480
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	424.102	406.011	4396392
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	427.759	413.563	4396360
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	OPT	24	448.467	427.246	4396626
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	464.045	450.311	4396532
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	465.806	449.226	4396470
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	472.566	454.32	4396351
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	515.648	496.011	4396401
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	520.087	501.504	4396418
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	558.528	533.659	4396525
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	OPT	48	567.092	553.382	4396639
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	580.958	570.31	4396359
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	620.939	600.311	4396415
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	656.107	633.416	4396384
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	667.545	648.052	4396471
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	677.092	653.9	4396448
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	678.868	650.493	4396424
Tal/ Tal-05_c18.xml	OPT	16	681.904	662.464	4396494
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	703.943	688.597	4396513
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	715.474	690.886	4396374
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	787.169	768.973	4396438
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	789.777	770.935	4396517
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	804.713	787.016	4396442
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	866.576	841.732	4396521
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	882.181	856.292	4396455
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	917.313	893.45	4396419
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	918.132	892.861	4396450
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	1013.95	993.908	4396370
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	1075.18	1052.59	4396422
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	1139.47	1111.26	4396554
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	1152.01	1121.09	4396416
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	1191.83	1168.41	4396468
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	1202.74	1172.14	4396459
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	1249.07	1217.12	4396350
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	1338.63	1319.08	4396523
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	1344.77	1326.95	4396377
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	1367.68	1336.53	4396491
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	1426.81	1403.01	4396483
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	1439.26	1405.41	4396369
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	1651.35	1632.38	4396536
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1663.24	1629.41	4396437
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	1769.94	1751.29	4396535
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	1808.04	1784.28	4396474
Tal/ Tal-03_c18.xml	OPT	96	1864.62	1833.31	4396449
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	2059.35	2038.88	4396534
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	2145.15	2123.63	4396379
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	2149.62	2106.02	4396396
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	2196.42	2167.17	4396518
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	2238.68	2200.37	4396408

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT	564258657	656.713	532.321	4396432

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	5	2400.04	2352.93	4396544
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	SAT (TO)	1079	2400.04	2373.63	4396395
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	SAT (TO)	14	2400.04	2355.53	4396542
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	SAT (TO)	1	2400.04	2347.83	4396486
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	SAT (TO)	1289	2400.05	2374.33	4396397
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	SAT (TO)	65	2400.05	2372.62	4396510
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	131	2400.05	2353.73	4396621
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	SAT (TO)	26	2400.05	2365.33	4396423
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	138	2400.05	2352.73	4396596
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	42	2400.05	2363.33	4396503
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	SAT (TO)	1070	2400.05	2374.54	4396386
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	68	2400.05	2364.83	4396574
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	SAT (TO)	1427	2400.05	2372.84	4396549
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1272	2400.05	2357.54	4396594
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	2053	2400.06	2344.24	4396569
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	SAT (TO)	990	2400.06	2352.04	4396547
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	SAT (TO)	48	2400.06	2376.14	4396477
Opd/Opd-sum-large/ Opd-16-035-010.xml	SAT (TO)	4	2400.06	2353.33	4396409
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	SAT (TO)	82	2400.06	2368.73	4396514
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	473	2400.06	2346.04	4396505
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	56285	2400.06	2351.04	4396622
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2400.06	2363.43	4396500
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	150	2400.06	2352.05	4396629
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	SAT (TO)	1429	2400.06	2374.43	4396385
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	SAT (TO)	718	2400.06	2347.04	4396528
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	SAT (TO)	2	2400.06	2370.63	4396522
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	10	2400.06	2357.34	4396458
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	SAT (TO)	65	2400.07	2376.65	4396530
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	SAT (TO)	2	2400.07	2376.13	4396466
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	SAT (TO)	29	2400.07	2368.14	4396453
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	SAT (TO)	73	2400.07	2368.43	4396516
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	10	2400.07	2357.34	4396434
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2400.07	2352.15	4396496
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	SAT (TO)	104	2400.07	2369.33	4396511
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.07	2341.23	4396527
Opd/Opd-sum-small/ Opd-15-015-004.xml	SAT (TO)	2	2400.07	2353.83	4396428
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.07	2378.13	4396592
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	SAT (TO)	32	2400.07	2362.04	4396431
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2400.07	2363.04	4396502
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	SAT (TO)	1003	2400.07	2375.14	4396551
Opd/Opd-sum-small/ Opd-10-015-006.xml	SAT (TO)	3	2400.07	2362.74	4396414
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	72	2400.07	2358.04	4396630
Opd/Opd-sum-small/ Opd-10-038-010.xml	SAT (TO)	3	2400.07	2372.83	4396457
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	128	2400.07	2360.04	4396587
PeacableArmies/ PeacableArmies-m1-07_c18.xml	SAT (TO)	7	2400.07	2354.04	4396463
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	SAT (TO)	693	2400.08	2367.44	4396444
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	SAT (TO)	1109	2400.08	2377.54	4396387
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	326	2400.08	2350.53	4396443
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	329	2400.08	2348.04	4396426
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2400.08	2352.84	4396398
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	SAT (TO)	960	2400.08	2374.23	4396403
Opd/Opd-sum-small/ Opd-10-031-009.xml	SAT (TO)	3	2400.08	2361.84	4396545
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	SAT (TO)	55	2400.08	2358.34	4396405
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	171	2400.08	2344.16	4396590
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	438	2400.08	2355.35	4396588
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	SAT (TO)	1049	2400.08	2375.05	4396376
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	SAT (TO)	980	2400.08	2361.24	4396388
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	SAT (TO)	1241	2400.08	2374.53	4396550
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	8	2400.09	2337.43	4396552
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	303	2400.09	2349.73	4396394
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	300	2400.09	2349.04	4396446
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	SAT (TO)	90	2400.09	2370.03	4396512
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.09	2355.04	4396604
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	SAT (TO)	98	2400.09	2366.73	4396519
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	SAT (TO)	52	2400.09	2370.93	4396383
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	SAT (TO)	992	2400.09	2374.64	4396378
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2400.09	2370.03	4396553
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	39	2400.09	2363.83	4396504
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	354	2400.1	2342.35	4396595
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	6	2400.1	2349.23	4396541
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	480	2400.1	2349.23	4396558
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31597	2400.1	2347.45	4396617
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	SAT (TO)	6	2400.1	2352.93	4396524
Opd/Opd-sum-large/ Opd-09-350-100.xml	SAT (TO)	70	2400.1	2347.37	4396618
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2400.1	2351.15	4396497
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	312	2400.1	2348.43	4396404
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	38	2400.1	2363.43	4396501
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	1084	2400.1	2342.86	4396632
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2400.1	2359.64	4396577
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.1	2347.43	4396526
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	782	2400.1	2352.72	4396599
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	700	2400.1	2341.14	4396612
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	113	2400.1	2361.63	4396638
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1352	2400.1	2346.37	4396600
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	40	2400.11	2364.03	4396499
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	111	2400.11	2362.34	4396641
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1439	2400.11	2344.96	4396613
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	35620	2400.11	2356.24	4396571
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1467	2400.11	2347.24	4396611
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	311	2400.11	2349.23	4396407
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	142	2400.11	2360.83	4396640
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	SAT (TO)	97	2400.11	2368.53	4396509
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	144	2400.11	2353.33	4396597
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	SAT (TO)	1121	2400.11	2377.83	4396548
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	SAT (TO)	5	2400.11	2347.74	4396543
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	402	2400.11	2345.68	4396616
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.11	2362.24	4396560
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	242	2400.12	2343.78	4396607
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	SAT (TO)	139	2400.12	2367.43	4396508
Opd/Opd-sum-small/ Opd-10-030-009.xml	SAT (TO)	3	2400.12	2360.83	4396546
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	SAT (TO)	113	2400.12	2365.94	4396520
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	645	2400.12	2344.47	4396610
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	228	2400.12	2343.88	4396608
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2400.12	2351.93	4396495
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	127	2400.12	2350.15	4396593
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.12	2366.14	4396601
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	SAT (TO)	1105	2400.12	2374.53	4396411
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	354	2400.12	2348.63	4396425
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	442	2400.12	2345.67	4396614
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	SAT (TO)	450	2400.12	2364.33	4396412
Opd/Opd-sum-small/ Opd-10-032-009.xml	SAT (TO)	3	2400.12	2359.05	4396382
Opd/Opd-sum-small/ Opd-09-024-008.xml	SAT (TO)	3	2400.12	2362.84	4396476
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	SAT (TO)	262	2400.13	2348.53	4396368
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1360038	2400.13	2352.86	4396602
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	SAT (TO)	34	2400.13	2361.93	4396464
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	725	2400.13	2352.33	4396582
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	5	2400.13	2357.83	4396540
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	SAT (TO)	103	2400.13	2369.43	4396515
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1331	2400.13	2348.06	4396636
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	286	2400.13	2343.28	4396589
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	SAT (TO)	1105	2400.13	2360.56	4396349
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2400.14	2355.64	4396498
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	29	2400.14	2366.34	4396586
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2400.14	2365.95	4396637
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	11135169	2400.14	2348.93	4396591
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	987	2400.14	2349.94	4396603
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	197124	2400.14	2320.96	4396620
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	SAT (TO)	26	2400.14	2362.13	4396417
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	SAT (TO)	14	2400.14	2355.34	4396635
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.15	2369.04	4396583
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2400.15	2364.93	4396391
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1828	2400.15	2340.45	4396625
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	2400.15	2368.23	4396452
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	205	2400.15	2340.46	4396605
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	72	2400.15	2349.53	4396623
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	400	2400.15	2344.37	4396609
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	SAT (TO)	627	2400.17	2347.16	4396559
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	961	2400.17	2354.56	4396598
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	509	2400.17	2343.57	4396566
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	278	2400.18	2343.88	4396606
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	619	2400.18	2344.57	4396615
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	267	2400.2	2346.8	4396585
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	SAT (TO)	45	2400.41	2334.35	4396441

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	? (TO)	2400.05	2363.04	4396533
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	? (TO)	2400.05	2373.53	4396563
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.06	2359.52	4396573
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.06	2362.62	4396578
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	? (TO)	2400.07	2373.23	4396564
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.08	2363.15	4396572
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.08	2357.07	4396579
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2400.08	2351.93	4396627
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.08	2362.06	4396624
PeacableArmies/ PeacableArmies-m2-07_c18.xml	? (TO)	2400.08	2356.14	4396488
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	? (TO)	2400.09	2360.05	4396555
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	? (TO)	2400.09	2366.83	4396410
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	? (TO)	2400.1	2348.94	4396375
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	? (TO)	2400.11	2367.83	4396562
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	? (TO)	2400.11	2367.84	4396537
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.12	2332.24	4396619
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.12	2362.63	4396561
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	? (TO)	2400.12	2362.14	4396529
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	? (TO)	2400.13	2370.83	4396556
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	? (TO)	2400.13	2365.63	4396531
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	? (TO)	2400.13	2362.83	4396389
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.13	2357.48	4396580
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.14	2367.35	4396570
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	? (TO)	2400.15	2357.26	4396575
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.17	2342.58	4396633
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.18	2313.61	4396634
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.22	2356.35	4396568
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.25	2352.66	4396584
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.28	2347.71	4396576
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.43	2351.68	4396581
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	? (TO)	2400.58	2018.35	4396567
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2402.09	2360.43	4396631
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2402.11	2376.93	4396565

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver Concrete 3.12.2 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (121 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) but this may not be the optimal solution (1 run) [Show/Hide]

Solver timed out but found at least a solution (143 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (1 run) [Show/Hide]

Solver timed out (no solution given) (33 runs) [Show/Hide]