2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		28.0645	7.33585	4400373
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	UNSAT		700.022	176.311	4400541

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	1.29925	0.611463	4400342
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	1.75826	1.18908	4400400
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	2.22966	0.855485	4400451
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	2.27171	0.881888	4400332
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	2.30272	0.900289	4400322
Opd/Opd-sum-small/ Opd-15-015-004.xml	OPT	1	2.33906	0.8828	4400408
Opd/Opd-sum-small/ Opd-09-024-008.xml	OPT	2	2.68622	0.971143	4400456
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	3.42743	1.19714	4400323
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	3.59682	1.21051	4400325
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	3.69135	1.23361	4400394
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	3.71028	1.27312	4400344
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	3.76129	1.26739	4400464
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	3.77744	1.28835	4400333
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	4.84484	1.62614	4400462
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	4.86261	1.54417	4400346
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	5.36557	2.0393	4400465
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	5.97505	1.84306	4400345
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	6.14551	2.05095	4400441
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	6.44939	2.12722	4400370
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	6.57405	2.02984	4400343
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	6.68881	1.98295	4400341
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	7.23234	2.11888	4400362
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	7.31295	2.22932	4400324
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	7.36206	2.20065	4400336
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	7.69175	2.27378	4400380
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	7.72781	2.67237	4400396
Opd/Opd-sum-small/ Opd-10-030-009.xml	OPT	2	7.73456	2.25127	4400526
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	8.26139	2.38062	4400525
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	8.43881	2.67202	4400386
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	8.44979	2.4771	4400349
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	8.6575	2.5017	4400415
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	8.91405	2.87315	4400393
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	8.95911	2.82038	4400472
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	8.97111	2.87439	4400431
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	9.23277	2.652	4400334
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	9.25888	2.67177	4400335
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	9.48533	3.01003	4400326
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	9.66772	3.18952	4400469
Opd/Opd-sum-small/ Opd-10-038-010.xml	OPT	2	10.0187	2.80823	4400437
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	10.0825	2.87261	4400409
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	10.26	2.92796	4400458
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	10.8863	3.05418	4400418
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	11.7082	3.84047	4400329
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	11.8806	3.72437	4400404
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	11.8835	3.29256	4400407
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	12.2573	3.86122	4400339
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	12.343	4.43618	4400419
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	12.4954	3.48005	4400544
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	13.2081	3.65084	4400413
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	13.242	3.68113	4400372
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	13.2449	4.6701	4400436
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	15.106	4.83643	4400445
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	15.2272	4.20698	4400395
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	15.2284	4.96848	4400330
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	15.739	4.46096	4400388
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	15.9796	4.7845	4400389
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	17.6716	5.33591	4400452
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	17.8116	4.92581	4400364
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	19.5473	5.47736	4400352
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	19.5887	5.74981	4400461
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	20.0368	5.44603	4400471
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	20.1885	5.68128	4400398
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	20.3207	5.96344	4400518
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	20.8272	5.83491	4400361
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	21.6695	5.99756	4400366
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	21.818	6.28467	4400523
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	22.636	6.23508	4400391
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	22.705	6.20252	4400337
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	23.1546	6.18332	4400438
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	24.2661	6.43047	4400383
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	OPT	10	24.2857	6.45764	4400414
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	24.9628	6.61585	4400410
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	25.1689	6.74894	4400460
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	25.4304	7.33533	4400519
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	26.0766	6.90861	4400390
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	26.6332	7.06429	4400468
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	27.7723	8.14774	4400534
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	30.6556	8.50455	4400375
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	34.7226	9.51957	4400350
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	OPT	98	35.079	9.18029	4400499
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	35.43	9.41315	4400385
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	36.3014	9.72546	4400379
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	37.108	9.67902	4400427
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	37.6857	9.81722	4400416
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	41.4435	10.9765	4400512
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	42.3351	10.9589	4400530
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	43.274	11.1916	4400457
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	43.918	11.5611	4400356
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	46.9492	12.332	4400513
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	46.9634	12.2058	4400443
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	48.0568	12.5433	4400402
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	48.3213	12.5356	4400327
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	49.0351	12.6945	4400422
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	50.3426	14.1792	4400453
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	52.5504	14.2091	4400340
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	52.6557	15.4318	4400442
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	52.8085	13.5927	4400328
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	56.6573	14.6	4400338
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	OPT	65	59.4035	15.2769	4400490
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	59.8996	15.436	4400500
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	62.1968	15.9848	4400467
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	OPT	161	62.9847	16.1812	4400536
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	64.6695	16.6659	4400355
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	64.7569	17.5249	4400447
Tal/ Tal-05_c18.xml	OPT	16	64.907	20.1545	4400474
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	66.549	17.0833	4400365
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	70.0138	17.9195	4400486
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	71.3271	18.3095	4400347
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	OPT	2	73.605	18.818	4400543
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	73.7568	18.9348	4400381
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	74.211	19.2138	4400505
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	74.9861	19.22	4400433
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	OPT	326	76.4923	19.6089	4400406
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	OPT	353	77.2184	19.8419	4400405
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	77.9471	20.0735	4400377
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	78.0631	19.9999	4400444
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	OPT	4	78.1598	20.0478	4400521
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	78.6126	20.0862	4400450
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	80.7366	20.6185	4400493
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	81.9117	21.0532	4400466
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	83.5486	21.3472	4400331
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	84.6994	21.6296	4400528
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	84.9466	21.6879	4400487
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	86.6108	22.172	4400403
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	88.8121	22.9559	4400503
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	90.4774	23.0628	4400435
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	92.831	23.881	4400357
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	93.1056	23.9148	4400515
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	93.3141	24.0538	4400367
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	OPT	3	94.1282	23.9835	4400542
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	95.6126	24.3422	4400428
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	95.8192	24.4135	4400430
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	OPT	310	96.8573	24.9368	4400387
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	OPT	1120	101.21	25.9063	4400371
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	103.804	26.5579	4400514
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	111.73	28.453	4400531
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	115.421	29.3527	4400529
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	OPT	14	120.103	30.5346	4400615
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	120.711	30.8629	4400516
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	OPT	103	122.51	31.1117	4400491
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	125.245	31.8929	4400348
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	OPT	14	127.17	32.3238	4400522
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	129.678	33.0179	4400397
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	130.274	33.2758	4400369
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	131.767	33.6309	4400359
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	142.519	36.4205	4400358
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	149.945	38.2487	4400511
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	160.842	40.9188	4400411
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	164.731	41.8296	4400449
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	171.009	43.8035	4400502
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	171.197	43.5074	4400517
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	174.488	44.7671	4400424
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	185.19	46.9069	4400524
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	OPT	73	185.851	47.0368	4400496
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	191.826	48.8492	4400533
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	191.947	48.5945	4400363
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	OPT	2	192.133	48.7508	4400473
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	193.74	49.5253	4400520
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	198.28	50.1871	4400463
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	198.816	50.3626	4400527
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	OPT	312	208.256	53.1415	4400384
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	212.314	53.7027	4400420
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	217.843	55.1026	4400354
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	OPT	303	218.4	55.5056	4400374
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	223.192	56.4213	4400497
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	OPT	300	231.873	58.7046	4400426
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	245.517	62.2744	4400510
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	257.039	64.9189	4400501
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	260.235	65.6864	4400494
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	267.384	70.528	4400440
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	OPT	139	267.854	67.6751	4400488
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	269.859	71.0406	4400421
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	271.053	68.4704	4400454
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	271.812	69.3091	4400368
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	291.972	73.8072	4400537
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	OPT	326	300.039	76.1334	4400423
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	OPT	90	305.785	77.1457	4400498
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	314.527	79.4397	4400535
Tal/ Tal-03_c18.xml	OPT	96	322.157	90.5095	4400429
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	OPT	97	395.932	99.8185	4400489
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	408.458	103.38	4400509
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	409.567	103.235	4400439
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	OPT	39	426.532	108.093	4400480
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	427.555	108.226	4400448
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	428.218	108.355	4400392
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	430.016	112.239	4400455
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	497.391	126.224	4400351
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	565.111	142.402	4400417
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	OPT	34	571.86	144.667	4400482
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	OPT	89	584.003	147.083	4400492
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	OPT	40	613.032	155.443	4400484
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	OPT	718	641.058	161.471	4400508
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	OPT	103	649.592	163.658	4400495
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	OPT	104	668.691	168.442	4400477
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	691.074	174.198	4400376
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	OPT	40	693.51	175.438	4400479
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	736.466	185.452	4400399
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	738.166	186.308	4400504
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	853.784	215.537	4400539
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	886.709	223.342	4400610
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	OPT	116	1215.73	306.369	4400378
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	OPT	93	1233.98	310.846	4400478
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	OPT	458	1248.93	315.364	4400485
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	OPT	105	1329.31	335.023	4400476
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	OPT	38	1784.92	449.896	4400481
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	OPT	91	1803.44	454.253	4400475
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	OPT	476	1898.06	478.109	4400538
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	OPT	43	2109.11	531.654	4400483

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	589041906	2400.09	2301.16	4400412
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	225807374	2400.09	2247.15	4400382
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	381005184	2400.11	2326.75	4400434
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	188728062	2400.12	2335.96	4400353
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	67	2400.3	603.765	4400621
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	114	2400.33	604.112	4400588
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	845	2400.34	603.718	4400591
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	940	2400.36	607.477	4400607
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.37	603.374	4400584
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	476	2400.37	604.192	4400562
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	15	2400.38	603.582	4400557
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31216	2400.39	633.196	4400597
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	2004940	2400.4	648.385	4400582
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	668	2400.41	604.969	4400592
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	134	2400.42	604.578	4400620
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	96	2400.43	603.687	4400567
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	519	2400.44	603.794	4400583
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2400.44	604.387	4400601
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	97	2400.44	603.825	4400570
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	957	2400.44	614.905	4400549
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	584	2400.45	607.206	4400612
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	2400.46	604.214	4400566
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	126	2400.46	604.075	4400609
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.47	603.493	4400507
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	70	2400.47	605.104	4400554
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	306	2400.48	603.679	4400569
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.48	603.508	4400506
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	143	2400.49	603.8	4400577
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	435	2400.5	603.633	4400595
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	290	2400.5	603.94	4400596
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.5	604.903	4400581
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	5	2400.51	610.14	4400578
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	222	2400.51	603.707	4400587
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	24644	2400.52	620.706	4400600
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	36	2400.53	665.306	4400608
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	322	2400.53	603.576	4400568
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	887	2400.54	608.232	4400593
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	409	2400.55	603.596	4400546
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	6	2400.56	603.998	4400617
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	328	2400.56	604.222	4400594
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	482	2400.58	603.621	4400590
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	2400.59	604.201	4400532
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.59	603.362	4400572
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	110	2400.6	604.092	4400618
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12968875	2400.6	608.488	4400571
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	78	2400.61	616.212	4400603
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	72	2400.62	604.705	4400585
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1244	2400.63	616.399	4400574
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2400.63	605.695	4400401
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	330	2400.63	603.745	4400575
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	2400.65	615.29	4400432
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.65	605.19	4400563
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1348	2400.65	603.684	4400580
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2400.67	605.886	4400619
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2400.68	604.7	4400606
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.68	612.507	4400540
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	143	2400.69	604.39	4400576
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	811	2400.7	607.414	4400616
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	554	2400.71	604.199	4400579
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	SAT (TO)	0	2400.71	603.384	4400558
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	267	2400.73	605.905	4400586
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	47955	2400.73	603.594	4400602
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	291	2400.73	606.216	4400589
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	119	2400.76	604.099	4400573
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	105	2400.86	603.736	4400565
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	912	2401.23	610.392	4400605

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	SAT (MO)	224	3.22047	1.15435	4400459
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	SAT (MO)	188	6.83671	2.52887	4400425
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	SAT (MO)	248	7.61532	2.5639	4400470
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (MO)	144731	15.813	6.44817	4400551

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	?		854.317	249.828	4400555
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	?		1647.6	519.298	4400547

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.33	603.684	4400614
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.34	603.582	4400613
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.38	605.223	4400552
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.39	604.082	4400599
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.4	603.575	4400553
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.42	603.187	4400560
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.43	605.885	4400561
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.48	604.4	4400604
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	2400.49	603.993	4400598
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.54	609.485	4400548
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.56	604.485	4400564
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.64	604.499	4400559
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.67	604.497	4400550
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2400.69	603.495	4400611
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2400.74	604.523	4400545
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2401.07	656.297	4400556
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	? (TO)	2407.61	672.859	4400360
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	? (TO)	2408.14	666.278	4400446

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver choco-solver 2019-09-16 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (2 runs) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (208 runs) [Show/Hide]

Solver timed out but found at least a solution (66 runs) [Show/Hide]

Solver exceeded the memory limit but found at least a solution (4 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (2 runs) [Show/Hide]

Solver timed out (no solution given) (18 runs) [Show/Hide]