2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		1072.44	134.275	4398573
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	UNSAT		1791.26	224.263	4398741

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	0.026849	0.014174	4398542
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	0.086265	0.0412931	4398579
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	0.14669	0.054512	4398649
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	0.165259	0.0457089	4398522
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	0.198406	0.120725	4398659
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	0.317993	0.0664341	4398532
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	0.333898	0.16084	4398662
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	0.344778	0.23375	4398641
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	0.477719	0.20395	4398665
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	0.518059	0.133132	4398543
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	0.65059	0.169804	4398533
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	0.656407	0.246175	4398570
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	0.757203	0.266575	4398586
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	0.917931	0.467025	4398560
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	0.923403	0.333301	4398631
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	1.00915	0.246534	4398660
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	1.03416	0.25122	4398650
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	1.10066	0.38627	4398625
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	1.23061	0.419537	4398669
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	1.36031	0.269446	4398580
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	OPT	3	2.19243	0.290922	4398561
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	2.61573	0.377971	4398664
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	2.64381	0.34993	4398609
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	3.21287	0.431525	4398524
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	4.20268	0.544187	4398523
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	4.29794	0.585465	4398541
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	4.58194	0.824175	4398593
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	4.588	0.624909	4398615
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	4.65242	0.894076	4398636
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	5.34165	2.19537	4398596
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	5.39938	0.751659	4398525
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	5.85172	0.876798	4398718
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	7.85811	1.28368	4398619
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	8.12475	2.57138	4398604
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	11.6518	1.48132	4398658
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	11.7689	1.54048	4398546
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	12.5462	16.6023	4398647
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	12.8337	1.6461	4398564
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	13.6238	1.73892	4398572
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	15.5787	1.98965	4398581
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	15.6869	2.41744	4398645
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	16.1621	2.40001	4398670
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	16.3389	2.06336	4398534
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	17.6022	2.34689	4398590
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	21.0095	3.81469	4398530
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	21.3119	10.1683	4398646
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	22.0389	2.80184	4398531
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	25.2036	3.20791	4398618
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	25.7665	3.27844	4398547
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	28.0675	3.52829	4398539
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	28.9346	3.70864	4398540
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	30.1078	4.04397	4398713
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	30.1761	3.91351	4398672
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	30.7489	4.17117	4398712
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	32.251	4.09255	4398527
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	37.5273	4.71824	4398545
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	37.9323	4.8501	4398536
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	38.9566	4.92788	4398538
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	41.5535	5.47589	4398559
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	47.062	6.20783	4398711
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	50.467	6.49285	4398668
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	51.6071	12.1609	4398616
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	57.4689	7.23008	4398652
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	58.9461	7.39203	4398526
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	62.1993	8.10083	4398715
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	67.5503	8.73175	4398557
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	76.0796	9.66498	4398653
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	76.1582	9.86101	4398569
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	80.0678	10.2099	4398620
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	102.448	13.1048	4398714
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	103.29	12.9576	4398585
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	110.084	13.8626	4398550
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	119.906	15.3268	4398717
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	120.973	15.2001	4398528
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	139.177	17.7367	4398716
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	149.145	18.6956	4398622
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	154.447	19.4749	4398642
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	158.821	20.2022	4398710
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	164.423	20.5981	4398591
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	174.347	21.8441	4398583
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	176.91	22.2109	4398661
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	OPT	2	180.526	24.7937	4398632
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	183.1	24.5511	4398705
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	192.361	24.3018	4398737
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	OPT	221	201.407	30.1625	4398751
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	218.944	27.6263	4398663
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	225.452	28.9852	4398739
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	OPT	2	252.057	31.5836	4398743
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	264.318	33.1081	4398566
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	307.297	38.493	4398575
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	345.854	43.3728	4398610
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	348.528	44.129	4398709
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	353.632	44.3592	4398667
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	OPT	130	389.227	49.0483	4398654
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	442.677	55.4742	4398657
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	451.848	56.597	4398627
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	487.461	62.6605	4398529
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	529.666	66.3307	4398730
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	544.025	68.4264	4398643
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	563.43	70.5631	4398577
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	572.597	71.7086	4398556
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	618.622	77.4666	4398567
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	635.769	79.7083	4398633
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	OPT	161	714.906	89.7522	4398736
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	OPT	2	736.117	94.2958	4398740
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	787.853	98.7244	4398551
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	797.284	99.8593	4398635
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	801.995	100.528	4398597
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	827.187	103.688	4398603
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	885.835	110.942	4398644
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	896.891	112.325	4398639
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	947.224	118.592	4398565
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	OPT	669	970.064	122.451	4398735
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	988.947	123.839	4398628
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	1122.71	140.579	4398731
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	1148.83	143.871	4398648
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	1182.13	148.022	4398558
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	OPT	476	1242.19	156.57	4398738
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	1250.51	156.559	4398729
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	1312.78	164.385	4398728
Tal/ Tal-03_c18.xml	OPT	96	1333.11	167.184	4398629
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	OPT	3	1399.56	175.245	4398742
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	1463.21	183.215	4398744
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	1779.83	222.879	4398704
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	1798.1	225.149	4398630
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	1865.48	233.591	4398727

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	56333	1847.47	252.382	4398800
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	1956.41	252.077	4398817
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	1964.31	252.155	4398781
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	20	1974.45	252.03	4398808
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	1987.4	252.033	4398766
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1741	1990.15	252.156	4398749
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	2004	1991.13	252.144	4398805
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1807	1992.53	252.14	4398793
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	SAT (TO)	6	1994.78	252.057	4398624
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	SAT (TO)	48	1995.01	252.32	4398640
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	SAT (TO)	8	1995.2	252.075	4398568
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1355	1996.49	252.106	4398816
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	940	1996.92	252.071	4398812
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	SAT (TO)	47	1997.41	252.272	4398621
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	4	1998	252.111	4398778
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2001.29	252.028	4398806
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	2004.48	252.027	4398732
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	442	2005.91	252.029	4398768
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2007.04	252.025	4398707
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	SAT (TO)	8	2007.15	252.051	4398719
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	SAT (TO)	1015	2007.25	252.031	4398555
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2007.34	252.023	4398819
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2007.84	252.029	4398706
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	SAT (TO)	10	2007.92	252.035	4398723
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31716	2009.03	252.045	4398797
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	SAT (TO)	14	2009.64	252.01	4398815
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	SAT (TO)	8	2009.8	252.016	4398535
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2009.8	252.024	4398601
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1674624	2009.86	252.026	4398782
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	549	2010.03	252.026	4398774
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	10	2010.25	252.016	4398638
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	7	2010.33	252.025	4398721
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	1022	2010.35	252.024	4398783
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	92	2010.39	252.016	4398767
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2010.39	252.034	4398757
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	SAT (TO)	15	2010.43	252.024	4398722
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	10	2010.43	252.026	4398614
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	SAT (TO)	8	2010.56	252.024	4398549
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1516	2010.7	252.023	4398791
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	75	2010.87	252.026	4398821
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	SAT (TO)	983	2010.88	252.025	4398807
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	10507282	2010.99	252.026	4398771
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	6	2011.15	252.017	4398724
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	443	2011.25	252.025	4398779
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	421	2011.56	252.024	4398762
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	5	2011.62	252.023	4398720
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	SAT (TO)	4	2011.66	252.025	4398595
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	60000	2011.69	252.024	4398802
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	SAT (TO)	3	2011.74	252.021	4398666
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	SAT (TO)	4	2011.79	252.022	4398588
Opd/Opd-sum-small/ Opd-11-011-005.xml	SAT (TO)	3	2011.79	252.022	4398600
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	SAT (TO)	54	2012.08	252.023	4398563
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2012.19	252.025	4398763
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	SAT (TO)	26489	2012.35	252.014	4398599
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	71	2012.38	252.021	4398754
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	359	2012.42	252.022	4398605
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2012.43	252.02	4398733
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	303	2012.47	252.021	4398626
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	316	2012.47	252.022	4398587
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	142	2012.48	252.022	4398820
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	114	2012.48	252.021	4398818
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	SAT (TO)	32	2012.49	252.021	4398611
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	509	2012.5	252.026	4398685
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	SAT (TO)	5	2012.5	252.023	4398602
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	SAT (TO)	262	2012.51	252.021	4398548
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	330	2012.51	252.022	4398623
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	SAT (TO)	450	2012.52	252.022	4398592
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2012.53	252.021	4398680
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	SAT (TO)	3103	2012.53	252.022	4398554
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	SAT (TO)	67514	2012.55	252.014	4398701
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	42	2012.56	252.021	4398683
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	SAT (TO)	85	2012.56	252.02	4398576
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	40	2012.56	252.021	4398684
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2012.56	252.022	4398772
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	2012.57	252.02	4398681
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	334	2012.61	252.022	4398606
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	39	2012.62	252.021	4398679
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	72	2012.63	252.023	4398810
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2012.63	252.024	4398682
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2012.64	252.021	4398571
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	317	2012.64	252.024	4398584
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2012.65	252.021	4398675
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	SAT (TO)	2	2012.67	252.021	4398703
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	309	2012.67	252.021	4398574
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	121	2012.69	252.021	4398773
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	129	2012.69	252.021	4398809
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2012.75	252.024	4398578
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2012.8	252.023	4398677
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	144	2012.82	252.029	4398776
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	SAT (TO)	2	2012.85	252.021	4398702
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	131	2012.9	252.023	4398801
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	155	2012.95	252.02	4398777
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2012.97	252.024	4398678
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	SAT (TO)	76	2013.08	252.021	4398617
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2013.08	252.021	4398676

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	? (NS)	0.027755	0.0282061	4398698
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	? (NS)	0.028025	0.0283521	4398696
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	? (NS)	0.028869	0.030673	4398697
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	? (NS)	0.031765	0.0321871	4398694
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	? (NS)	0.032106	0.0322231	4398695
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	? (NS)	0.049151	0.0497669	4398690
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	? (NS)	0.049552	0.0500381	4398691
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	? (NS)	0.049586	0.0499591	4398693
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	? (NS)	0.050292	0.050724	4398692
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	? (NS)	0.056084	0.056574	4398688
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	? (NS)	0.056424	0.056833	4398687
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	? (NS)	0.057447	0.0578529	4398689
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	? (NS)	0.061004	0.0626869	4398686
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	? (NS)	0.109133	0.109552	4398699
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	? (NS)	0.109348	0.109309	4398700

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Opd/Opd-sum-large/ Opd-15-035-010.xml	? (TO)	252.339	254.136	4398613
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	? (TO)	252.346	254.15	4398770
Opd/Opd-sum-large/ Opd-04-350-100.xml	? (TO)	252.35	254.094	4398671
Opd/Opd-sum-small/ Opd-10-038-010.xml	? (TO)	252.351	254.118	4398637
Opd/Opd-sum-large/ Opd-03-350-100.xml	? (TO)	252.36	254.103	4398651
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	252.36	254.109	4398798
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	? (TO)	252.366	254.145	4398769
Opd/Opd-sum-small/ Opd-10-032-009.xml	? (TO)	252.372	254.138	4398562
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	? (TO)	252.372	254.137	4398789
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	? (TO)	252.378	254.129	4398788
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	? (TO)	252.381	254.141	4398765
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	? (TO)	252.382	254.131	4398787
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	? (TO)	252.384	254.129	4398790
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	? (TO)	252.387	254.137	4398746
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	? (TO)	252.398	254.15	4398775
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	? (TO)	252.405	254.136	4398794
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	? (TO)	252.41	254.14	4398780
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	? (TO)	252.412	254.143	4398786
Opd/Opd-sum-small/ Opd-10-031-009.xml	? (TO)	252.415	254.161	4398725
Opd/Opd-sum-large/ Opd-16-035-010.xml	? (TO)	252.417	254.142	4398589
Opd/Opd-sum-small/ Opd-10-037-014.xml	? (TO)	252.419	254.128	4398607
Opd/Opd-sum-small/ Opd-15-015-004.xml	? (TO)	252.426	254.192	4398608
Opd/Opd-sum-small/ Opd-10-015-006.xml	? (TO)	252.427	254.17	4398594
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	? (TO)	252.436	254.137	4398785
Opd/Opd-sum-small/ Opd-10-030-009.xml	? (TO)	252.436	254.16	4398726
Opd/Opd-sum-small/ Opd-19-020-009.xml	? (TO)	252.437	254.176	4398784
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	? (TO)	252.446	254.138	4398795
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	? (TO)	252.449	254.135	4398796
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	252.455	254.162	4398673
Opd/Opd-sum-small/ Opd-09-024-008.xml	? (TO)	252.461	254.148	4398656
Tal/ Tal-05_c18.xml	? (TO)	252.593	254.34	4398674
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	? (TO)	252.724	254.559	4398655
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	? (TO)	252.742	254.544	4398803
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	? (TO)	253.113	254.857	4398747
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	? (TO)	1464.98	252.528	4398612
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	? (TO)	1607.79	252.436	4398634
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	? (TO)	1660.9	252.335	4398582
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	? (TO)	1745.23	252.313	4398553
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	? (TO)	1754.66	252.149	4398755
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	1943.98	253.182	4398745
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	1973.75	252.779	4398811
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	1995.56	252.499	4398814
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2001.92	252.048	4398756
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2002.61	252.092	4398804
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2003.87	252.036	4398761
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2006	252.075	4398764
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	? (TO)	2006.73	252.036	4398708
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2007.01	252.037	4398748
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2008.61	252.024	4398750
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2009.51	252.04	4398813
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2010.62	252.026	4398759
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2010.75	252.026	4398752
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2010.78	252.025	4398799
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2010.82	252.024	4398760
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	? (TO)	2011.96	252.023	4398792
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2012.43	252.021	4398753
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2012.68	252.024	4398758

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	Wrong Opt.	610	0.826684	0.12471	4398544
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	Wrong Opt.	770	20.3878	2.59178	4398552
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	Wrong Opt.	587	20.9888	2.67409	4398598
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	Wrong Opt.	1687	21.4045	2.72582	4398734
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	Wrong Opt.	70	37.8682	4.8098	4398537

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver cosoco 2.O parallel (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (2 runs) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (126 runs) [Show/Hide]

Solver timed out but found at least a solution (95 runs) [Show/Hide]

Solver does not handle one of the constraint (15 runs) [Show/Hide]

Solver timed out (no solution given) (57 runs) [Show/Hide]

Solver found a wrong optimum (5 runs) [Show/Hide]