2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		421.522	421.487	4397673

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	0.013407	0.012861	4397642
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	0.027065	0.027518	4397679
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	0.041477	0.0417671	4397749
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	0.05926	0.061026	4397643
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	0.076072	0.076327	4397622
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	0.08717	0.0883721	4397632
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	0.10351	0.105239	4397633
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	0.112451	0.112736	4397759
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	0.151372	0.151856	4397762
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	0.190729	0.190621	4397765
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	0.219502	0.219654	4397741
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	0.250826	0.256695	4397760
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	0.253512	0.254997	4397686
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	0.253767	0.254105	4397670
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	0.279856	0.280126	4397750
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	0.310586	0.311082	4397660
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	0.318867	0.319245	4397725
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	0.327993	0.371978	4397746
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	0.330599	0.330927	4397731
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	0.36065	0.36099	4397769
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	0.556539	0.556958	4397693
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	0.694642	0.695183	4397736
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	1.04907	1.04968	4397719
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	1.14641	1.14738	4397641
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	1.18453	1.18604	4397630
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	1.33746	1.33739	4397629
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	1.41011	1.41084	4397644
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	1.78581	1.78626	4397770
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	1.83564	1.83715	4397623
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	1.95931	1.95984	4397704
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	2.08108	2.08184	4397745
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	2.21137	2.21246	4397696
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	2.53044	2.53315	4397624
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	4.60244	4.60876	4397715
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	4.94181	4.94675	4397772
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	5.28852	5.28885	4397709
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	5.82244	12.1059	4397747
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	6.60672	6.61171	4397640
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	6.87488	6.88071	4397639
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	7.74652	7.75717	4397634
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	8.34502	8.34809	4397646
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	9.20911	9.21504	4397672
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	OPT	2	9.4954	9.49689	4397732
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	9.63801	9.64109	4397768
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	9.68622	9.69027	4397645
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	10.0306	10.0315	4397626
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	10.3266	10.3324	4397637
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	OPT	221	10.8315	16.308	4397851
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	11.2458	11.2499	4397764
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	15.2144	15.2144	4397627
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	17.3544	17.3542	4397753
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	19.6165	19.6199	4397625
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	21.0161	21.0193	4397647
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	22.5161	22.5142	4397761
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	23.287	23.2952	4397638
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	25.904	25.9044	4397758
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	29.238	29.2389	4397631
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	29.2766	29.2752	4397652
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	29.3171	29.3204	4397683
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	30.6158	30.6182	4397628
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	31.2666	31.2654	4397742
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	37.6576	37.6549	4397691
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	39.2385	39.2355	4397664
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	40.8416	40.8375	4397681
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	47.684	47.6876	4397666
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	49.3014	49.3013	4397710
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	51.8996	51.8995	4397636
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	60.7419	60.7389	4397650
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	62.9688	62.971	4397716
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	64.4018	64.4104	4397752
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	65.5	65.4995	4397767
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	68.8412	68.8551	4397698
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	71.4158	71.4235	4397805
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	74.6607	74.6536	4397675
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	79.9772	79.9804	4397834
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	84.6146	84.6222	4397651
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	86.2132	86.2447	4397830
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	87.4123	87.4062	4397656
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	108.398	108.409	4397677
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	124.075	124.117	4397667
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	126.001	125.988	4397727
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	133.489	133.518	4397668
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	134.609	134.604	4397733
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	147.349	147.354	4397743
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	181.519	181.527	4397828
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	221.6	221.576	4397658
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	231.978	232.003	4397728
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	OPT	4	237.803	237.894	4397832
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	242.975	242.992	4397831
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	279.669	279.644	4397735
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	300.668	300.647	4397739
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	304.339	304.362	4397748
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	312.577	312.593	4397665
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	OPT	1427	316.619	316.646	4397829
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	321.728	321.778	4397801
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	331.616	331.669	4397724
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	331.731	331.703	4397703
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	337.473	337.469	4397837
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	345.421	345.52	4397722
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	359.041	359.011	4397697
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	411.793	411.778	4397663
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	424.211	424.321	4397730
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	556.498	556.452	4397827
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	571.597	571.573	4397744
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	630.952	630.94	4397702
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	727.61	727.546	4397699
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	855.161	855.054	4397803
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	989.861	989.775	4397685
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	1155.48	1155.42	4397804
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	1189.27	1189.24	4397802
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1274.73	1274.71	4397717
Tal/ Tal-03_c18.xml	OPT	96	1319.04	1319.25	4397729
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	1498.86	1498.77	4397711
GolombRuler/ GolombRuler-a3v18-11_c18.xml	OPT	72	1779.59	1779.68	4397910
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	1909.34	1909.16	4397720
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1934.01	1933.98	4397676

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	SAT (TO)	-6986	2400.01	2399.7	4397680
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	1209	2400.01	2399.9	4397883
Opd/Opd-sum-small/ Opd-11-011-005.xml	SAT (TO)	3	2400.01	2400.2	4397700
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	816	2400.01	2399.8	4397879
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	113	2400.01	2399.8	4397918
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	387	2400.02	2400.01	4397705
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	SAT (TO)	125	2400.02	2400.11	4397763
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2400.02	2399.8	4397776
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	SAT (TO)	-15984	2400.02	2400.2	4397690
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	SAT (TO)	-24000	2400.02	2400.01	4397816
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1695417	2400.02	2399.8	4397882
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2400.02	2400.11	4397778
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	276	2400.02	2400.11	4397877
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	SAT (TO)	-25000	2400.02	2400.3	4397812
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	96	2400.02	2400.01	4397867
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	11	2400.02	2399.8	4397738
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.02	2400.01	4397840
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	398	2400.02	2399.8	4397868
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	59555	2400.02	2399.7	4397902
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2400.02	2400.01	4397906
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.02	2399.9	4397881
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2400.02	2400.2	4397806
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	578394884	2400.02	2399.81	4397712
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	SAT (TO)	-25000	2400.03	2399.8	4397669
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	SAT (TO)	-24000	2400.03	2399.8	4397817
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	SAT (TO)	-24000	2400.03	2400.11	4397814
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	2400.03	2399.9	4397866
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	4	2400.03	2399.8	4397878
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	SAT (TO)	4	2400.03	2400.8	4397695
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2400.03	2400.2	4397671
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	348	2400.03	2400.01	4397706
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	40	2400.03	2400.01	4397779
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	SAT (TO)	8	2400.03	2400.01	4397649
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	SAT (TO)	48	2400.03	2400	4397757
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	SAT (TO)	6	2400.03	2400.01	4397852
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.03	2400.01	4397872
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	SAT (TO)	47	2400.03	2400.21	4397740
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	17	2400.04	2400.11	4397857
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2400.04	2400.11	4397833
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	SAT (TO)	-24000	2400.04	2400.2	4397813
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	66	2400.04	2399.7	4397854
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2400.04	2400.2	4397777
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2400.04	2400.01	4397807
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2400.04	2400.4	4397678
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	SAT (TO)	-24000	2400.04	2400.01	4397659
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	231	2400.04	2400.01	4397876
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.04	2400.11	4397863
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	SAT (TO)	-25000	2400.04	2400.11	4397811
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	41	2400.04	2399.8	4397783
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2400.05	2399.9	4397917
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	SAT (TO)	139	2400.05	2399.9	4397754
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1300	2400.05	2399.8	4397874
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	SAT (TO)	1	2400.05	2399.8	4397766
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	206	2400.05	2400.3	4397901
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	349	2400.05	2400.4	4397723
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1845	2400.05	2400.2	4397849
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	SAT (TO)	-24000	2400.05	2400.01	4397815
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	40	2400.05	2399.8	4397784
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	9	2400.05	2400.01	4397821
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	58361	2400.05	2399.9	4397900
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2400.05	2400.01	4397775
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	SAT (TO)	8	2400.05	2400.01	4397635
PizzaVoucher/ PizzaVoucher-12a_c18.xml	SAT (TO)	40	2400.06	2400.2	4397718
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2400.06	2400.4	4397836
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	137	2400.06	2400.3	4397920
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	202	2400.06	2399.9	4397909
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	181624473	2400.06	2400.3	4397653
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1495	2400.06	2400.4	4397893
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	SAT (TO)	47	2400.06	2400.41	4397721
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	SAT (TO)	3078	2400.06	2400.01	4397654
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	75	2400.06	2399.8	4397921
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	317	2400.06	2400.11	4397726
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1876	2400.06	2400.11	4397905
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2400.06	2400.2	4397782
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	967	2400.07	2399.8	4397862
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	20	2400.07	2400.11	4397908
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2400.07	2400.6	4397919
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	SAT (TO)	13	2400.07	2400.3	4397823
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	SAT (TO)	276	2400.07	2400.3	4397648
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	SAT (TO)	450	2400.07	2399.8	4397692
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	11	2400.07	2399.9	4397714
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	321	2400.07	2400.4	4397687
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	SAT (TO)	0	2400.08	2399.8	4397855
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	229229905	2400.08	2399.9	4397682
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	SAT (TO)	1015	2400.08	2399.9	4397655
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT (TO)	529692396	2400.08	2400.52	4397847
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	SAT (TO)	4	2400.08	2400.5	4397688
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2400.08	2400.4	4397701
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	11182902	2400.08	2400.3	4397871
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	SAT (TO)	-25000	2400.08	2399.9	4397810
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	6	2400.08	2399.9	4397820
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1131	2400.09	2400.31	4397916
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	6	2400.09	2400.2	4397824
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31710	2400.09	2399.9	4397897
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	996	2400.09	2400.01	4397912
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	221	2400.09	2400.01	4397873
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	312	2400.09	2400.2	4397674
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	2400.09	2400.8	4397781
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	374253920	2400.09	2400.61	4397734
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1967	2400.09	2399.9	4397891
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	SAT (TO)	13	2400.09	2399.8	4397819
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	SAT (TO)	-24000	2400.1	2399.9	4397657
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	498	2400.1	2400.2	4397838
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	SAT (TO)	-28000	2400.1	2400.3	4397809
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	338	2400.1	2400.11	4397684
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2400.1	2400.11	4397780
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	SAT (TO)	-19000	2400.11	2399.9	4397818

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	? (NS)	0.026549	0.026844	4397797
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	? (NS)	0.026599	0.026929	4397798
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	? (NS)	0.026774	0.0271929	4397796
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	? (NS)	0.030298	0.0306299	4397794
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	? (NS)	0.030935	0.0312979	4397795
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	? (NS)	0.047473	0.04774	4397791
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	? (NS)	0.047899	0.0482661	4397790
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	? (NS)	0.047959	0.048301	4397793
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	? (NS)	0.04891	0.049177	4397792
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	? (NS)	0.05447	0.054706	4397787
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	? (NS)	0.054813	0.0565749	4397788
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	? (NS)	0.055204	0.0556391	4397789
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	? (NS)	0.058133	0.0584849	4397786
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	? (NS)	0.104193	0.109829	4397799
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	? (NS)	0.104423	0.108578	4397800

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	? (TO)	2400.01	2399.9	4397785
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.01	2399.8	4397861
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.01	2399.81	4397914
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	? (TO)	2400.02	2400.01	4397839
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.02	2399.8	4397904
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	? (TO)	2400.02	2400.2	4397892
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	? (TO)	2400.02	2399.8	4397822
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	? (TO)	2400.02	2400.2	4397844
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	? (TO)	2400.03	2400.2	4397843
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.03	2399.9	4397864
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	? (TO)	2400.03	2400.11	4397915
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.03	2400.01	4397848
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.04	2400.2	4397859
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	? (TO)	2400.04	2400.3	4397835
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.04	2400.11	4397850
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.05	2399.8	4397841
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	? (TO)	2400.05	2399.8	4397661
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.05	2399.8	4397913
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.05	2400.01	4397899
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2400.05	2399.81	4397845
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	? (TO)	2400.06	2400.2	4397842
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.09	2399.9	4397853
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2400.09	2399.9	4397911
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.09	2400.11	4397858
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.09	2399.9	4397856
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	? (TO)	2400.1	2400.11	4397808
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.11	2400.3	4397860
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2400.11	2400.4	4397907

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	? (MO)	284.749	286.52	4397755
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	? (MO)	288.828	290.501	4397903
Tal/ Tal-05_c18.xml	? (MO)	546.518	548.357	4397774
Opd/Opd-sum-small/ Opd-19-020-009.xml	? (MO)	1114.63	1116.68	4397884
Opd/Opd-sum-small/ Opd-15-015-004.xml	? (MO)	1157.92	1159.78	4397708
Opd/Opd-sum-small/ Opd-10-015-006.xml	? (MO)	1181.68	1183.84	4397694
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (MO)	1269	1271.18	4397773
Opd/Opd-sum-small/ Opd-10-030-009.xml	? (MO)	1290.67	1292.45	4397826
Opd/Opd-sum-small/ Opd-10-031-009.xml	? (MO)	1298.14	1300.26	4397825
Opd/Opd-sum-small/ Opd-10-032-009.xml	? (MO)	1369.92	1371.86	4397662
Opd/Opd-sum-small/ Opd-09-024-008.xml	? (MO)	1377.72	1379.66	4397756
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	? (MO)	1508.56	1510.45	4397887
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	? (MO)	1508.89	1511.12	4397865
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	? (MO)	1515.35	1517.36	4397894
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	? (MO)	1515.96	1517.79	4397885
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	? (MO)	1517.22	1519.1	4397889
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	? (MO)	1518.02	1520.29	4397869
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	? (MO)	1518.73	1520.34	4397896
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	? (MO)	1519.68	1521.66	4397870
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	? (MO)	1520.63	1522.56	4397875
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	? (MO)	1520.94	1523.35	4397880
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	? (MO)	1523.26	1524.7	4397886
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	? (MO)	1525.69	1527.84	4397895
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	? (MO)	1526.61	1528.46	4397890
Opd/Opd-sum-large/ Opd-15-035-010.xml	? (MO)	1529.8	1532.05	4397713
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	? (MO)	1535.1	1536.83	4397846
Opd/Opd-sum-large/ Opd-16-035-010.xml	? (MO)	1540.83	1543.02	4397689
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	? (MO)	1564.35	1566.45	4397888
Opd/Opd-sum-small/ Opd-10-037-014.xml	? (MO)	1635.45	1637.44	4397707
Opd/Opd-sum-small/ Opd-10-038-010.xml	? (MO)	1705.02	1707.15	4397737
Opd/Opd-sum-large/ Opd-03-350-100.xml	? (MO)	2052.54	2054.76	4397751
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (MO)	2083.27	2085.22	4397898
Opd/Opd-sum-large/ Opd-04-350-100.xml	? (MO)	2103.88	2105.72	4397771

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver cosoco 2.0 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (116 runs) [Show/Hide]

Solver timed out but found at least a solution (107 runs) [Show/Hide]

Solver does not handle one of the constraint (15 runs) [Show/Hide]

Solver timed out (no solution given) (28 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (33 runs) [Show/Hide]