2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Auction/Auction-sum/ Auction-sum-example_c18.xml	OPT	54	1.51361	1.02326	4291711
Auction/Auction-cnt/ Auction-cnt-example_c18.xml	OPT	54	1.52514	1.02448	4291751
PseudoBoolean-opt/ Pb-garden-4x4_c18.xml	OPT	4	1.62522	1.07587	4291565
TemplateDesign/ TemplateDesign-m2-1_c18.xml	OPT	2	1.68186	1.12002	4291649
TemplateDesign/ TemplateDesign-m1-1_c18.xml	OPT	2	1.70332	1.12932	4291639
SumColoring/ SumColoring-myciel3_c18.xml	OPT	10	1.79232	1.12458	4291663
TemplateDesign/ TemplateDesign-m1-2_c18.xml	OPT	2	1.93945	1.20771	4291640
TemplateDesign/ TemplateDesign-m1s-1_c18.xml	OPT	2	1.94238	1.22534	4291644
TemplateDesign/ TemplateDesign-m2-2_c18.xml	OPT	2	1.95714	1.20821	4291650
GolombRuler/ GolombRuler-a3v18-07_c18.xml	OPT	25	1.96733	1.20014	4291520
SteelMillSlab/ SteelMillSlab-m1-simple_c18.xml	OPT	0	2.04328	1.26495	4291617
GraphColoring/ GraphColoring-queen5-5_c18.xml	OPT	4	2.07084	1.2225	4291466
Bacp/Bacp-m1/ Bacp-m1-05_c18.xml	OPT	9	2.14929	1.29144	4292176
Tal/ Tal-01_c18.xml	OPT	6	2.23215	1.31024	4291629
TemplateDesign/ TemplateDesign-m1s-2_c18.xml	OPT	2	2.23473	1.32844	4291645
Knapsack/ Knapsack-30-100-00_c18.xml	OPT	709	2.27247	1.27603	4291442
Bacp/Bacp-m2/ Bacp-m2-05_c18.xml	OPT	9	2.30493	1.36033	4292116
Rcpsp/ Rcpsp-j30-01-03_c18.xml	OPT	47	2.32157	1.66107	4291539
Knapsack/ Knapsack-30-100-01_c18.xml	OPT	871	2.32854	1.29787	4291443
Rcpsp/ Rcpsp-j30-01-04_c18.xml	OPT	62	2.33656	1.35888	4291540
Rcpsp/ Rcpsp-j30-01-01_c18.xml	OPT	43	2.35195	1.35366	4291537
Mario/ Mario-easy-2_c18.xml	OPT	628	2.40155	1.36418	4291668
Rcpsp/ Rcpsp-j30-01-02_c18.xml	OPT	47	2.42938	1.38555	4291538
GolombRuler/ GolombRuler-a3v18-08_c18.xml	OPT	34	2.45414	1.38217	4291521
PeacableArmies/ PeacableArmies-m1-05_c18.xml	OPT	4	2.55833	1.39811	4291480
Mario/ Mario-easy-5_c18.xml	OPT	445	2.59126	1.4093	4291670
SteelMillSlab/ SteelMillSlab-m2-simple_c18.xml	OPT	0	2.64973	1.44843	4291628
TemplateDesign/ TemplateDesign-m1s-catfood_c18.xml	OPT	2	2.66454	1.45088	4291646
CrosswordDesign/ CrosswordDesign-03-4-rom_c18.xml	OPT	12	2.67485	1.31965	4291467
TravelingTournament/ TravelingTournament-a2-galaxy04_c18.xml	OPT	517	2.82738	1.57015	4291494
Mario/ Mario-easy-4_c18.xml	OPT	545	2.8731	1.51076	4291669
TravelingTournament/ TravelingTournament-a3-galaxy04_c18.xml	OPT	416	3.00096	1.64913	4291501
TravellingSalesman/ TravellingSalesman-10-20-00_c18.xml	OPT	47	3.35492	1.785	4291509
QuadraticAssignment/ QuadraticAssignment-qap_c18.xml	OPT	4776	3.37614	1.77993	4291583
Rcpsp/ Rcpsp-j60-01-03_c18.xml	OPT	68	3.67057	1.78523	4291543
Rcpsp/ Rcpsp-j60-01-04_c18.xml	OPT	91	3.68971	1.79028	4291544
Rcpsp/ Rcpsp-j60-01-01_c18.xml	OPT	77	3.8343	1.83242	4291541
Fapp/Fapp-m2s/ Fapp-m2s-ex2_c18.xml	OPT	13871	3.88047	1.73223	4292061
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	4.02932	2.2374	4291522
Rcpsp/ Rcpsp-j60-01-02_c18.xml	OPT	68	4.04079	1.9195	4291542
Mario/ Mario-t-hard-5_c18.xml	OPT	4482	4.04727	1.93129	4291677
Knapsack/ Knapsack-40-150-01_c18.xml	OPT	1128	4.13779	3.39747	4291445
CrosswordDesign/ CrosswordDesign-04-4-rom_c18.xml	OPT	24	4.3211	2.01352	4291468
PseudoBoolean-opt/ Pb-circ4-3_c18.xml	OPT	20	4.41591	2.42954	4291560
Mario/ Mario-t-hard-1_c18.xml	OPT	4783	4.61057	1.97158	4291675
LowAutocorrelation/ LowAutocorrelation-015_c18.xml	OPT	15	4.87383	2.16387	4291678
Rcpsp/ Rcpsp-j90-01-02_c18.xml	OPT	92	5.09088	2.2475	4291546
Rcpsp/ Rcpsp-j90-01-03_c18.xml	OPT	66	5.33208	2.4181	4291547
TemplateDesign/ TemplateDesign-m2-catfood_c18.xml	OPT	2	5.92359	4.29186	4291651
Knapsack/ Knapsack-40-150-00_c18.xml	OPT	932	6.54761	5.29304	4291444
Rcpsp/ Rcpsp-j90-01-01_c18.xml	OPT	73	6.71622	3.37865	4291545
Rlfap/Rlfap-opt/ Rlfap-scen-04-opt_c18.xml	OPT	46	7.14916	2.70946	4291946
Rcpsp/ Rcpsp-j90-01-04_c18.xml	OPT	86	7.28262	3.20561	4291548
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	7.77147	5.6249	4291523
Mario/ Mario-t-hard-2_c18.xml	OPT	4850	8.45994	4.85789	4291676
SumColoring/ SumColoring-myciel4_c18.xml	OPT	22	10.5548	8.38769	4291664
Rlfap/Rlfap-opt/ Rlfap-scen-05-opt_c18.xml	OPT	792	12.1384	6.53718	4291871
TemplateDesign/ TemplateDesign-m1-catfood_c18.xml	OPT	2	13.2894	10.8208	4291641
NurseRostering/ NurseRostering-00_c18.xml	OPT	1202	15.139	10.9304	4291591
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	48.2418	44.7642	4291592
GraphColoring/ GraphColoring-4-fullins-4_c18.xml	OPT	7	54.43	47.3047	4291458
SumColoring/ SumColoring-1-fullins-3_c18.xml	OPT	24	94.9949	92.3245	4291654
Knapsack/ Knapsack-60-250-01_c18.xml	OPT	1323	135.152	133.766	4291449

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
TemplateDesign/ TemplateDesign-m1s-herbs_c18.xml	SAT	2	487.903	471.94	4291647

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Auction/Auction-cnt/ Auction-cnt-decay100_c18.xml	SAT (TO)	809405	2400.03	2337.82	4291756
GolombRuler/ GolombRuler-a3v18-14_c18.xml	SAT (TO)	142	2400.03	2359.42	4291527
Bacp/Bacp-m2/ Bacp-m2-06_c18.xml	SAT (TO)	10	2400.03	2346.72	4292091
PseudoBoolean-opt/ Pb-radar-10-10-45-050-100_c18.xml	SAT (TO)	4	2400.03	2352.52	4291568
QuadraticAssignment/ QuadraticAssignment-esc32d_c18.xml	SAT (TO)	100	2400.03	2352.52	4291576
LowAutocorrelation/ LowAutocorrelation-020_c18.xml	SAT (TO)	26	2400.03	2337.82	4291679
Rlfap/Rlfap-opt/ Rlfap-graph-03-opt_c18.xml	SAT (TO)	736	2400.03	2344.82	4291911
Bacp/Bacp-m2/ Bacp-m2-10b_c18.xml	SAT (TO)	14	2400.03	2351.02	4292076
TravellingSalesman/ TravellingSalesman-20-30-00_c18.xml	SAT (TO)	113	2400.03	2356.02	4291512
TravellingSalesman/ TravellingSalesman-35-30-00_c18.xml	SAT (TO)	164	2400.03	2348.14	4291515
Bacp/Bacp-m1/ Bacp-m1-07b_c18.xml	SAT (TO)	13	2400.03	2349.72	4292181
SumColoring/ SumColoring-dsjc-250-9_c18.xml	SAT (TO)	10073	2400.03	2352.03	4291662
Rcpsp/ Rcpsp-j120-01-01_c18.xml	SAT (TO)	108	2400.03	2332.53	4291533
PeacableArmies/ PeacableArmies-m2-10_c18.xml	SAT (TO)	9	2400.03	2357.42	4291489
Bacp/Bacp-m2/ Bacp-m2-07b_c18.xml	SAT (TO)	13	2400.03	2350.12	4292111
Knapsack/ Knapsack-90-400-00_c18.xml	SAT (TO)	1551	2400.03	2356.71	4291454
Auction/Auction-sum/ Auction-sum-decay200_c18.xml	SAT (TO)	1440749	2400.03	2337.22	4291706
GolombRuler/ GolombRuler-a3v18-15_c18.xml	SAT (TO)	187	2400.04	2361.72	4291528
QuadraticAssignment/ QuadraticAssignment-esc128_c18.xml	SAT (TO)	32	2400.04	2346.03	4291572
NurseRostering/ NurseRostering-02_c18.xml	SAT (TO)	1223	2400.04	2345.81	4291593
StillLife/ StillLife-wastage-10_c18.xml	SAT (TO)	54	2400.04	2356.61	4291431
Auction/Auction-cnt/ Auction-cnt-decay200_c18.xml	SAT (TO)	1402863	2400.04	2340.02	4291761
QuadraticAssignment/ QuadraticAssignment-esc64a_c18.xml	SAT (TO)	58	2400.04	2352.03	4291577
NurseRostering/ NurseRostering-04_c18.xml	SAT (TO)	2130	2400.04	2347.21	4291595
TravellingSalesman/ TravellingSalesman-15-30-00_c18.xml	SAT (TO)	93	2400.05	2354.31	4291511
Bacp/Bacp-m1/ Bacp-m1-07a_c18.xml	SAT (TO)	12	2400.05	2348.32	4292161
Knapsack/ Knapsack-80-350-01_c18.xml	SAT (TO)	1668	2400.05	2360.23	4291453
Knapsack/ Knapsack-70-300-01_c18.xml	SAT (TO)	1465	2400.05	2353.92	4291451
LowAutocorrelation/ LowAutocorrelation-050_c18.xml	SAT (TO)	753	2400.05	2362.13	4291691
LowAutocorrelation/ LowAutocorrelation-027_c18.xml	SAT (TO)	77	2400.05	2331.42	4291686
StillLife/ StillLife-wastage-15_c18.xml	SAT (TO)	107	2400.05	2360.92	4291436
Rcpsp/ Rcpsp-j120-01-04_c18.xml	SAT (TO)	97	2400.05	2355.82	4291536
Rlfap/Rlfap-opt/ Rlfap-scen-06-opt_c18.xml	SAT (TO)	21768	2400.05	2337.92	4291956
LowAutocorrelation/ LowAutocorrelation-023_c18.xml	SAT (TO)	47	2400.05	2336.53	4291682
SumColoring/ SumColoring-myciel7_c18.xml	SAT (TO)	215	2400.05	2343.02	4291667
StillLife/ StillLife-wastage-08_c18.xml	SAT (TO)	36	2400.05	2363.33	4291429
Auction/Auction-cnt/ Auction-cnt-matching040_c18.xml	SAT (TO)	12882352	2400.06	2343.83	4291791
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	36368	2400.06	2335.73	4291936
Rlfap/Rlfap-opt/ Rlfap-scen-10-opt_c18.xml	SAT (TO)	6695055	2400.06	2347.94	4291926
LowAutocorrelation/ LowAutocorrelation-022_c18.xml	SAT (TO)	39	2400.06	2335.04	4291681
Bacp/Bacp-m1/ Bacp-m1-08a_c18.xml	SAT (TO)	17	2400.06	2346.22	4292151
PeacableArmies/ PeacableArmies-m1-20_c18.xml	SAT (TO)	46	2400.06	2328.14	4291484
GraphColoring/ GraphColoring-2-fullins-5_c18.xml	SAT (TO)	6	2400.06	2364.64	4291456
Bacp/Bacp-m2/ Bacp-m2-08b_c18.xml	SAT (TO)	17	2400.06	2350.41	4292121
Rcpsp/ Rcpsp-j120-01-02_c18.xml	SAT (TO)	109	2400.06	2349.42	4291534
SumColoring/ SumColoring-dsjc-125-5_c18.xml	SAT (TO)	1046	2400.06	2344.62	4291658
Auction/Auction-sum/ Auction-sum-matching080_c18.xml	SAT (TO)	46810432	2400.06	2334.93	4291701
TravellingSalesman/ TravellingSalesman-150-50-00_c18.xml	SAT (TO)	742	2400.06	2366.62	4291510
LowAutocorrelation/ LowAutocorrelation-040_c18.xml	SAT (TO)	216	2400.06	2333.04	4291690
QuadraticAssignment/ QuadraticAssignment-sko56_c18.xml	SAT (TO)	18159	2400.06	2375.44	4291586
SumColoring/ SumColoring-1-fullins-5_c18.xml	SAT (TO)	241	2400.06	2354.72	4291656
PeacableArmies/ PeacableArmies-m2-20_c18.xml	SAT (TO)	28	2400.06	2344.62	4291491
GolombRuler/ GolombRuler-a3v18-16_c18.xml	SAT (TO)	221	2400.06	2361.73	4291529
LowAutocorrelation/ LowAutocorrelation-028_c18.xml	SAT (TO)	74	2400.06	2343.52	4291687
LowAutocorrelation/ LowAutocorrelation-035_c18.xml	SAT (TO)	241	2400.07	2350.31	4291689
NurseRostering/ NurseRostering-05_c18.xml	SAT (TO)	2466	2400.07	2341.21	4291596
LowAutocorrelation/ LowAutocorrelation-024_c18.xml	SAT (TO)	44	2400.07	2334.52	4291683
PeacableArmies/ PeacableArmies-m2-05_c18.xml	SAT (TO)	4	2400.07	2352.42	4291487
PeacableArmies/ PeacableArmies-m2-30_c18.xml	SAT (TO)	17	2400.07	2345.22	4291492
Bacp/Bacp-m2/ Bacp-m2-12a-nodv_c18.xml	SAT (TO)	17	2400.07	2356.42	4292096
Mario/ Mario-n-medium-2_c18.xml	SAT (TO)	886	2400.07	2376.52	4291671
TravellingSalesman/ TravellingSalesman-30-30-00_c18.xml	SAT (TO)	145	2400.07	2342.02	4291514
StillLife/ StillLife-wastage-19_c18.xml	SAT (TO)	159	2400.07	2354.92	4291438
Mario/ Mario-n-medium-3_c18.xml	SAT (TO)	943	2400.07	2367.02	4291672
StillLife/ StillLife-wastage-21_c18.xml	SAT (TO)	197	2400.07	2352.53	4291439
GraphColoring/ GraphColoring-qg-order40_c18.xml	SAT (TO)	143	2400.07	2312.16	4291464
QuadraticAssignment/ QuadraticAssignment-sko42_c18.xml	SAT (TO)	8120	2400.07	2344.93	4291584
PseudoBoolean-opt/ Pb-garden-9x9_c18.xml	SAT (TO)	21	2400.07	2347.12	4291567
PizzaVoucher/ PizzaVoucher-10b_c18.xml	SAT (TO)	28	2400.07	2335.23	4291550
SumColoring/ SumColoring-myciel5_c18.xml	SAT (TO)	46	2400.07	2339.12	4291665
Knapsack/ Knapsack-60-250-00_c18.xml	SAT (TO)	1404	2400.07	2347.81	4291448
Knapsack/ Knapsack-90-400-01_c18.xml	SAT (TO)	1681	2400.07	2340.81	4291455
Knapsack/ Knapsack-80-350-00_c18.xml	SAT (TO)	1564	2400.07	2348.53	4291452
Bacp/Bacp-m1/ Bacp-m1-10a-nodv_c18.xml	SAT (TO)	14	2400.07	2344.41	4292136
PeacableArmies/ PeacableArmies-m2-50_c18.xml	SAT (TO)	41	2400.08	2358.34	4291493
StillLife/ StillLife-wastage-13_c18.xml	SAT (TO)	71	2400.08	2365.82	4291434
QuadraticAssignment/ QuadraticAssignment-had20_c18.xml	SAT (TO)	3525	2400.08	2353.31	4291582
TravelingTournament/ TravelingTournament-a3-galaxy12_c18.xml	SAT (TO)	10154	2400.08	2359.62	4291505
GraphColoring/ GraphColoring-5-fullins-3_c18.xml	SAT (TO)	7	2400.08	2347.22	4291460
TemplateDesign/ TemplateDesign-m1s-magazine_c18.xml	SAT (TO)	6	2400.08	2345.92	4291648
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	122	2400.08	2355.22	4291526
Bacp/Bacp-m1/ Bacp-m1-12a-nodv_c18.xml	SAT (TO)	17	2400.08	2347.71	4292146
Fapp/Fapp-m2s/ Fapp-m2s-test01-0150_c18.xml	SAT (TO)	50606891	2400.08	2335.35	4291981
TravellingSalesman/ TravellingSalesman-50-30-00_c18.xml	SAT (TO)	198	2400.08	2342.71	4291518
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	SAT (TO)	45	2400.08	2357.42	4291530
TravellingSalesman/ TravellingSalesman-75-50-00_c18.xml	SAT (TO)	436	2400.08	2338.82	4291519
TravelingTournament/ TravelingTournament-a3-galaxy14_c18.xml	SAT (TO)	16327	2400.08	2356.34	4291506
QuadraticAssignment/ QuadraticAssignment-esc16d_c18.xml	SAT (TO)	8	2400.08	2355.03	4291574
StillLife/ StillLife-wastage-25_c18.xml	SAT (TO)	231	2400.08	2352.82	4291440
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	382326506	2400.08	2247.86	4292031
QuadraticAssignment/ QuadraticAssignment-had16_c18.xml	SAT (TO)	1885	2400.08	2348.92	4291580
QuadraticAssignment/ QuadraticAssignment-sko49_c18.xml	SAT (TO)	11955	2400.08	2349.22	4291585
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	SAT (TO)	74	2400.08	2389.21	4291531
SumColoring/ SumColoring-dsjc-250-5_c18.xml	SAT (TO)	3662	2400.08	2349.22	4291661
Bacp/Bacp-m1/ Bacp-m1-12b_c18.xml	SAT (TO)	17	2400.08	2347.21	4292131
Knapsack/ Knapsack-50-200-01_c18.xml	SAT (TO)	1297	2400.09	2356.42	4291447
LowAutocorrelation/ LowAutocorrelation-030_c18.xml	SAT (TO)	83	2400.09	2349.81	4291688
GolombRuler/ GolombRuler-a3v18-12_c18.xml	SAT (TO)	97	2400.09	2357.13	4291525
PseudoBoolean-opt/ Pb-circ6-3_c18.xml	SAT (TO)	72	2400.09	2335.14	4291561
Rcpsp/ Rcpsp-j120-01-03_c18.xml	SAT (TO)	128	2400.09	2348.62	4291535
PizzaVoucher/ PizzaVoucher-10a_c18.xml	SAT (TO)	210	2400.09	2364.92	4291549
PseudoBoolean-opt/ Pb-garden-7x7_c18.xml	SAT (TO)	13	2400.09	2302.83	4291566
Bacp/Bacp-m2/ Bacp-m2-10a_c18.xml	SAT (TO)	14	2400.09	2352.82	4292086
TravellingSalesman/ TravellingSalesman-45-30-00_c18.xml	SAT (TO)	176	2400.09	2348.82	4291517
Auction/Auction-cnt/ Auction-cnt-decay300_c18.xml	SAT (TO)	2015882	2400.09	2333.14	4291746
Bacp/Bacp-m1/ Bacp-m1-08b_c18.xml	SAT (TO)	17	2400.09	2349.43	4292171
Auction/Auction-sum/ Auction-sum-decay500_c18.xml	SAT (TO)	3048435	2400.09	2335.62	4291736
Rlfap/Rlfap-opt/ Rlfap-graph-06-opt_c18.xml	SAT (TO)	112921	2400.09	2340.94	4291886
Fapp/Fapp-m2s/ Fapp-m2s-04-0300_c18.xml	SAT (TO)	276102473	2400.09	2253.16	4291991
SumColoring/ SumColoring-dsjc-125-9_c18.xml	SAT (TO)	2583	2400.09	2343.42	4291659
QuadraticAssignment/ QuadraticAssignment-had12_c18.xml	SAT (TO)	826	2400.09	2347.83	4291578
PeacableArmies/ PeacableArmies-m2-15_c18.xml	SAT (TO)	13	2400.09	2357.12	4291490
TravellingSalesman/ TravellingSalesman-40-30-00_c18.xml	SAT (TO)	170	2400.09	2360.02	4291516
Fapp/Fapp-m2s/ Fapp-m2s-01-0200_c18.xml	SAT (TO)	99265427	2400.09	2339.05	4292046
PeacableArmies/ PeacableArmies-m2-07_c18.xml	SAT (TO)	7	2400.1	2353.73	4291488
LowAutocorrelation/ LowAutocorrelation-021_c18.xml	SAT (TO)	26	2400.1	2348.81	4291680
TravelingTournament/ TravelingTournament-a3-galaxy06_c18.xml	SAT (TO)	1463	2400.1	2360.02	4291502
StillLife/ StillLife-wastage-11_c18.xml	SAT (TO)	56	2400.1	2347.92	4291432
SumColoring/ SumColoring-dsjc-250-1_c18.xml	SAT (TO)	848	2400.1	2343.42	4291660
PseudoBoolean-opt/ Pb-radar-10-20-45-050-100_c18.xml	SAT (TO)	5	2400.1	2334.23	4291569
Knapsack/ Knapsack-70-300-00_c18.xml	SAT (TO)	1425	2400.1	2359.72	4291450
SumColoring/ SumColoring-dsjc-125-1_c18.xml	SAT (TO)	215	2400.1	2341.83	4291657
QuadraticAssignment/ QuadraticAssignment-had14_c18.xml	SAT (TO)	1372	2400.1	2347.52	4291579
QuadraticAssignment/ QuadraticAssignment-esc32a_c18.xml	SAT (TO)	76	2400.1	2340.91	4291575
TravelingTournament/ TravelingTournament-a2-galaxy10_c18.xml	SAT (TO)	6636	2400.1	2365.82	4291497
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12959841	2400.1	2339.24	4291726
LowAutocorrelation/ LowAutocorrelation-025_c18.xml	SAT (TO)	36	2400.1	2353.71	4291684
Auction/Auction-cnt/ Auction-cnt-decay400_c18.xml	SAT (TO)	2493564	2400.1	2329.52	4291771
Auction/Auction-cnt/ Auction-cnt-decay500_c18.xml	SAT (TO)	2941882	2400.1	2338.84	4291776
Knapsack/ Knapsack-50-200-00_c18.xml	SAT (TO)	960	2400.1	2366.71	4291446
PeacableArmies/ PeacableArmies-m1-10_c18.xml	SAT (TO)	13	2400.1	2337.81	4291482
SumColoring/ SumColoring-1-fullins-4_c18.xml	SAT (TO)	91	2400.11	2335.02	4291655
Bacp/Bacp-m1/ Bacp-m1-10a_c18.xml	SAT (TO)	14	2400.11	2348.91	4292141
Bacp/Bacp-m2/ Bacp-m2-10a-nodv_c18.xml	SAT (TO)	14	2400.11	2354.13	4292126
GraphColoring/ GraphColoring-5-fullins-4_c18.xml	SAT (TO)	8	2400.11	2325.93	4291461
GraphColoring/ GraphColoring-3-fullins-5_c18.xml	SAT (TO)	1142	2400.11	2259.24	4291457
PeacableArmies/ PeacableArmies-m1-07_c18.xml	SAT (TO)	7	2400.11	2356.31	4291481
TravellingSalesman/ TravellingSalesman-100-50-00_c18.xml	SAT (TO)	574	2400.11	2358.23	4291508
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	2005187	2400.11	2334.42	4291741
StillLife/ StillLife-wastage-17_c18.xml	SAT (TO)	123	2400.11	2334.04	4291437
StillLife/ StillLife-wastage-30_c18.xml	SAT (TO)	365	2400.11	2356.23	4291441
Fapp/Fapp-m2s/ Fapp-m2s-ex1_c18.xml	SAT (TO)	523	2400.11	2354.22	4291986
PseudoBoolean-opt/ Pb-garden-15x15_c18.xml	SAT (TO)	58	2400.11	2334.32	4291564
Bacp/Bacp-m1/ Bacp-m1-10b_c18.xml	SAT (TO)	14	2400.11	2348.32	4292156
Bacp/Bacp-m2/ Bacp-m2-07a_c18.xml	SAT (TO)	12	2400.11	2349.62	4292106
SumColoring/ SumColoring-myciel6_c18.xml	SAT (TO)	112	2400.11	2339.73	4291666
LowAutocorrelation/ LowAutocorrelation-026_c18.xml	SAT (TO)	53	2400.12	2332.41	4291685
GolombRuler/ GolombRuler-a3v18-nodv-11_c18.xml	SAT (TO)	79	2400.12	2365.81	4291532
QuadraticAssignment/ QuadraticAssignment-sko90_c18.xml	SAT (TO)	62835	2400.12	2344.36	4291590
CrosswordDesign/ CrosswordDesign-05-4-rom_c18.xml	SAT (TO)	38	2400.12	2392.33	4291469
Rlfap/Rlfap-opt/ Rlfap-graph-07-opt_c18.xml	SAT (TO)	101845	2400.12	2334.16	4291881
PeacableArmies/ PeacableArmies-m1-30_c18.xml	SAT (TO)	99	2400.12	2366.55	4291485
Mario/ Mario-n-medium-4_c18.xml	SAT (TO)	832	2400.12	2352.52	4291673
TravelingTournament/ TravelingTournament-a2-galaxy08_c18.xml	SAT (TO)	3242	2400.12	2363.14	4291496
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	76	2400.12	2353.92	4291524
PeacableArmies/ PeacableArmies-m1-15_c18.xml	SAT (TO)	28	2400.12	2354.13	4291483
QuadraticAssignment/ QuadraticAssignment-had18_c18.xml	SAT (TO)	2679	2400.12	2348.53	4291581
TravelingTournament/ TravelingTournament-a2-galaxy12_c18.xml	SAT (TO)	10787	2400.12	2350.22	4291498
PseudoBoolean-opt/ Pb-radar-30-30-45-050-100_c18.xml	SAT (TO)	63	2400.12	2355.95	4291570
TravelingTournament/ TravelingTournament-a2-galaxy06_c18.xml	SAT (TO)	1593	2400.12	2350.81	4291495
Fapp/Fapp-m2s/ Fapp-m2s-06-0500_c18.xml	SAT (TO)	1061881838	2400.12	1955.28	4292016
Mario/ Mario-n-medium-5_c18.xml	SAT (TO)	762	2400.12	2341.61	4291674
Bacp/Bacp-m2/ Bacp-m2-08a_c18.xml	SAT (TO)	17	2400.12	2349.62	4292071
NurseRostering/ NurseRostering-03_c18.xml	SAT (TO)	1303	2400.12	2354.81	4291594
StillLife/ StillLife-wastage-12_c18.xml	SAT (TO)	73	2400.12	2360.82	4291433
TravelingTournament/ TravelingTournament-a3-galaxy08_c18.xml	SAT (TO)	3131	2400.12	2363.63	4291503
Auction/Auction-sum/ Auction-sum-decay100_c18.xml	SAT (TO)	783852	2400.12	2337.93	4291696
QuadraticAssignment/ QuadraticAssignment-esc16a_c18.xml	SAT (TO)	35	2400.12	2361.82	4291573
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2400.12	2347.82	4292101
Bacp/Bacp-m1/ Bacp-m1-06_c18.xml	SAT (TO)	10	2400.12	2346.62	4292186
Auction/Auction-sum/ Auction-sum-decay400_c18.xml	SAT (TO)	2482439	2400.12	2331.14	4291731
StillLife/ StillLife-wastage-09_c18.xml	SAT (TO)	42	2400.12	2361.02	4291430
Fapp/Fapp-m2s/ Fapp-m2s-02-0250_c18.xml	SAT (TO)	226933202	2400.12	2286.17	4292006
TravelingTournament/ TravelingTournament-a2-galaxy14_c18.xml	SAT (TO)	17658	2400.13	2362.33	4291499
TravellingSalesman/ TravellingSalesman-25-30-00_c18.xml	SAT (TO)	115	2400.13	2337.04	4291513
StillLife/ StillLife-wastage-14_c18.xml	SAT (TO)	101	2400.13	2368.02	4291435
Rlfap/Rlfap-opt/ Rlfap-scen-07-opt_c18.xml	SAT (TO)	87071194	2400.13	2205.77	4291916
QuadraticAssignment/ QuadraticAssignment-sko72_c18.xml	SAT (TO)	35373	2400.13	2368.44	4291588
TravelingTournament/ TravelingTournament-a2-galaxy16_c18.xml	SAT (TO)	24581	2400.13	2336.93	4291500
PseudoBoolean-opt/ Pb-garden-100x100_c18.xml	SAT (TO)	3444	2400.14	2237.08	4291563
QuadraticAssignment/ QuadraticAssignment-sko64_c18.xml	SAT (TO)	26020	2400.14	2361.63	4291587
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	231924910	2400.14	2295.16	4292051
TravelingTournament/ TravelingTournament-a3-galaxy10_c18.xml	SAT (TO)	6073	2400.14	2354.03	4291504
CrosswordDesign/ CrosswordDesign-06-4-rom_c18.xml	SAT (TO)	50	2400.14	2380.34	4291470
TravelingTournament/ TravelingTournament-a3-galaxy16_c18.xml	SAT (TO)	23158	2400.14	2366.74	4291507
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	184253556	2400.14	2281.45	4292066
GraphColoring/ GraphColoring-qg-order30_c18.xml	SAT (TO)	29	2400.14	2357.85	4291463
Fapp/Fapp-m2s/ Fapp-m2s-test02-0250_c18.xml	SAT (TO)	143641913	2400.15	2269.86	4292021
Rlfap/Rlfap-opt/ Rlfap-graph-12-opt_c18.xml	SAT (TO)	295440	2400.15	2335.06	4291891
Rlfap/Rlfap-opt/ Rlfap-scen-08-opt_c18.xml	SAT (TO)	4903	2400.15	2344.65	4291861
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	229840	2400.15	2346.17	4291856
QuadraticAssignment/ QuadraticAssignment-sko81_c18.xml	SAT (TO)	49152	2400.15	2364.65	4291589
Fapp/Fapp-m2s/ Fapp-m2s-16-0260_c18.xml	SAT (TO)	389436243	2400.16	2233.66	4291996
PeacableArmies/ PeacableArmies-m1-50_c18.xml	SAT (TO)	190	2400.16	2334.95	4291486
Fapp/Fapp-m2s/ Fapp-m2s-03-0300_c18.xml	SAT (TO)	474954140	2400.27	2141.91	4292011
Auction/Auction-cnt/ Auction-cnt-matching080_c18.xml	SAT (TO)	45437910	2400.41	2317.72	4291786
Rlfap/Rlfap-opt/ Rlfap-graph-11-opt_c18.xml	SAT (TO)	227490	2401.27	2343.96	4291961
GraphColoring/ GraphColoring-4-fullins-5_c18.xml	SAT (TO)	3844	2406.2	2007.64	4291459

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CrosswordDesign/ CrosswordDesign-08-4-rom_c18.xml	?	64.601	22.1443	4291472
CrosswordDesign/ CrosswordDesign-09-4-rom_c18.xml	?	68.2425	23.7144	4291473
CrosswordDesign/ CrosswordDesign-07-4-rom_c18.xml	?	72.8078	24.0105	4291471
CrosswordDesign/ CrosswordDesign-10-4-rom_c18.xml	?	75.3058	33.0325	4291474
CrosswordDesign/ CrosswordDesign-13-4-rom_c18.xml	?	77.527	34.941	4291477
CrosswordDesign/ CrosswordDesign-14-4-rom_c18.xml	?	80.2378	36.0102	4291478
CrosswordDesign/ CrosswordDesign-12-4-rom_c18.xml	?	81.8078	37.44	4291476
CrosswordDesign/ CrosswordDesign-11-4-rom_c18.xml	?	82.7079	35.5911	4291475
CrosswordDesign/ CrosswordDesign-15-4-rom_c18.xml	?	86.1214	38.3951	4291479
GraphColoring/ GraphColoring-qg-order60_c18.xml	?	421.082	140.24	4291465
GraphColoring/ GraphColoring-qg-order100_c18.xml	?	726.303	230.3	4291462

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SteelMillSlab/ SteelMillSlab-m1-3-2_c18.xml	? (TO)	2400.02	2392.41	4291615
PizzaVoucher/ PizzaVoucher-15a_c18.xml	? (TO)	2400.03	2361.02	4291553
NurseRostering/ NurseRostering-17_c18.xml	? (TO)	2400.03	2380.12	4291608
NurseRostering/ NurseRostering-16_c18.xml	? (TO)	2400.03	2377.62	4291607
PizzaVoucher/ PizzaVoucher-18b_c18.xml	? (TO)	2400.03	2361.03	4291556
TemplateDesign/ TemplateDesign-m2-magazine_c18.xml	? (TO)	2400.04	2384.02	4291653
Bacp/Bacp-m2/ Bacp-m2-12a_c18.xml	? (TO)	2400.04	2381.31	4292081
SteelMillSlab/ SteelMillSlab-m1-3-0_c18.xml	? (TO)	2400.04	2392.51	4291614
PizzaVoucher/ PizzaVoucher-12b_c18.xml	? (TO)	2400.04	2360.52	4291552
PizzaVoucher/ PizzaVoucher-22b_c18.xml	? (TO)	2400.04	2361.02	4291558
NurseRostering/ NurseRostering-14_c18.xml	? (TO)	2400.04	2381.61	4291605
NurseRostering/ NurseRostering-07_c18.xml	? (TO)	2400.04	2380.81	4291598
Rlfap/Rlfap-opt/ Rlfap-graph-13-opt_c18.xml	? (TO)	2400.05	2384.92	4291906
NurseRostering/ NurseRostering-11_c18.xml	? (TO)	2400.05	2381.92	4291602
Bacp/Bacp-m1/ Bacp-m1-12a_c18.xml	? (TO)	2400.05	2385.51	4292166
NurseRostering/ NurseRostering-09_c18.xml	? (TO)	2400.05	2376.03	4291600
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	? (TO)	2400.05	2381.51	4291976
SteelMillSlab/ SteelMillSlab-m2s-2-0_c18.xml	? (TO)	2400.05	2385.33	4291623
NurseRostering/ NurseRostering-13_c18.xml	? (TO)	2400.06	2377.51	4291604
NurseRostering/ NurseRostering-06_c18.xml	? (TO)	2400.06	2376.03	4291597
TemplateDesign/ TemplateDesign-m1-herbs_c18.xml	? (TO)	2400.06	2389.61	4291642
NurseRostering/ NurseRostering-10_c18.xml	? (TO)	2400.07	2381.71	4291601
NurseRostering/ NurseRostering-08_c18.xml	? (TO)	2400.07	2380.82	4291599
PizzaVoucher/ PizzaVoucher-12a_c18.xml	? (TO)	2400.07	2358.42	4291551
PseudoBoolean-opt/ Pb-circ10-3_c18.xml	? (TO)	2400.07	2378.32	4291559
SteelMillSlab/ SteelMillSlab-m2s-2-2_c18.xml	? (TO)	2400.08	2385.83	4291624
SteelMillSlab/ SteelMillSlab-m1-2-2_c18.xml	? (TO)	2400.08	2394.21	4291613
PizzaVoucher/ PizzaVoucher-22a_c18.xml	? (TO)	2400.08	2360.62	4291557
Rlfap/Rlfap-opt/ Rlfap-graph-04-opt_c18.xml	? (TO)	2400.08	2382.92	4291896
SteelMillSlab/ SteelMillSlab-m2s-3-0_c18.xml	? (TO)	2400.08	2385.82	4291625
SteelMillSlab/ SteelMillSlab-m1-4-0_c18.xml	? (TO)	2400.09	2393.61	4291616
NurseRostering/ NurseRostering-19_c18.xml	? (TO)	2400.09	2371.92	4291610
TemplateDesign/ TemplateDesign-m1-magazine_c18.xml	? (TO)	2400.09	2380.51	4291643
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.1	2379.42	4291609
SteelMillSlab/ SteelMillSlab-m1-2-0_c18.xml	? (TO)	2400.1	2393.31	4291612
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	2400.1	2391.21	4291652
SteelMillSlab/ SteelMillSlab-m2-3-2_c18.xml	? (TO)	2400.1	2385.92	4291621
NurseRostering/ NurseRostering-15_c18.xml	? (TO)	2400.1	2380.51	4291606
SteelMillSlab/ SteelMillSlab-m2s-3-2_c18.xml	? (TO)	2400.1	2386.42	4291626
PseudoBoolean-opt/ Pb-circ8-3_c18.xml	? (TO)	2400.1	2366.41	4291562
NurseRostering/ NurseRostering-12_c18.xml	? (TO)	2400.11	2384.12	4291603
SteelMillSlab/ SteelMillSlab-m2-3-0_c18.xml	? (TO)	2400.11	2386.32	4291620
SteelMillSlab/ SteelMillSlab-m2s-4-0_c18.xml	? (TO)	2400.11	2385.83	4291627
SteelMillSlab/ SteelMillSlab-m2-4-0_c18.xml	? (TO)	2400.11	2386.52	4291622
Fapp/Fapp-m2s/ Fapp-m2s-test03-0400_c18.xml	? (TO)	2400.11	2367.32	4292026
SteelMillSlab/ SteelMillSlab-m2-2-2_c18.xml	? (TO)	2400.11	2387.32	4291619
NurseRostering/ NurseRostering-20_c18.xml	? (TO)	2400.11	2368.53	4291611
SteelMillSlab/ SteelMillSlab-m2-2-0_c18.xml	? (TO)	2400.11	2387.93	4291618
PizzaVoucher/ PizzaVoucher-15b_c18.xml	? (TO)	2400.11	2360.91	4291554
Fapp/Fapp-m2s/ Fapp-m2s-05-0350_c18.xml	? (TO)	2400.12	2366.03	4292036
Fapp/Fapp-m2s/ Fapp-m2s-08-0700_c18.xml	? (TO)	2400.12	2356.54	4292041
PizzaVoucher/ PizzaVoucher-18a_c18.xml	? (TO)	2400.12	2360.91	4291555
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	? (TO)	2400.15	2355.63	4292056
Fapp/Fapp-m2s/ Fapp-m2s-07-0600_c18.xml	? (TO)	2407.79	1068.07	4292001
PseudoBoolean-opt/ Pb-radar-30-70-45-050-100_c18.xml	? (TO)	2408.09	893.378	4291571

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Rlfap/Rlfap-opt/ Rlfap-scen-02-opt_c18.xml	Wrong Opt.	28	4.05918	1.70996	4291921
Rlfap/Rlfap-opt/ Rlfap-graph-01-opt_c18.xml	Wrong Opt.	34	4.18571	1.72657	4291901
Rlfap/Rlfap-opt/ Rlfap-graph-02-opt_c18.xml	Wrong Opt.	32	5.00663	2.01327	4291951
Rlfap/Rlfap-opt/ Rlfap-scen-03-opt_c18.xml	Wrong Opt.	40	5.12733	2.04289	4291941
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	Wrong Opt.	48	5.88979	2.37255	4291966
Rlfap/Rlfap-opt/ Rlfap-graph-14-opt_c18.xml	Wrong Opt.	30	6.34563	2.55285	4291971
Rlfap/Rlfap-opt/ Rlfap-graph-09-opt_c18.xml	Wrong Opt.	46	6.86441	2.69106	4291931
Rlfap/Rlfap-opt/ Rlfap-scen-01-opt_c18.xml	Wrong Opt.	42	7.08842	2.87619	4291866
Rlfap/Rlfap-opt/ Rlfap-scen-11-opt_c18.xml	Wrong Opt.	46	18.0653	12.6805	4291876

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Tal/ Tal-02_c18.xml	Wrong UNSAT	3.36023	1.56161	4291630
Tal/ Tal-03_c18.xml	Wrong UNSAT	3.69295	1.67254	4291631
Tal/ Tal-04_c18.xml	Wrong UNSAT	3.81248	1.68434	4291632
Tal/ Tal-05_c18.xml	Wrong UNSAT	3.8707	1.75466	4291633
Tal/ Tal-06_c18.xml	Wrong UNSAT	4.0257	1.76199	4291634
Tal/ Tal-07_c18.xml	Wrong UNSAT	4.0539	1.9837	4291635
Tal/ Tal-08_c18.xml	Wrong UNSAT	4.31738	1.91116	4291636
Tal/ Tal-09_c18.xml	Wrong UNSAT	4.42164	1.96976	4291637
Tal/ Tal-10_c18.xml	Wrong UNSAT	4.59186	1.99929	4291638

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver OscaR - Hybrid 2018-07-02 (complete)

Category "optimization problem" (COP)

Solver found optimum (OPTIMUM FOUND) (63 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) but this may not be the optimal solution (1 run) [Show/Hide]

Solver timed out but found at least a solution (198 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (11 runs) [Show/Hide]

Solver timed out (no solution given) (55 runs) [Show/Hide]

Solver found a wrong optimum (9 runs) [Show/Hide]

Solver wrongly proved unsatitisfiability (9 runs) [Show/Hide]