2019 XCSP3 competition: main track (CSP and COP, sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		800.314	785.248	4396093

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	7.45024	3.40422	4396062
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	9.94088	4.0898	4396042
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	11.248	4.41424	4396063
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	11.4689	4.51981	4396182
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	11.6328	4.54867	4396179
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	11.9704	4.63981	4396185
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	12.3172	5.13238	4396052
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	12.4157	4.71598	4396053
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	13.1881	5.10586	4396161
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	13.9413	5.29592	4396090
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	13.9421	5.37458	4396106
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	15.0714	6.12539	4396151
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	15.503	6.13149	4396145
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	17.1731	9.35269	4396071
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	OPT	2	17.4479	7.07477	4396080
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	18.5172	11.8318	4396129
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	18.7138	8.3498	4396189
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	19.9932	8.98044	4396139
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	20.4661	12.1794	4396043
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	21.0569	10.1965	4396113
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	24.3232	14.9519	4396135
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	24.8017	13.8514	4396181
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	25.1207	13.6778	4396156
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	30.848	18.3289	4396190
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	46.2219	30.4697	4396165
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	47.077	34.669	4396045
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	50.4113	39.0108	4396184
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	55.1556	44.1655	4396099
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	56.8666	43.5857	4396130
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	60.6658	46.9332	4396082
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	62.423	52.1034	4396064
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	OPT	2	69.967	58.7939	4396169
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	70.2833	61.4106	4396207
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	70.928	61.9229	4396054
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	73.253	63.1038	4396044
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	91.0044	67.937	4396162
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	OPT	162507055	98.4528	56.9982	4396102
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	104.071	83.3222	4396173
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	104.851	83.3108	4396192
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	105.138	93.8968	4396066
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	109.635	101.076	4396172
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	111.721	95.4695	4396133
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	122.903	108.979	4396171
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	OPT	130971634	124.133	81.4327	4396154
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	125.752	115.403	4396175
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	132.328	119.87	4396092
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	135.269	121.081	4396048
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	OPT	63832030	141.977	103.605	4396073
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	OPT	48	144.803	133.167	4396339
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	145.387	132.883	4396057
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	174.08	162.922	4396065
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	183.681	173.928	4396136
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	186.639	165.362	4396167
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	200.995	183.53	4396187
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	215.14	204.785	4396178
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	215.768	203.611	4396056
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	OPT	89	232.913	219.275	4396257
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	241.201	225.526	4396067
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	OPT	506362597	243.523	160.881	4396132
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	OPT	12	247.669	233.635	4396121
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	252.867	244.371	4396046
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	270.995	254.02	4396047
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	271.913	258.996	4396114
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	309.857	293.691	4396058
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	OPT	45	335.463	306.567	4396141
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	OPT	45	337.57	306.93	4396160
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	OPT	24	343.39	324.634	4396326
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	347.299	333.58	4396238
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	410.592	394.411	4396072
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	422.198	408.795	4396147
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	426.208	415.964	4396059
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	428.732	410.769	4396101
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	435.938	418.533	4396051
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	445.144	431.079	4396100
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	455.201	440.12	4396140
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	461.575	447.085	4396060
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	493.406	479.822	4396110
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	OPT	2	587.38	569.418	4396170
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	603.719	588.712	4396138
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	679.984	664.069	4396142
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	684.851	660.682	4396074
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	703.854	679.157	4396109
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	724.911	701.287	4396069
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	733.223	708.881	4396148
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	OPT	8	760.633	732.043	4396225
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	761.323	739.293	4396084
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	846.745	819.714	4396155
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	858.334	840.461	4396070
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	860.74	844.491	4396217
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	920.04	896.783	4396119
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	949.491	924.56	4396108
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	949.804	924.741	4396118
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	972.291	946.611	4396221
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	1165.7	1147.87	4396061
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	1192.21	1160.2	4396150
Tal/ Tal-05_c18.xml	OPT	16	1255.47	1229.94	4396194
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	1257.94	1232.68	4396122
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	1260.95	1231.28	4396254
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	OPT	113	1308.72	1287.14	4396220
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	1364.57	1335.46	4396115
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	1364.71	1344.09	4396223
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	1402.45	1376.83	4396159
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	OPT	68	1418.62	1398.43	4396206
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	OPT	2	1434.68	1410.92	4396180
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	1495.2	1453.64	4396243
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1532.65	1499.97	4396137
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	1587.56	1554.33	4396050
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	1609.94	1589.41	4396235
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	1623.24	1600.43	4396213
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	1648.06	1629.11	4396234
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	1656.26	1627.63	4396168
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	1725.1	1687.69	4396055
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	1925.57	1892.97	4396124
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	OPT	13	2043.14	2008.58	4396286
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	2090.88	2054.75	4396116
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	OPT	123	2102.99	2075.64	4396183
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	2158.55	2115.69	4396163
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	2182.4	2139.51	4396096
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	2323.09	2282.33	4396105
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	2343.51	2321.09	4396231
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	2416.61	2391.19	4396166
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	2480.62	2454.71	4396103

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	SAT (TO)	37	2520.04	2482.33	4396204
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	SAT (TO)	357	2520.04	2465.83	4396125
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	SAT (TO)	65	2520.04	2491.73	4396210
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	SAT (TO)	718	2520.04	2465.63	4396228
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	121	2520.04	2470.84	4396293
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	1637	2520.05	2461.44	4396269
Opd/Opd-sum-small/ Opd-09-024-008.xml	SAT (TO)	3	2520.05	2484.53	4396176
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	SAT (TO)	32	2520.05	2482.33	4396131
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	SAT (TO)	1121	2520.05	2495.53	4396248
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	SAT (TO)	992	2520.05	2493.73	4396078
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2520.05	2498.52	4396292
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	SAT (TO)	26	2520.05	2482.63	4396117
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	799	2520.05	2472.04	4396299
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2520.05	2471.84	4396196
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	SAT (TO)	84	2520.05	2490.04	4396214
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	SAT (TO)	1003	2520.05	2494.24	4396251
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	115	2520.06	2480.03	4396338
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	SAT (TO)	90	2520.06	2487.32	4396218
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	SAT (TO)	1109	2520.06	2494.33	4396087
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	17	2520.06	2486.04	4396283
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	SAT (TO)	1	2520.06	2465.23	4396186
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	470	2520.06	2466.43	4396205
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	1585	2520.06	2465.05	4396311
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2520.06	2475.04	4396195
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	SAT (TO)	3	2520.06	2490.03	4396264
Opd/Opd-sum-small/ Opd-10-030-009.xml	SAT (TO)	3	2520.06	2478.74	4396246
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	SAT (TO)	97	2520.06	2490.83	4396209
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	SAT (TO)	1120	2520.06	2483.23	4396091
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2520.06	2471.43	4396321
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	1028	2520.06	2462.84	4396332
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	87	2520.06	2477.93	4396341
Opd/Opd-sum-small/ Opd-11-011-005.xml	SAT (TO)	3	2520.06	2481.73	4396120
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	SAT (TO)	331	2520.06	2458.54	4396227
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	SAT (TO)	312	2520.07	2469.33	4396104
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	SAT (TO)	477	2520.07	2465.73	4396258
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	1227	2520.07	2463.48	4396336
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	494	2520.07	2473.24	4396288
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	SAT (TO)	1289	2520.07	2493.23	4396097
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	SAT (TO)	1105	2520.07	2492.43	4396111
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	SAT (TO)	14	2520.07	2474.93	4396335
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	1751	2520.07	2463.73	4396313
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	SAT (TO)	48	2520.07	2495.42	4396177
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2520.07	2484.63	4396301
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	SAT (TO)	3	2520.08	2487.23	4396253
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	SAT (TO)	89	2520.08	2488.53	4396212
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	199	2520.08	2465.05	4396308
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	687	2520.08	2457.33	4396312
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	10708954	2520.08	2474.34	4396291
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	SAT (TO)	2	2520.08	2492.43	4396222
Opd/Opd-sum-small/ Opd-15-015-004.xml	SAT (TO)	2	2520.08	2473.63	4396128
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	734	2520.08	2466.74	4396282
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	SAT (TO)	1241	2520.08	2492.73	4396250
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	SAT (TO)	3	2520.08	2484.64	4396337
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	2520.08	2487.05	4396152
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	128	2520.08	2478.83	4396287
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	SAT (TO)	300	2520.09	2467.14	4396146
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	133	2520.09	2471.43	4396296
Opd/Opd-sum-small/ Opd-10-038-010.xml	SAT (TO)	3	2520.09	2490.23	4396157
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	197	2520.09	2467.14	4396297
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	SAT (TO)	1079	2520.09	2493.43	4396095
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	SAT (TO)	26	2520.09	2481.63	4396123
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	SAT (TO)	701	2520.09	2486.75	4396144
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	SAT (TO)	5	2520.09	2475.73	4396244
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2520.09	2471.15	4396197
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	SAT (TO)	37	2520.09	2486.63	4396201
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	440	2520.09	2463.05	4396266
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	SAT (TO)	1070	2520.09	2492.43	4396086
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	261	2520.09	2462.66	4396285
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	SAT (TO)	196	2520.1	2461.19	4396290
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2520.1	2486.54	4396256
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	SAT (TO)	10	2520.1	2476.83	4396134
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	401	2520.1	2462.77	4396306
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	5	2520.1	2463.63	4396241
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	SAT (TO)	5	2520.1	2471.63	4396240
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	SAT (TO)	7	2520.1	2464.43	4396239
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	8	2520.1	2453.73	4396252
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	SAT (TO)	450	2520.1	2482.04	4396112
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2520.1	2484.34	4396260
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	SAT (TO)	39	2520.1	2481.04	4396200
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	SAT (TO)	303	2520.1	2468.33	4396094
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	SAT (TO)	1427	2520.1	2497.23	4396249
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	72	2520.11	2476.23	4396330
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	56935	2520.11	2472.04	4396322
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	1716	2520.11	2459.17	4396325
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	14	2520.11	2492.44	4396277
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	SAT (TO)	326	2520.11	2467.04	4396143
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	SAT (TO)	34	2520.11	2481.53	4396164
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	SAT (TO)	310	2520.11	2459.23	4396226
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	SAT (TO)	1049	2520.11	2493.05	4396076
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	SAT (TO)	29	2520.11	2482.63	4396153
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	SAT (TO)	990	2520.11	2469.14	4396247
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	626	2520.11	2464.28	4396310
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	SAT (TO)	311	2520.12	2468.83	4396107
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	SAT (TO)	14	2520.12	2476.83	4396242
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	SAT (TO)	57	2520.12	2495.57	4396089
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	SAT (TO)	142	2520.12	2485.53	4396208
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	SAT (TO)	1352	2520.12	2466.36	4396300
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	SAT (TO)	34	2520.12	2481.14	4396202
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	SAT (TO)	1015	2520.12	2466.64	4396075
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	665	2520.12	2465.77	4396315
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	SAT (TO)	1097	2520.12	2479.85	4396049
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	SAT (TO)	579	2520.12	2465.24	4396259
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	SAT (TO)	742	2520.12	2479.36	4396255
Opd/Opd-sum-small/ Opd-10-037-014.xml	SAT (TO)	6	2520.12	2479.04	4396127
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31584	2520.12	2468.73	4396317
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	SAT (TO)	40	2520.13	2488.04	4396199
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	SAT (TO)	73	2520.13	2489.44	4396216
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	SAT (TO)	98	2520.13	2486.14	4396219
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	140	2520.13	2481.63	4396340
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2520.13	2471.74	4396198
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	SAT (TO)	282	2520.13	2463.54	4396289
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	69	2520.13	2484.14	4396274
Opd/Opd-sum-small/ Opd-10-031-009.xml	SAT (TO)	3	2520.13	2480.63	4396245
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	1347428	2520.13	2484.76	4396302
Tal/ Tal-03_c18.xml	SAT (TO)	96	2520.13	2483.33	4396149
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	SAT (TO)	262	2520.13	2469.93	4396068
Opd/Opd-sum-large/ Opd-04-350-100.xml	SAT (TO)	10	2520.13	2474.64	4396191
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	SAT (TO)	10	2520.13	2480.34	4396158
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	1057	2520.13	2468.85	4396303
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	72	2520.13	2466.33	4396323
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	126	2520.13	2472.14	4396329
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	SAT (TO)	-898	2520.13	2497.95	4396237
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	SAT (TO)	103	2520.14	2487.43	4396215
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	SAT (TO)	6	2520.14	2470.82	4396224
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	SAT (TO)	979	2520.14	2479.44	4396088
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	SAT (TO)	326	2520.14	2469.73	4396126
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	250	2520.14	2467.36	4396305
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	SAT (TO)	380	2520.14	2460.68	4396314
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	SAT (TO)	42	2520.14	2482.63	4396203
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	SAT (TO)	1429	2520.14	2493.14	4396085
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	SAT (TO)	53	2520.14	2488.42	4396083
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	SAT (TO)	103	2520.15	2487.53	4396211
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	SAT (TO)	255	2520.15	2463.45	4396307
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2520.15	2471.34	4396098
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	1177	2520.15	2469.82	4396294
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2520.15	2472.34	4396304
Opd/Opd-sum-large/ Opd-09-350-100.xml	SAT (TO)	72	2520.16	2462.17	4396318
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	41032	2520.16	2475.66	4396271
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	SAT (TO)	130	2520.16	2488.7	4396174
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	SAT (TO)	228	2520.17	2462.37	4396316
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	963	2520.17	2473.2	4396298
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	135726	2520.18	2430.58	4396320
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	SAT (TO)	433	2520.18	2462.57	4396309
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	SAT (TO)	346	2520.23	2463.12	4396295

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	?		17.8995	7.01958	4396328

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	2520.05	2471.23	4396193
PeacableArmies/ PeacableArmies-m2-07_c18.xml	? (TO)	2520.07	2474.63	4396188
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	? (TO)	2520.07	2477.24	4396232
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2520.08	2485.14	4396272
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	? (TO)	2520.08	2474.23	4396081
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2520.08	2472.55	4396327
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	? (TO)	2520.09	2483.15	4396077
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	? (TO)	2520.1	2483.64	4396230
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2520.1	2450.05	4396319
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	? (TO)	2520.1	2480.05	4396229
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2520.1	2481.32	4396261
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	? (TO)	2520.1	2479.04	4396236
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	? (TO)	2520.1	2480.63	4396233
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2520.11	2481.04	4396273
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	? (TO)	2520.11	2483.14	4396079
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	? (TO)	2520.12	2475.15	4396275
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	? (TO)	2520.12	2492.83	4396263
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2520.13	2486.65	4396270
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2520.13	2477.23	4396278
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2520.14	2462.96	4396284
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2520.16	2482.03	4396279
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2520.16	2456.69	4396333
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2520.16	2475.38	4396280
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2520.17	2478.08	4396324
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2520.22	2433.38	4396334
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2520.26	2461.94	4396276
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2520.28	2476.81	4396268
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2520.32	2466.57	4396281
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	? (TO)	2520.33	2486.06	4396262
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	? (TO)	2520.35	2159.34	4396267
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2522.1	2495.53	4396265
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2522.11	2496.73	4396331

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
MaxCSP/ MaxCSP-kbtree-s9-5/kbtree-9-5-3-5-80-33.xml	UNSAT	6.5451	3.14053	4395757
KnightTour/KnightTour-int-s1/ KnightTour-05-int.xml	UNSAT	6.96028	3.21068	4395830
Knights/Knights-m1-s1/ Knights-015-09.xml	UNSAT	8.58618	3.6453	4395791
SchurrLemma/SchurrLemma-mod-s1/ SchurrLemma-mod-100-9.xml	UNSAT	9.32502	4.16683	4395824
Crossword/ Crossword-m1c-ogd-vg/Crossword-m1c-ogd-vg-15-19.xml	UNSAT	9.41293	4.70144	4395755
Crossword/ Crossword-m1c-ogd-vg/Crossword-m1c-ogd-vg-16-16.xml	UNSAT	9.69644	4.26353	4395794
Random/Random-D-t090/ rand-2-40-180-84-090-90.xml	UNSAT	17.3999	8.24813	4395784
KnightTour/KnightTour-ext-s1/ KnightTour-17-ext02.xml	UNSAT	19.0255	9.23549	4395875
MaxCSP/MaxCSP-maxclique-s1/ MaxCSP-brock-800-2.xml	UNSAT	25.2477	11.2784	4395768
KnightTour/KnightTour-int-s1/ KnightTour-17-int.xml	UNSAT	30.6769	19.512	4396002
QRandom/QRandom-reg2ext-s1/ reg-s20-p03-c20-d10-n10-l5-64.xml	UNSAT	35.464	28.3428	4395770
PigeonsPlus/PigeonsPlus-m1-s1/ pigeonsPlus-08-08.xml	UNSAT	39.8225	24.4038	4395867
KnightTour/KnightTour-ext-s1/ KnightTour-15-ext06.xml	UNSAT	67.4256	44.811	4395936
Random/Random-m1-5-12-12/ rand-5-12-12-200-12442-22.xml	UNSAT	92.537	81.1004	4395780
PigeonsPlus/PigeonsPlus-m1-s1/ pigeonsPlus-10-05.xml	UNSAT	122.286	115.035	4395809
QRandom/QRandom-mdd-7-25-5-p7/ mdd-7-25-5-ps05-psh07-9.xml	UNSAT	153.641	142.579	4395802
Mixed/Mixed-xcsp2-cril/ cril-2_X2.xml	UNSAT	186.591	175.976	4395861
Random/Random-RB-3-20-20/ rand-3-20-20-60-632-45.xml	UNSAT	205.063	195.724	4395773
Crossword/ Crossword-m1c-ogd-vg/Crossword-m1c-ogd-vg-14-15.xml	UNSAT	241.348	233.16	4395789
PropStress/PropStress-m1-s1/ PropStress-0150.xml	UNSAT	242.287	218.884	4395842
Random/Random-m1-5-12-12t/ rand-5-12-12-200-t85-8.xml	UNSAT	248.507	231.927	4395884
QRandom/QRandom-mdd-7-25-5-p7/ mdd-7-25-5-ps05-psh07-4.xml	UNSAT	253.661	242.986	4395826
QRandom/QRandom-bdd-18-21-2/ bdd-18-21-2-133-78-29.xml	UNSAT	300.281	289.621	4395913
Random/Random-m1-5-12-12t/ rand-5-12-12-200-t85-6.xml	UNSAT	345.061	326.471	4395887
QRandom/QRandom-bdd-18-21-2/ bdd-18-21-2-133-78-21.xml	UNSAT	353.827	343.593	4395883
Langford/Langford-m1-k4/ Langford-4-15.xml	UNSAT	366.467	347.777	4395851
QRandom/QRandom-bdd-18-21-2/ bdd-18-21-2-133-78-06.xml	UNSAT	381.38	369.531	4395912
Crossword/ Crossword-m1c-words-vg/Crossword-m1c-words-vg-8-10.xml	UNSAT	411.442	402.926	4395903
QRandom/QRandom-bdd-18-21-2/ bdd-18-21-2-133-78-33.xml	UNSAT	468.22	457.273	4395923
Random/Random-D-t020/ rand-2-40-11-414-020-79.xml	UNSAT	485.724	472.488	4395756
QRandom/ QRandom-bdd-15-21-2/bdd-15-21-2-2713-79-15.xml	UNSAT	547.383	535.744	4395888
QRandom/ QRandom-bdd-15-21-2/bdd-15-21-2-2713-79-06.xml	UNSAT	669.239	655.053	4395918
Random/Random-m1-7-40-8t/ rand-7-40-8-40-15000-9.xml	UNSAT	793.299	781.262	4395779
QRandom/ QRandom-geometric-rw/geometric-50-20-d4-75-94.xml	UNSAT	927.076	907.228	4395804
Langford/Langford-m1-k3/ Langford-3-14.xml	UNSAT	1130.6	1101.03	4395873
PseudoBoolean/PseudoBoolean-dec-queen/ Pb-queen-0975965.xml	UNSAT	1556.2	1533.24	4395771
Langford/Langford-m1-k4/ Langford-4-16.xml	UNSAT	1688.68	1651.58	4395841
Subisomorphism/Subisomorphism-m1-LV/ Subisomorphism-g07-g20.xml	UNSAT	1754.48	1733.52	4396009
Random/Random-m1-5-8X-05c/ rand-5-8X-05c-44.xml	UNSAT	1827.27	1805.9	4396003

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Primes/ Primes-m1-p20/Primes-20-20-3-3.xml	SAT	5.54718	2.68799	4395846
Primes/ Primes-m1-p15/Primes-15-20-2-7.xml	SAT	5.64566	2.86658	4395876
Primes/ Primes-m1-p25/Primes-25-20-3-1.xml	SAT	5.84315	2.75237	4395767
Primes/ Primes-m1-p25/Primes-25-80-2-7.xml	SAT	6.35615	2.97487	4395849
Primes/ Primes-m1-p15/Primes-15-80-3-7.xml	SAT	7.40543	3.27555	4395807
Domino/Domino-m1-s1/ Domino-9000-9000.xml	SAT	7.76743	3.3259	4395863
QRandom/ QRandom-geometric-rw/geometric-50-20-d4-75-76.xml	SAT	8.90347	3.72795	4395748
Blackhole/Blackhole-m1-s13/ Blackhole-13-3-04.xml	SAT	9.64907	3.93198	4395758
Subisomorphism/Subisomorphism-m1-si4-m4D/ Subisomorphism-si4-m4Dr4-m256-08.xml	SAT	9.9445	4.36255	4395750
Subisomorphism/Subisomorphism-m1-si4-bvg/ Subisomorphism-si4-b03m-m400-04.xml	SAT	10.1161	4.30555	4395761
Primes/ Primes-m1-p25/Primes-25-40-2-7.xml	SAT	10.5366	5.05472	4395981
Primes/ Primes-m1-p30/Primes-30-80-3-7.xml	SAT	10.7056	4.36764	4395900
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-5-3-4-cp.xml	SAT	10.7171	4.82184	4395747
Subisomorphism/Subisomorphism-m1-si2-m4D/ Subisomorphism-si2-m4Dr6-m256-00.xml	SAT	11.343	4.64728	4395749
Scheduling/Scheduling-jsdec-sadeh/ Sadeh-enddr1-7.xml	SAT	11.4129	4.5663	4395835
TravellingSalesman/TravellingSalesman-xcsp2-s20a4/ TravellingSalesman-4-20-001-a4_X2.xml	SAT	11.7035	4.97076	4395764
Subisomorphism/Subisomorphism-m1-si6-bvg/ Subisomorphism-si6-b06-m200-07.xml	SAT	12.1065	5.71047	4395774
Primes/ Primes-m1-p10/Primes-10-40-2-7.xml	SAT	12.4023	5.54947	4395865
Subisomorphism/Subisomorphism-m1-si6-bvg/ Subisomorphism-si6-b09-m200-08.xml	SAT	13.193	6.70413	4395785
Hanoi/Hanoi-m1-s1/ Hanoi-07.xml	SAT	13.2706	6.03082	4395840
Crossword/Crossword-m1c-ogd-herald/ Crossword-m1c-ogd-h1502.xml	SAT	13.5153	5.96468	4395787
Primes/ Primes-m1-p10/Primes-10-60-3-5.xml	SAT	13.9983	7.50451	4395845
Subisomorphism/Subisomorphism-m1-SF/ Subisomorphism-A-20.xml	SAT	14.2786	6.22666	4395752
Crossword/Crossword-m1c-ogd2008-herald/ Crossword-m1c-ogd2008-h1509.xml	SAT	14.8108	6.89104	4395801
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-064.xml	SAT	15.1314	6.87275	4395799
Sudoku/ Sudoku-table-s1/Sudoku-s10c-table.xml	SAT	16.2335	8.79122	4395817
Crossword/Crossword-m1c-ogd2008-herald/ Crossword-m1c-ogd2008-h1905.xml	SAT	16.7066	8.91013	4395788
Random/Random-D-t035/ rand-2-40-16-250-035-86.xml	SAT	17.7872	10.3225	4395753
Crossword/Crossword-m1c-ogd-herald/ Crossword-m1c-ogd-h2107.xml	SAT	17.8294	9.53161	4395908
Crossword/Crossword-m1c-ogd-herald/ Crossword-m1c-ogd-h2105.xml	SAT	17.9664	9.73537	4395877
Crossword/Crossword-m1c-ogd2008-herald/ Crossword-m1c-ogd2008-h1506.xml	SAT	18.4827	9.22419	4396022
KnightTour/KnightTour-ext-s1/ KnightTour-08-ext03.xml	SAT	19.0605	8.23806	4395872
QRandom/ QRandom-geometric-rw/geometric-50-20-d4-75-08.xml	SAT	20.2413	11.9268	4395751
Nonogram/Nonogram-table-s1/ Nonogram-020-table.xml	SAT	20.6778	12.5214	4395762
Subisomorphism/Subisomorphism-m1-si4-m4D/ Subisomorphism-si4-m4D-m625-05.xml	SAT	21.4161	12.6288	4395775
Random/Random-D-t050/ rand-2-40-25-180-050-34.xml	SAT	25.9543	17.5694	4395759
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-70-08.xml	SAT	32.6838	13.7667	4395856
DeBruijnSequence/DeBruijnSequence-m1-s1/ DeBruijnSequence-03-05.xml	SAT	34.8029	15.9212	4395874
Subisomorphism/Subisomorphism-m1-si2-rand/ Subisomorphism-si2-r001-m400-05.xml	SAT	36.3961	28.3586	4395776
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-65-10.xml	SAT	37.9359	17.9162	4395781
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-01.xml	SAT	38.9669	25.486	4395910
MagicSquare/MagicSquare-sum-s1/ MagicSquare-13-sum.xml	SAT	39.9918	27.1492	4396024
GracefulGraph/GracefulGraph-m1-s1/ GracefulGraph-K03-P07.xml	SAT	41.1252	28.9104	4395819
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-144.xml	SAT	41.5342	26.067	4395974
Subisomorphism/Subisomorphism-m1-si2-m4D/ Subisomorphism-si2-m4Dr6-m1296-04.xml	SAT	46.0365	36.2192	4395890
MagicSquare/MagicSquare-sum-s1/ MagicSquare-12-sum.xml	SAT	46.4447	32.6754	4395968
Subisomorphism/Subisomorphism-m1-SF/ Subisomorphism-B-08.xml	SAT	54.0234	35.4226	4395878
Crossword/Crossword-m1c-words-herald/ Crossword-m1c-words-h2303.xml	SAT	54.7557	45.0207	4395904
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-08.xml	SAT	54.8498	41.6545	4395953
QRandom/QRandom-mdd-7-25-5/ mdd-7-25-5-56-01.xml	SAT	56.5752	45.7949	4395894
Rlfap/Rlfap-m1-scens/ Rlfap-scen-01.xml	SAT	66.4419	46.3388	4395765
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h375-07.xml	SAT	69.6259	55.8941	4395958
Rlfap/Rlfap-m1-graphsMod/ Rlfap-graph-08-f10.xml	SAT	71.5184	52.2746	4395839
Crossword/Crossword-m1c-lex-herald/ Crossword-m1c-lex-h2307.xml	SAT	72.4718	63.5132	4395882
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-02.xml	SAT	86.5976	72.2738	4395937
Rlfap/Rlfap-m1-graphs/ Rlfap-graph-10.xml	SAT	90.1212	71.2834	4395803
MagicSquare/MagicSquare-mdd-s1/ MagicSquare-9-mdd.xml	SAT	93.1999	74.385	4395880
AllInterval/AllInterval-m1-s1/ AllInterval-040.xml	SAT	93.5386	79.4634	4395956
Subisomorphism/Subisomorphism-m1-si4-m4D/ Subisomorphism-si4-m4Dr4-m1296-05.xml	SAT	94.9782	83.3718	4395881
Subisomorphism/Subisomorphism-m1-si6-m4D/ Subisomorphism-si6-m4Dr4-m1296-04.xml	SAT	103.439	92.5793	4395879
Subisomorphism/Subisomorphism-m1-si6-m4D/ Subisomorphism-si6-m4Dr2-m1296-05.xml	SAT	105.633	92.9293	4395889
Nonogram/Nonogram-table-s1/ Nonogram-122-table.xml	SAT	114.535	76.1859	4395866
Subisomorphism/Subisomorphism-m1-si4-rand/ Subisomorphism-si4-r001-m600-08.xml	SAT	151.868	138.744	4395998
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h375-19.xml	SAT	180.011	164.417	4395954
DeBruijnSequence/DeBruijnSequence-m1-s1/ DeBruijnSequence-02-09.xml	SAT	199.724	169.457	4395925
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-04-m018.xml	SAT	204.004	187.15	4395795
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-9-7-4-cp.xml	SAT	205.745	184.732	4395831
Primes/ Primes-m1-p20/Primes-20-40-2-7.xml	SAT	215.299	206.86	4395915
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-05.xml	SAT	234.513	219.225	4395891
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-07.xml	SAT	234.697	218.838	4395960
TravellingSalesman/TravellingSalesman-xcsp2-s25/ TravellingSalesman-25-715_X2.xml	SAT	247.655	235.766	4395838
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h375-06.xml	SAT	263.908	248.059	4395922
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-60-03.xml	SAT	272.624	251.988	4395812
Crossword/Crossword-m1c-words-vg/ Crossword-m1c-words-vg-7-7.xml	SAT	312.947	304.584	4396023
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-18-047.xml	SAT	343.101	329.133	4395745
Queens/ Queens-m1-s1/Queens-0150-m1.xml	SAT	527.055	475.663	4395782
Primes/ Primes-m1-p10/Primes-10-40-3-5.xml	SAT	583.729	571.519	4395961
QRandom/QRandom-mdd-7-25-5/ mdd-7-25-5-56-09.xml	SAT	601.336	589.547	4395920
Primes/ Primes-m1-p20/Primes-20-60-3-5.xml	SAT	669.44	655.812	4395955
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-60-01.xml	SAT	711.076	683.35	4395870
QRandom/QRandom-mdd-7-25-5/ mdd-7-25-5-56-17.xml	SAT	714.923	702.583	4395929
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-116.xml	SAT	727.017	699.076	4395864
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-15-036.xml	SAT	756.921	739.724	4395743
Random/Random-RB-2-50-23f/ rand-2-50-23-587-230f-45.xml	SAT	871.059	851.12	4396008
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-128.xml	SAT	905.384	872.736	4395893
Queens/ Queens-m1-s1/Queens-0200-m1.xml	SAT	928.281	823.572	4395857
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h375-01.xml	SAT	936.29	909.443	4395916
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	1043.25	1013.26	4395805
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-12.xml	SAT	1230.51	1075	4395810
SportsScheduling/SportsScheduling-m1-s1/ SportsScheduling-14.xml	SAT	1521.78	1480.8	4395833
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-19.xml	SAT	1723.93	1684.59	4395944
QuasiGroups/QuasiGroups-elt-qg3/ QuasiGroup-3-12.xml	SAT	1877.98	1835.46	4395970
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-75-03.xml	SAT	1953.82	1908.92	4395850
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-70-05.xml	SAT	2109.07	2062.09	4395860

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
XCSP19/hcp/ graph162.xml	?	17.6359	8.37143	4395986
MagicSequence/MagicSequence-count-s1/ MagicSequence-600-co.xml	?	21.8853	10.5446	4395858
GracefulGraph/GracefulGraph-m1-s1/ GracefulGraph-K13-P08.xml	?	25.6637	12.4109	4396007
StripPacking/StripPacking-m1-seriesN/ StripPacking-N6d.xml	?	27.7382	12.1475	4396026
MagicSequence/MagicSequence-card-s1/ MagicSequence-800-ca.xml	?	37.5537	25.6199	4395852
MagicSequence/MagicSequence-count-s1/ MagicSequence-1000-co.xml	?	51.7883	35.984	4395862
MagicSequence/MagicSequence-card-s1/ MagicSequence-1000-ca.xml	?	59.1874	45.344	4395777
GracefulGraph/GracefulGraph-m1-s1/ GracefulGraph-K09-P07.xml	?	117.256	99.8169	4396004

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-6-5-5-cp.xml	? (TO)	2520.03	2484.23	4395907
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-203.xml	? (TO)	2520.04	2465.83	4395818
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-012.xml	? (TO)	2520.04	2471.14	4395813
PseudoBoolean/PseudoBoolean-dec-pigeon/ Pb-pigeon-card-015-010.xml	? (TO)	2520.05	2492.63	4395806
GracefulGraph/GracefulGraph-m1-s1/ GracefulGraph-K05-P02.xml	? (TO)	2520.05	2466.13	4395796
QueensKnights/QueensKnights-m1-s1/ QueensKnights-050-05-mul.xml	? (TO)	2520.05	2460.23	4395973
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-06-0021.xml	? (TO)	2520.05	2468.13	4395997
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-06-m100.xml	? (TO)	2520.05	2464.13	4396027
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-199.xml	? (TO)	2520.05	2466.23	4395754
Dubois/Dubois-m1-s1/ Dubois-028.xml	? (TO)	2520.05	2480.73	4395827
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-36-92.xml	? (TO)	2520.06	2483.64	4395932
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-26-080.xml	? (TO)	2520.06	2484.43	4395746
PseudoBoolean/PseudoBoolean-dec-sptate/ Pb-Tate-K106.xml	? (TO)	2520.06	2474.17	4395962
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-16.xml	? (TO)	2520.06	2457.94	4395959
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-30-098.xml	? (TO)	2520.06	2474.83	4396011
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-5_X2.xml	? (TO)	2520.07	2476.33	4395928
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h374-11.xml	? (TO)	2520.07	2467.23	4395943
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-07-0080.xml	? (TO)	2520.07	2462.04	4395969
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-16-81.xml	? (TO)	2520.07	2479.64	4395792
PseudoBoolean/PseudoBoolean-dec-pigeon/ Pb-pigeon-clau-015-010.xml	? (TO)	2520.07	2476.04	4395972
Crossword/Crossword-m1c-lex-herald/ Crossword-m1c-lex-h2101.xml	? (TO)	2520.07	2506.83	4396028
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-18-046.xml	? (TO)	2520.07	2488.04	4395945
Sat/Sat-m1-various/ pret-150-40.xml	? (TO)	2520.07	2483.92	4395828
PseudoBoolean/PseudoBoolean-dec-armies/ Pb-army11-17ls.xml	? (TO)	2520.07	2482.44	4395811
Langford/Langford-m1-k3/ Langford-3-45.xml	? (TO)	2520.07	2471.63	4395977
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-02.xml	? (TO)	2520.07	2458.84	4395964
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-17-042.xml	? (TO)	2520.07	2486.33	4395744
QueensKnights/QueensKnights-m1-s1/ QueensKnights-080-05-add.xml	? (TO)	2520.07	2464.15	4395854
StripPacking/StripPacking-m1-seriesT/ StripPacking-T1e.xml	? (TO)	2520.07	2467.53	4395941
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-8-4-8-cp.xml	? (TO)	2520.07	2478.83	4396018
Dubois/Dubois-m1-s1/ Dubois-050.xml	? (TO)	2520.07	2482.53	4395821
XCSP19/hcp/ graph197.xml	? (TO)	2520.08	2483.95	4395988
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-023.xml	? (TO)	2520.08	2469.23	4395896
AllInterval/AllInterval-m1-s1/ AllInterval-035.xml	? (TO)	2520.08	2466.13	4395892
Rlfap_mini/Rlfap-dec-scens11_mini/ Rlfap-ext-scen-11-f02_c18.xml	? (TO)	2520.08	2472.75	4395786
PseudoBoolean/PseudoBoolean-dec-fpga/ Pb-chnl10-11.xml	? (TO)	2520.08	2495.53	4395797
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-029.xml	? (TO)	2520.08	2471.33	4395909
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-033.xml	? (TO)	2520.08	2466.23	4395816
Knights/Knights-m1-s1/ Knights-080-25.xml	? (TO)	2520.08	2469.04	4396041
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-29-093.xml	? (TO)	2520.08	2485.83	4395935
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-90-07.xml	? (TO)	2520.08	2470.64	4395949
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-27-083.xml	? (TO)	2520.09	2483.74	4395982
Bibd/Bibd-sc-stab1/ Bibd-sc-25-09-03.xml	? (TO)	2520.09	2468.62	4395924
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-9-8-4-cp.xml	? (TO)	2520.09	2480.74	4395868
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-183.xml	? (TO)	2520.09	2466.73	4395760
Langford/Langford-m1-k3/ Langford-3-30.xml	? (TO)	2520.09	2470.14	4396035
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-80-07.xml	? (TO)	2520.09	2468.64	4395822
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-152.xml	? (TO)	2520.09	2470.93	4395897
StripPacking/StripPacking-m1-series1/ StripPacking-C3P2.xml	? (TO)	2520.09	2476.73	4395963
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-20-054.xml	? (TO)	2520.09	2486.83	4395763
Bibd/Bibd-sc-stab1/ Bibd-sc-25-05-01.xml	? (TO)	2520.09	2463.44	4395844
Blackhole/Blackhole-xcsp2-s13/ Blackhole-4-13-2_X2.xml	? (TO)	2520.09	2475.33	4396019
XCSP19/hcp/ graph171.xml	? (TO)	2520.09	2481.95	4395987
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-7_X2.xml	? (TO)	2520.09	2474.14	4395930
XCSP19/hcp/ graph252.xml	? (TO)	2520.09	2482.55	4395992
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-35-123.xml	? (TO)	2520.09	2482.64	4395985
Bibd/Bibd-sum-stab1/ Bibd-sum-25-05-01.xml	? (TO)	2520.1	2466.56	4395859
Random/Random-RB-3-24-24/ rand-3-24-24-76-632-16.xml	? (TO)	2520.1	2506.33	4395778
LatinSquare/LatinSquare-xcsp2-qcp25/ qcp-25-264-12_X2.xml	? (TO)	2520.1	2471.44	4395825
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-142.xml	? (TO)	2520.1	2471.83	4395820
Haystacks/Haystacks-m1-s1/ Haystacks-39.xml	? (TO)	2520.1	2463.76	4396020
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-01.xml	? (TO)	2520.1	2374.97	4395790
XCSP19/hcp/ graph223.xml	? (TO)	2520.1	2475.98	4395989
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-187.xml	? (TO)	2520.1	2470.73	4395999
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-23.xml	? (TO)	2520.1	2395.37	4395832
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-7_X2.xml	? (TO)	2520.1	2477.74	4395898
KnightTour/KnightTour-ext-s1/ KnightTour-12-ext04.xml	? (TO)	2520.1	2458.53	4396040
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-0_X2.xml	? (TO)	2520.1	2474.33	4395946
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-3_X2.xml	? (TO)	2520.1	2475.43	4395911
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-184.xml	? (TO)	2520.1	2473.65	4395921
PseudoBoolean/PseudoBoolean-dec-fpga/ Pb-chnl10-15.xml	? (TO)	2520.11	2496.62	4395971
PseudoBoolean/PseudoBoolean-dec-armies/ Pb-army12-21ls.xml	? (TO)	2520.11	2478.74	4396032
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-1_X2.xml	? (TO)	2520.11	2474.63	4395927
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-06.xml	? (TO)	2520.11	2424.96	4395848
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-160.xml	? (TO)	2520.11	2468.33	4395899
LatinSquare/LatinSquare-m1-gp/ qwh-o30-h375-20.xml	? (TO)	2520.11	2470.72	4395950
PseudoBoolean/PseudoBoolean-dec-spba/ Pb-BeauxArts-K67.xml	? (TO)	2520.11	2476.64	4395942
PseudoBoolean/PseudoBoolean-dec-pigeon/ Pb-pigeon-clau-011-010.xml	? (TO)	2520.11	2479.03	4395834
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-26.xml	? (TO)	2520.11	2424.56	4395829
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-29-092.xml	? (TO)	2520.11	2485.84	4395984
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-4_X2.xml	? (TO)	2520.11	2475.33	4395947
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-152.xml	? (TO)	2520.11	2471.94	4395902
Random/Random-RB-3-24-24f/ rand-3-24-24-76-632f-49.xml	? (TO)	2520.11	2505.43	4396000
StripPacking/StripPacking-m1-seriesT/ StripPacking-T5c.xml	? (TO)	2520.11	2467.43	4396037
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-9_X2.xml	? (TO)	2520.11	2475.23	4395980
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-28-088.xml	? (TO)	2520.12	2485.83	4395983
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-8_X2.xml	? (TO)	2520.12	2475.63	4395917
Random/Random-B-2-26-26/ rand-2-26-26-325-155-9.xml	? (TO)	2520.12	2480.13	4395885
Bibd/Bibd-sc-stab2/ Bibd-sc-21-06-02.xml	? (TO)	2520.12	2464.92	4396001
PseudoBoolean/PseudoBoolean-dec-armies/ Pb-army13-24ls.xml	? (TO)	2520.12	2480.03	4395939
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-154.xml	? (TO)	2520.12	2472.73	4395886
Bibd/Bibd-sum-open/ Bibd-sum-22-033-12-08-04.xml	? (TO)	2520.12	2467.73	4396010
XCSP19/hcp/ graph255.xml	? (TO)	2520.12	2470.52	4395994
Langford/Langford-m1-k3/ Langford-3-35.xml	? (TO)	2520.12	2472.33	4395976
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-09-m057.xml	? (TO)	2520.12	2479.64	4396013
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07h-6_X2.xml	? (TO)	2520.12	2476.04	4395919
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-85-05.xml	? (TO)	2520.13	2469.93	4395815
Bibd/Bibd-sum-open/ Bibd-sum-40-052-13-10-03.xml	? (TO)	2520.13	2462.3	4396016
Fischer/Fischer-m1-s1/ Fischer-07-07-fair.xml	? (TO)	2520.13	2472.07	4395948
Primes/ Primes-m1-p10/Primes-10-60-3-7.xml	? (TO)	2520.13	2477.44	4395933
KnightTour/KnightTour-int-s1/ KnightTour-08-int.xml	? (TO)	2520.13	2467.73	4395895
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-2_X2.xml	? (TO)	2520.13	2475.34	4395967
PseudoBoolean/PseudoBoolean-dec-sptate/ Pb-Tate-K097.xml	? (TO)	2520.13	2476.66	4395979
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-5-5-9-cp.xml	? (TO)	2520.13	2480.94	4395814
Rlfap/ Rlfap-m1-scens11/Rlfap-scen-11-f04.xml	? (TO)	2520.13	2471.47	4395793
Crossword/ Crossword-m1c-uk-vg/Crossword-m1c-uk-vg-10-13.xml	? (TO)	2520.13	2506.15	4396006
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-097.xml	? (TO)	2520.13	2467.04	4395823
NumberPartitioning/NumberPartitioning-m1-s1/ NumberPartitioning-164.xml	? (TO)	2520.13	2456.74	4396031
PseudoBoolean/PseudoBoolean-dec-spng/ Pb-NG-K146.xml	? (TO)	2520.13	2465.99	4396012
Fischer/Fischer-m1-s1/ Fischer-08-07-fair.xml	? (TO)	2520.13	2470.08	4395965
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-26.xml	? (TO)	2520.13	2458.76	4395966
XCSP19/hcp/ graph249.xml	? (TO)	2520.13	2469.3	4395991
Fischer/Fischer-m1-s1/ Fischer-09-06-fair.xml	? (TO)	2520.13	2468.04	4395975
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-194.xml	? (TO)	2520.13	2468.63	4396036
Langford/Langford-m2-s1/ LangfordBin-25.xml	? (TO)	2520.13	2502.32	4396030
QuasiGroups/QuasiGroups-elt-qg7/ QuasiGroup-7-39.xml	? (TO)	2520.13	2464.8	4396017
Fischer/Fischer-m1-s1/ Fischer-10-06-fair.xml	? (TO)	2520.14	2468.65	4395931
Bibd/Bibd-sum-lex/ Bibd-sum-09-120-40-03-10.xml	? (TO)	2520.14	2477.94	4395769
SuperSolutions/SuperSolutions-Taillard-os10/ SuperTaillard-os-10-21.xml	? (TO)	2520.14	2312.27	4395843
Fischer/Fischer-m1-s1/ Fischer-06-08-fair.xml	? (TO)	2520.14	2468.25	4395934
Blackhole/Blackhole-xcsp2-s07/ Blackhole-4-07-1_X2.xml	? (TO)	2520.14	2476.43	4395938
StripPacking/StripPacking-m1-seriesN/ StripPacking-N1c.xml	? (TO)	2520.14	2470.04	4395905
Sat/Sat-m1-various/ hole-10.xml	? (TO)	2520.14	2484.33	4395855
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-24-071.xml	? (TO)	2520.14	2485.82	4395772
XCSP19/ConsecutiveSquarePacking/ ConsecutiveSquarePacking-sp-15-035.xml	? (TO)	2520.14	2484.74	4395742
RectPacking/RectPacking-m1-perf/ RectPacking-perfect-126.xml	? (TO)	2520.14	2467.83	4395783
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-8-5-6-cp.xml	? (TO)	2520.14	2479.05	4395869
Bibd/Bibd-sum-open/ Bibd-sum-57-076-20-15-05.xml	? (TO)	2520.14	2446.39	4396021
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-08.xml	? (TO)	2520.15	2457.84	4395901
CarSequencing/CarSequencing-m1-jcr/ CarSequencing-75-09.xml	? (TO)	2520.15	2471.05	4395847
XCSP19/hcp/ graph48.xml	? (TO)	2520.15	2471.53	4395995
Random/Random-m1-7-40-8t/ rand-7-40-8-40-22500-0.xml	? (TO)	2520.16	2505.56	4395996
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-13.xml	? (TO)	2520.16	2457.65	4395853
PseudoBoolean/PseudoBoolean-dec-fpga/ Pb-fpga45-44-sat.xml	? (TO)	2520.16	2475.05	4395800
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	? (TO)	2520.16	2473.28	4395766
LatinSquare/LatinSquare-xcsp2-qcp25/ qcp-25-264-08_X2.xml	? (TO)	2520.16	2470.35	4395836
Primes/ Primes-m1-p15/Primes-15-40-3-5.xml	? (TO)	2520.16	2485.14	4396038
SuperSolutions/SuperSolutions-Taillard-js15/ SuperTaillard-js-15-18.xml	? (TO)	2520.17	2458.58	4395798
MagicHexagon/MagicHexagon-m1-s1/ MagicHexagon-08-m039.xml	? (TO)	2520.17	2460.04	4396005
PseudoBoolean/PseudoBoolean-dec-sptate/ Pb-Tate-K100.xml	? (TO)	2520.18	2472.66	4395906
Fischer/Fischer-m1-s1/ Fischer-11-05-fair.xml	? (TO)	2520.18	2467.28	4395957
XCSP19/hcp/ graph254.xml	? (TO)	2520.19	2471.62	4395993
XCSP19/hcp/ graph237.xml	? (TO)	2520.21	2481.63	4395990
SocialGolfers/SocialGolfers-cp-s1/ SocialGolfers-8-9-9-cp.xml	? (TO)	2520.21	2458.69	4395837
SuperSolutions/SuperSolutions-Taillard-js20/ SuperTaillard-js-20-10.xml	? (TO)	2520.25	2442.75	4396034
SuperSolutions/SuperSolutions-Taillard-os20/ SuperTaillard-os-20-02.xml	? (TO)	2520.3	2477.23	4396025
SuperSolutions/SuperSolutions-Taillard-js20/ SuperTaillard-js-20-20.xml	? (TO)	2520.33	2448.78	4396039
Bibd/Bibd-sc-open/ Bibd-sc-85-085-36-36-15.xml	? (TO)	2520.44	2357.93	4396014
LatinSquare/LatinSquare-m1-gs/ qwh-o100-h10000.xml	? (TO)	2520.44	2434.52	4396029
Bibd/Bibd-sum-open/ Bibd-sum-85-085-36-36-15.xml	? (TO)	2520.8	2325.39	4396033
PropStress/PropStress-m1-s1/ PropStress-0400.xml	? (TO)	2522.05	2430.63	4395940
PropStress/PropStress-m1-s1/ PropStress-0450.xml	? (TO)	2522.1	2496.13	4395926
QuasiGroups/QuasiGroups-elt-qg3/ QuasiGroup-3-40.xml	? (TO)	2523.22	1473.74	4396015
RoomMate/ RoomMate-int-s1/RoomMate-sr1000-int.xml	? (TO)	2526.93	845.953	4395952
RoomMate/ RoomMate-int-s1/RoomMate-sr0700d-int.xml	? (TO)	2526.94	866.059	4395808
RoomMate/ RoomMate-int-s1/RoomMate-sr0600-int.xml	? (TO)	2527.18	877.761	4395871
RoomMate/ RoomMate-int-s1/RoomMate-sr1000b-int.xml	? (TO)	2527.21	846.248	4395951
RoomMate/ RoomMate-int-s1/RoomMate-sr1000e-int.xml	? (TO)	2528.25	844.95	4395978
RoomMate/ RoomMate-int-s1/RoomMate-sr1000c-int.xml	? (TO)	2528.3	852.162	4395914

2019 XCSP3 competition: main track (CSP and COP, sequential and parallel solvers): benchmarks results per solver

Result page for solver Concrete 3.12.2 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (122 runs) [Show/Hide]

Solver timed out but found at least a solution (144 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (1 run) [Show/Hide]

Solver timed out (no solution given) (32 runs) [Show/Hide]

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (39 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (94 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (8 runs) [Show/Hide]

Solver timed out (no solution given) (159 runs) [Show/Hide]