MAX-CSP 2008 Competition: benchmarks results per solver

Benchmark Name	Answer	Number of falsified constraints	CPU time	Wall clock time	TraceID
maxcsp/spot5/ normalized-spot5-8_ext.xml	OPTIMUM	1	0.006998	0.0122831	1126526
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/ normalized-kbtree-9-7-3-5-10-04_ext.xml	OPTIMUM	0	0.016996	0.0203461	1128118
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/ normalized-kbtree-9-7-3-5-10-08_ext.xml	OPTIMUM	0	0.016997	0.0205939	1128110
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-10/ normalized-kbtree-9-7-3-5-10-25_ext.xml	OPTIMUM	0	0.016997	0.0202791	1128126
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/ normalized-kbtree-5-2-4-5-10-18_ext.xml	OPTIMUM	0	0.018996	0.0220869	1128094
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/ normalized-kbtree-5-2-4-5-10-23_ext.xml	OPTIMUM	0	0.018997	0.019197	1128102
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/ normalized-kbtree-9-5-3-5-10-18_ext.xml	OPTIMUM	0	0.019996	0.026424	1128630
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/ normalized-kbtree-9-5-3-5-10-36_ext.xml	OPTIMUM	0	0.019996	0.026946	1128614
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-10/ normalized-kbtree-5-2-4-5-10-26_ext.xml	OPTIMUM	0	0.019996	0.019593	1128086
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/ normalized-kbtree-5-2-4-5-20-08_ext.xml	OPTIMUM	0	0.020996	0.0272321	1128062
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-10/ normalized-kbtree-9-5-3-5-10-31_ext.xml	OPTIMUM	0	0.020996	0.027031	1128622
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/ normalized-kbtree-9-2-3-5-10-35_ext.xml	OPTIMUM	0	0.020996	0.0291519	1128494
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/ normalized-kbtree-9-2-3-5-10-26_ext.xml	OPTIMUM	0	0.021996	0.0222271	1128502
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/ normalized-kbtree-5-2-4-5-20-38_ext.xml	OPTIMUM	0	0.021996	0.0282749	1128078
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-20/ normalized-kbtree-5-2-4-5-20-50_ext.xml	OPTIMUM	0	0.023995	0.0292461	1128070
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-10/ normalized-kbtree-9-2-3-5-10-38_ext.xml	OPTIMUM	0	0.023996	0.02353	1128510
maxcsp/planning/ normalized-depot01cc_ext.xml	OPTIMUM	3	0.024995	0.0244979	1125654
maxcsp/planning/ normalized-mprime03bc_ext.xml	OPTIMUM	3	0.024995	0.0322369	1125774
maxcsp/planning/ normalized-mprime03cc_ext.xml	OPTIMUM	3	0.024995	0.031593	1125974
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/ normalized-kbtree-5-2-4-5-30-25_ext.xml	OPTIMUM	0	0.024995	0.0291321	1127998
maxcsp/planning/ normalized-mprime03c_ext.xml	OPTIMUM	3	0.025995	0.031807	1125574
maxcsp/planning/ normalized-driverlog01cc_ext.xml	OPTIMUM	3	0.025995	0.032684	1125838
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-30.xml	OPTIMUM	2	0.026995	0.032482	1124462
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/ normalized-kbtree-9-7-3-5-20-23_ext.xml	OPTIMUM	1	0.027995	0.0342609	1128198
csp/coloring/ normalized-geom-40-2-ext.xml	OPTIMUM	22	0.029995	0.0359159	1108542
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/ normalized-kbtree-9-5-3-5-20-13_ext.xml	OPTIMUM	1	0.033994	0.0405781	1128718
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-38.xml	OPTIMUM	2	0.033994	0.040648	1125110
maxcsp/warehouses/ normalized-cap44_ext.xml	OPTIMUM	0	0.034994	0.0531259	1127022
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/ normalized-kbtree-5-2-4-5-30-47_ext.xml	OPTIMUM	0	0.034994	0.0408321	1127990
csp/composed-25-1-40/ normalized-composed-25-1-40-0_ext.xml	OPTIMUM	1	0.037993	0.0384099	1114838
maxcsp/maxclique/ normalized-johnson-8-2-4_ext.xml	OPTIMUM	24	0.037994	0.0415	1126278
maxcsp/warehouses/ normalized-cap62_ext.xml	OPTIMUM	0	0.038993	0.044983	1126998
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/ normalized-kbtree-9-5-3-5-20-21_ext.xml	OPTIMUM	1	0.039993	0.0468739	1128710
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/ normalized-kbtree-9-7-3-5-20-12_ext.xml	OPTIMUM	1	0.040993	0.0468601	1128190
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-36.xml	OPTIMUM	1	0.042992	0.0503519	1124638
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/ normalized-kbtree-9-2-3-5-20-15_ext.xml	OPTIMUM	0	0.042993	0.046044	1128486
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-17.xml	OPTIMUM	2	0.043992	0.0514359	1124910
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/ normalized-kbtree-9-2-3-5-20-02_ext.xml	OPTIMUM	0	0.046992	0.055189	1128478
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-68.xml	OPTIMUM	2	0.047992	0.053049	1124758
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-94.xml	OPTIMUM	1	0.053991	0.059865	1125134
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-13.xml	OPTIMUM	2	0.054991	0.0613041	1124950
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-300-182024_ext.xml	OPTIMUM	35	0.056991	0.064338	1127478
maxcsp/warehouses/ normalized-cap102_ext.xml	OPTIMUM	0	0.057991	0.066149	1126838
maxcsp/warehouses/ normalized-cap91_ext.xml	OPTIMUM	0	0.05899	0.068575	1127134
maxcsp/warehouses/ normalized-cap104_ext.xml	OPTIMUM	0	0.05899	0.061173	1126974
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-300-182021_ext.xml	OPTIMUM	35	0.05899	0.0680871	1127502
maxcsp/pi/pi-20-10-20-t60/ normalized-pi-20-10-20-40-28.xml	OPTIMUM	2	0.059989	0.0629279	1124862
csp/composed-25-1-2/ normalized-composed-25-1-2-6_ext.xml	OPTIMUM	2	0.05999	0.066199	1114622
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-300-182022_ext.xml	OPTIMUM	34	0.05999	0.064349	1127462
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-30/ normalized-kbtree-5-2-4-5-30-35_ext.xml	OPTIMUM	0	0.05999	0.063157	1128006
maxcsp/warehouses/ normalized-cap92_ext.xml	OPTIMUM	0	0.061989	0.0679031	1126766
maxcsp/warehouses/ normalized-cap93_ext.xml	OPTIMUM	0	0.062989	0.0686179	1126742
maxcsp/warehouses/ normalized-cap103_ext.xml	OPTIMUM	0	0.062989	0.0689749	1126870
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-20/ normalized-kbtree-9-7-3-5-20-40_ext.xml	OPTIMUM	2	0.06499	0.070689	1128182
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-20/ normalized-kbtree-9-2-3-5-20-01_ext.xml	OPTIMUM	0	0.065989	0.0650261	1128470
maxcsp/celar/subs7/ normalized-scenw-7-sub1-20_ext.xml	OPTIMUM	16	0.078987	0.078391	1125294
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-18.xml	OPTIMUM	8	0.079987	0.086076	1123430
csp/composed-25-1-2/ normalized-composed-25-1-2-8_ext.xml	OPTIMUM	2	0.094984	0.18995	1114590
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-43.xml	OPTIMUM	7	0.100984	0.106911	1123270
csp/composed-25-1-25/ normalized-composed-25-1-25-3_ext.xml	OPTIMUM	2	0.103983	0.109295	1114262
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/ normalized-kbtree-9-7-3-5-30-27_ext.xml	OPTIMUM	5	0.105983	0.114341	1128318
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-37.xml	OPTIMUM	5	0.107983	0.112893	1123534
csp/composed-25-1-80/ normalized-composed-25-1-80-8_ext.xml	OPTIMUM	2	0.111982	0.112914	1114542
csp/composed-75-1-80/ normalized-composed-75-1-80-8_ext.xml	OPTIMUM	2	0.114982	0.121055	1115142
maxcsp/celar/subs6/ normalized-scenw-6-sub1-24_ext.xml	OPTIMUM	18	0.116981	0.12421	1125398
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-39.xml	OPTIMUM	6	0.12498	0.131639	1123054
maxcsp/celar/subs7/ normalized-scenw-7-sub0_ext.xml	OPTIMUM	4	0.127979	0.131612	1125326
csp/composed-25-1-40/ normalized-composed-25-1-40-4_ext.xml	OPTIMUM	2	0.130979	0.137922	1114846
maxcsp/celar/subs6/ normalized-scenw-6-sub4-20_ext.xml	OPTIMUM	23	0.131979	0.139057	1125422
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-20/ normalized-kbtree-9-5-3-5-20-04_ext.xml	OPTIMUM	0	0.133978	0.140677	1128726
csp/composed-25-1-25/ normalized-composed-25-1-25-6_ext.xml	OPTIMUM	2	0.134979	0.140933	1114254
csp/coloring/ normalized-geom-40-3-ext.xml	OPTIMUM	7	0.140978	0.146673	1108534
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/ normalized-kbtree-9-7-3-5-30-25_ext.xml	OPTIMUM	7	0.140978	0.148992	1128310
csp/composed-25-1-80/ normalized-composed-25-1-80-2_ext.xml	OPTIMUM	2	0.143977	0.149182	1114510
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-4.xml	OPTIMUM	7	0.145977	0.152309	1122894
maxcsp/celar/subs6/ normalized-scenw-6-sub0_ext.xml	OPTIMUM	6	0.147977	0.15441	1125406
maxcsp/planning/ normalized-zenotravel02bc_ext.xml	OPTIMUM	3	0.169973	0.176237	1125446
csp/composed-75-1-80/ normalized-composed-75-1-80-1_ext.xml	OPTIMUM	2	0.176972	0.193573	1115150
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-81.xml	OPTIMUM	7	0.178972	0.184747	1122830
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-61.xml	OPTIMUM	7	0.178972	0.183249	1123030
maxcsp/warehouses/ normalized-cap113_ext.xml	OPTIMUM	0	0.186971	0.194606	1126950
maxcsp/celar/subs7/ normalized-scenw-7-sub1_ext.xml	OPTIMUM	18	0.187971	0.194706	1125318
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-35_ext.xml	OPTIMUM	19	0.194969	0.201063	1116294
maxcsp/warehouses/ normalized-cap122_ext.xml	OPTIMUM	0	0.200969	0.20437	1126774
maxcsp/pi/pi-20-10-20-t70/ normalized-pi-20-10-20-30-64.xml	OPTIMUM	8	0.215966	0.222332	1123246
csp/coloring/ normalized-geom-40-4-ext.xml	OPTIMUM	3	0.215966	0.22138	1108550
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-33_ext.xml	OPTIMUM	19	0.218966	0.225236	1116214
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-400-907730_ext.xml	OPTIMUM	57	0.221966	0.222325	1127486
csp/composed-25-1-25/ normalized-composed-25-1-25-8_ext.xml	OPTIMUM	2	0.225965	0.238121	1114278
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-800-810521_ext.xml	OPTIMUM	107	0.237963	0.241858	1127454
maxcsp/celar/subs7/ normalized-scenw-7-sub4-22_ext.xml	OPTIMUM	19	0.245961	0.252001	1125334
maxcsp/maxclique/ normalized-hamming-10-2_ext.xml	OPTIMUM	512	0.245962	0.250226	1126270
csp/composed-25-1-80/ normalized-composed-25-1-80-9_ext.xml	OPTIMUM	2	0.251961	0.261594	1114534
maxcsp/celar/subs6/ normalized-scenw-6-sub1_ext.xml	OPTIMUM	22	0.25696	0.263857	1125414
csp/composed-25-1-40/ normalized-composed-25-1-40-5_ext.xml	OPTIMUM	2	0.25896	0.266828	1114862
csp/composed-75-1-25/ normalized-composed-75-1-25-9_ext.xml	OPTIMUM	2	0.272958	0.280058	1114646
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-17.xml	OPTIMUM	2	0.274957	0.28049	1121270
csp/composed-75-1-80/ normalized-composed-75-1-80-9_ext.xml	OPTIMUM	2	0.294954	0.303207	1115126
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-500-633422_ext.xml	OPTIMUM	65	0.295954	0.303182	1127470
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/ normalized-kbtree-9-7-3-5-90-08_ext.xml	OPTIMUM	123	0.310951	0.316759	1128214
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/ normalized-kbtree-9-7-3-5-50-42_ext.xml	OPTIMUM	30	0.315951	0.326125	1128134
csp/coloring/ normalized-geom-30a-4-ext.xml	OPTIMUM	4	0.32295	0.329358	1108582
csp/composed-75-1-2/ normalized-composed-75-1-2-7_ext.xml	OPTIMUM	1	0.329948	0.336751	1114302
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-600-359126_ext.xml	OPTIMUM	83	0.333948	0.344357	1127494
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/ normalized-kbtree-9-7-3-5-60-01_ext.xml	OPTIMUM	54	0.334948	0.342688	1128166
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/ normalized-kbtree-9-7-3-5-90-11_ext.xml	OPTIMUM	123	0.337948	0.35008	1128206
csp/composed-75-1-40/ normalized-composed-75-1-40-2_ext.xml	OPTIMUM	2	0.339948	0.3458	1114582
maxcsp/celar/subs6/ normalized-scenw-6-sub2_ext.xml	OPTIMUM	22	0.373942	0.383916	1125390
maxcsp/celar/subs7/ normalized-scenw-7-sub2_ext.xml	OPTIMUM	18	0.38894	0.401512	1125286
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-44_ext.xml	OPTIMUM	2	0.393939	0.395098	1117526
csp/composed-75-1-2/ normalized-composed-75-1-2-2_ext.xml	OPTIMUM	2	0.404938	0.410833	1114318
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-92.xml	OPTIMUM	1	0.413936	0.428385	1121774
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-30/ normalized-kbtree-9-7-3-5-30-10_ext.xml	OPTIMUM	9	0.436933	0.442747	1128302
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-93.xml	OPTIMUM	1	0.44793	0.456792	1121382
csp/composed-75-1-40/ normalized-composed-75-1-40-9_ext.xml	OPTIMUM	2	0.469927	0.480563	1114558
maxcsp/planning/ normalized-rovers02ac_ext.xml	OPTIMUM	3	0.502922	0.508454	1125486
csp/composed-25-1-2/ normalized-composed-25-1-2-7_ext.xml	OPTIMUM	2	0.504923	0.510526	1114598
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/ normalized-kbtree-9-7-3-5-80-04_ext.xml	OPTIMUM	100	0.528919	0.538159	1128286
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-15_ext.xml	OPTIMUM	19	0.563914	0.569941	1116390
maxcsp/cnf/2-40-100-1000/ normalized-cnf-2-40-800-810527_ext.xml	OPTIMUM	113	0.564914	0.57612	1127446
maxcsp/celar/subs6/ normalized-scenw-6-sub3_ext.xml	OPTIMUM	24	0.565913	0.570841	1125438
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/ normalized-kbtree-9-7-3-5-40-34_ext.xml	OPTIMUM	23	0.576911	0.58803	1128230
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-300-186944_ext.xml	OPTIMUM	22	0.58591	0.594352	1127830
maxcsp/planning/ normalized-zenotravel04ac_ext.xml	OPTIMUM	5	0.595909	0.607426	1125790
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-26.xml	OPTIMUM	2	0.617905	0.626134	1121294
maxcsp/celar/scens/ normalized-scenw-06-30reduc_ext.xml	OPTIMUM	2	0.630903	0.635616	1125230
maxcsp/celar/subs6/ normalized-scenw-6-sub4_ext.xml	OPTIMUM	24	0.6539	0.664862	1125430
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-6.xml	OPTIMUM	2	0.660898	0.668473	1122230
maxcsp/celar/graphs/ normalized-graphw-07_ext.xml	OPTIMUM	122	0.674897	0.690092	1125366
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-98.xml	OPTIMUM	2	0.674897	0.678132	1121854
maxcsp/celar/scens/ normalized-scenw-06-30_ext.xml	OPTIMUM	21	0.699892	0.702692	1125206
maxcsp/celar/subs7/ normalized-scenw-7-sub3_ext.xml	OPTIMUM	20	0.71489	0.726435	1125310
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-43.xml	OPTIMUM	3	0.753884	0.765917	1121566
maxcsp/celar/subs7/ normalized-scenw-7-sub4_ext.xml	OPTIMUM	20	0.791879	0.803467	1125302
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-37.xml	OPTIMUM	1	0.797878	0.80509	1122646
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/ normalized-kbtree-9-2-3-5-30-34_ext.xml	OPTIMUM	6	0.821874	0.831521	1128518
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-24_ext.xml	OPTIMUM	19	0.824873	0.836863	1116310
maxcsp/celar/scens/ normalized-scenw-10_ext.xml	OPTIMUM	94	0.842871	0.860306	1125246
maxcsp/celar/scens/ normalized-scenw-09_ext.xml	OPTIMUM	94	0.844871	0.860744	1125214
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/ normalized-kbtree-9-7-3-5-80-50_ext.xml	OPTIMUM	97	0.845871	0.855982	1128278
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1100-987629_ext.xml	OPTIMUM	159	0.85087	0.858665	1127734
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/ normalized-kbtree-5-2-4-5-40-16_ext.xml	OPTIMUM	10	0.861868	0.874957	1128046
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-38_ext.xml	OPTIMUM	29	0.873866	0.874456	1115382
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-39_ext.xml	OPTIMUM	3	0.881865	0.89142	1117510
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-73.xml	OPTIMUM	2	0.882865	0.888464	1121750
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-20_ext.xml	OPTIMUM	20	0.887864	0.894031	1116126
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/ normalized-kbtree-9-7-3-5-70-43_ext.xml	OPTIMUM	73	0.991848	0.997643	1128254
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-33_ext.xml	OPTIMUM	2	1.03084	1.0422	1117542
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-300-186945_ext.xml	OPTIMUM	25	1.03284	1.04165	1127838
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-27_ext.xml	OPTIMUM	20	1.05584	1.07377	1116342
maxcsp/celar/graphs/ normalized-graphw-12_ext.xml	OPTIMUM	203	1.05884	1.06397	1125358
maxcsp/planning/ normalized-mprime04bc_ext.xml	OPTIMUM	3	1.07883	1.08877	1126006
maxcsp/planning/ normalized-mprime04ac_ext.xml	OPTIMUM	3	1.08783	1.09248	1125766
csp/composed-75-1-25/ normalized-composed-75-1-25-4_ext.xml	OPTIMUM	2	1.12883	1.14312	1114630
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-22_ext.xml	OPTIMUM	29	1.13183	1.14845	1115334
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/ normalized-kbtree-5-2-4-5-80-41_ext.xml	OPTIMUM	86	1.15282	1.16992	1127974
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-80/ normalized-kbtree-9-7-3-5-80-05_ext.xml	OPTIMUM	104	1.21781	1.23325	1128294
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/ normalized-kbtree-9-5-3-5-30-13_ext.xml	OPTIMUM	12	1.21981	1.23156	1128678
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/ normalized-kbtree-9-7-3-5-50-39_ext.xml	OPTIMUM	37	1.22281	1.23978	1128142
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-93.xml	OPTIMUM	3	1.24581	1.25986	1122678
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/ normalized-kbtree-9-5-3-5-30-37_ext.xml	OPTIMUM	9	1.26781	1.28297	1128662
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/ normalized-kbtree-9-7-3-5-70-33_ext.xml	OPTIMUM	74	1.3288	1.34119	1128270
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/ normalized-kbtree-9-7-3-5-60-16_ext.xml	OPTIMUM	62	1.3358	1.34942	1128174
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-43_ext.xml	OPTIMUM	19	1.35379	1.36761	1116198
maxcsp/maxclique/ normalized-c-fat200-2_ext.xml	OPTIMUM	176	1.36779	1.38807	1126294
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-42_ext.xml	OPTIMUM	2	1.37579	1.3918	1117198
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1800-067529_ext.xml	OPTIMUM	246	1.41778	1.43549	1127710
maxcsp/pi/pi-40-10-08-t60/ normalized-pi-40-10-07948-40-22.xml	OPTIMUM	3	1.43178	1.43077	1121222
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/ normalized-kbtree-9-7-3-5-40-49_ext.xml	OPTIMUM	22	1.43378	1.44597	1128238
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-88.xml	OPTIMUM	2	1.44178	1.44738	1122590
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-21_ext.xml	OPTIMUM	29	1.47578	1.49151	1115310
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	OPTIMUM	1	1.49177	1.49604	1108270
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	OPTIMUM	1	1.49477	1.51418	1108262
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-29.xml	OPTIMUM	2	1.50577	1.52401	1122726
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	OPTIMUM	1	1.51277	1.51911	1108246
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1500-890427_ext.xml	OPTIMUM	210	1.52277	1.54031	1127750
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2400-421722_ext.xml	OPTIMUM	279	1.53877	1.54641	1127262
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-16_ext.xml	OPTIMUM	30	1.54377	1.56137	1115590
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-70/ normalized-kbtree-9-7-3-5-70-50_ext.xml	OPTIMUM	72	1.57976	1.60294	1128262
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-50/ normalized-kbtree-9-7-3-5-50-13_ext.xml	OPTIMUM	36	1.58776	1.60224	1128150
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	OPTIMUM	1	1.59076	1.6017	1108222
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-40/ normalized-kbtree-9-7-3-5-40-39_ext.xml	OPTIMUM	23	1.59576	1.63029	1128246
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	OPTIMUM	1	1.59976	1.62084	1108254
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	OPTIMUM	1	1.60076	1.62059	1108294
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	OPTIMUM	1	1.61375	1.63361	1108286
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	OPTIMUM	1	1.61675	1.63266	1108278
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	OPTIMUM	1	1.62275	1.63991	1108238
maxcsp/celar/graphs/ normalized-graphw-05_ext.xml	OPTIMUM	5	1.62875	1.65408	1125382
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	OPTIMUM	1	1.63975	1.65902	1108230
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-11_ext.xml	OPTIMUM	3	1.64775	1.66669	1117574
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1600-616124_ext.xml	OPTIMUM	220	1.65875	1.6696	1127726
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-36_ext.xml	OPTIMUM	29	1.85672	1.87653	1115422
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-61.xml	OPTIMUM	2	1.87871	1.88411	1121990
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1600-616123-ext.xml	OPTIMUM	227	1.88871	1.90995	1127718
maxcsp/randomMaxCSP/sparseTight/ normalized-vcsp-25-10-21-85-48_ext.xml	OPTIMUM	21	1.9827	2.00808	1116414
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1100-987630_ext.xml	OPTIMUM	162	2.03169	2.05218	1127758
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-40-10-13-60-24_ext.xml	OPTIMUM	3	2.03569	2.04755	1116742
csp/composed-75-1-25/ normalized-composed-75-1-25-6_ext.xml	OPTIMUM	2	2.03769	2.05331	1114638
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/ normalized-kbtree-5-2-4-5-40-23_ext.xml	OPTIMUM	7	2.13567	2.15793	1128054
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-90/ normalized-kbtree-9-7-3-5-90-27_ext.xml	OPTIMUM	127	2.13967	2.16482	1128222
maxcsp/warehouses/ normalized-capmo3_ext.xml	OPTIMUM	1	2.14667	2.16066	1126750
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-40/ normalized-kbtree-5-2-4-5-40-32_ext.xml	OPTIMUM	10	2.20466	2.22904	1128038
maxcsp/warehouses/ normalized-capmo4_ext.xml	OPTIMUM	1	2.25166	2.2811	1126758
maxcsp/warehouses/ normalized-capmo5_ext.xml	OPTIMUM	1	2.25966	2.278	1127006
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2500-147426_ext.xml	OPTIMUM	307	2.29765	2.31365	1127294
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2900-050223-ext.xml	OPTIMUM	289	2.38464	2.39904	1127286
maxcsp/kbtree/kbtree-9-7-3-5/kbtree-9-7-3-5-60/ normalized-kbtree-9-7-3-5-60-19_ext.xml	OPTIMUM	59	2.41863	2.4367	1128158
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-15_ext.xml	OPTIMUM	2	2.76358	2.91691	1117414
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/ normalized-kbtree-9-5-3-5-90-45_ext.xml	OPTIMUM	163	2.87456	2.89971	1128702
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-9_ext.xml	OPTIMUM	29	3.03354	3.04782	1115270
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/ normalized-kbtree-5-2-4-5-90-34_ext.xml	OPTIMUM	121	3.17052	3.20936	1127958
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-40-10-13-60-14_ext.xml	OPTIMUM	4	3.24351	3.27668	1116822
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/ normalized-kbtree-9-5-3-5-90-47_ext.xml	OPTIMUM	164	3.3055	3.34528	1128686
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-90/ normalized-kbtree-9-5-3-5-90-10_ext.xml	OPTIMUM	167	3.41848	3.45866	1128694
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-30/ normalized-kbtree-9-5-3-5-30-06_ext.xml	OPTIMUM	10	3.47647	3.72601	1128670
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/ normalized-kbtree-9-5-3-5-60-23_ext.xml	OPTIMUM	76	3.59345	3.63279	1128550
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-40-10-13-60-4_ext.xml	OPTIMUM	3	3.70044	3.73412	1116622
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2600-873121_ext.xml	OPTIMUM	297	3.74243	3.78696	1127254
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2400-421728_ext.xml	OPTIMUM	291	3.9254	3.94208	1127278
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-36.xml	OPTIMUM	2	3.9654	3.9743	1122078
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/ normalized-kbtree-5-2-4-5-90-13_ext.xml	OPTIMUM	121	4.07538	4.08202	1127950
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-49_ext.xml	OPTIMUM	31	4.08938	4.11661	1115406
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1900-793226_ext.xml	OPTIMUM	253	4.10238	4.52473	1127702
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/ normalized-kbtree-9-5-3-5-70-09_ext.xml	OPTIMUM	94	4.29835	4.30073	1128582
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2300-96030_ext.xml	OPTIMUM	276	4.33434	4.38247	1127310
maxcsp/pi/pi-30-10-25-t48/ normalized-pi-30-10-197-52-22.xml	OPTIMUM	3	4.37333	4.58981	1122142
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-21_ext.xml	OPTIMUM	3	4.53431	4.58763	1117262
maxcsp/randomMaxCSP/denseLoose/ normalized-vcsp-30-10-25-48-32_ext.xml	OPTIMUM	4	4.94425	4.95656	1117494
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-23_ext.xml	OPTIMUM	70	4.96924	5.03964	1115726
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/ normalized-kbtree-9-5-3-5-80-47_ext.xml	OPTIMUM	129	5.11722	5.16448	1128654
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2400-421727_ext.xml	OPTIMUM	284	5.19821	5.2479	1127302
maxcsp/randomMaxCSP/denseTight/ normalized-vcsp-25-10-25-87-44_ext.xml	OPTIMUM	32	5.84211	5.87198	1115542
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-90/ normalized-kbtree-5-2-4-5-90-08_ext.xml	OPTIMUM	119	5.9311	5.98305	1127942
maxcsp/planning/ normalized-driverlog08cc_ext.xml	OPTIMUM	7	6.13907	6.20104	1125614
maxcsp/celar/scens/ normalized-scenw-06-24_ext.xml	OPTIMUM	22	6.18006	6.22185	1125182
maxcsp/planning/ normalized-driverlog08c_ext.xml	OPTIMUM	7	6.39403	6.47598	1125886
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/ normalized-kbtree-5-2-4-5-60-36_ext.xml	OPTIMUM	41	6.564	6.63167	1127934
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/ normalized-kbtree-9-5-3-5-80-08_ext.xml	OPTIMUM	134	6.597	6.63233	1128638
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-60-10-8-60-4_ext.xml	OPTIMUM	3	6.79497	6.8682	1117070
maxcsp/cnf/2-40-1100-2000/ normalized-cnf-2-40-1500-890423-ext.xml	OPTIMUM	217	6.82396	6.88489	1127742
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-47_ext.xml	OPTIMUM	71	7.07692	7.55759	1115662
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-60-10-8-60-1_ext.xml	OPTIMUM	1	7.13691	7.20043	1117142
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/ normalized-kbtree-5-2-4-5-50-14_ext.xml	OPTIMUM	18	7.27589	7.34888	1128014
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/ normalized-kbtree-9-5-3-5-70-23_ext.xml	OPTIMUM	99	7.29489	7.36096	1128566
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/ normalized-kbtree-5-2-4-5-50-16_ext.xml	OPTIMUM	18	7.30689	7.87911	1128022
maxcsp/celar/scens/ normalized-scenw-06-22_ext.xml	OPTIMUM	22	7.60484	7.68387	1125270
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/ normalized-kbtree-5-2-4-5-60-34_ext.xml	OPTIMUM	39	8.15176	9.06979	1127918
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-23.xml	OPTIMUM	8	8.5337	8.64406	1124134
maxcsp/celar/scens/ normalized-scenw-06-20_ext.xml	OPTIMUM	24	8.71467	8.77391	1125190
csp/composed-75-1-2/ normalized-composed-75-1-2-0_ext.xml	OPTIMUM	2	9.01863	9.10713	1114294
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-17.xml	OPTIMUM	9	9.16261	9.61675	1123686
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/ normalized-kbtree-5-2-4-5-80-06_ext.xml	OPTIMUM	90	9.90149	9.96501	1127966
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-50/ normalized-kbtree-5-2-4-5-50-22_ext.xml	OPTIMUM	19	10.1485	10.3442	1128030
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-15.xml	OPTIMUM	10	10.2024	10.3049	1123958
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/ normalized-kbtree-9-2-3-5-30-08_ext.xml	OPTIMUM	7	10.2424	10.3329	1128526
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-8_ext.xml	OPTIMUM	71	10.2754	10.3749	1115718
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/ normalized-kbtree-9-5-3-5-50-28_ext.xml	OPTIMUM	46	10.6634	10.7622	1128742
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/ normalized-kbtree-9-5-3-5-40-23_ext.xml	OPTIMUM	29	10.7044	11.0126	1128590
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-20_ext.xml	OPTIMUM	73	10.7594	10.8127	1115870
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-41_ext.xml	OPTIMUM	72	10.7754	10.8273	1115926
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/ normalized-kbtree-5-2-4-5-70-37_ext.xml	OPTIMUM	59	10.8404	10.8958	1127910
maxcsp/cnf/2-40-2100-3000/ normalized-cnf-2-40-2500-147422_ext.xml	OPTIMUM	294	11.7342	11.7588	1127270
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-14_ext.xml	OPTIMUM	73	12.3021	12.4562	1115702
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-600-364043_ext.xml	OPTIMUM	63	12.6151	12.6803	1127870
maxcsp/maxclique/ normalized-c-fat500-10_ext.xml	OPTIMUM	374	14.0389	14.1213	1126366
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/ normalized-kbtree-9-5-3-5-60-05_ext.xml	OPTIMUM	74	14.7168	14.8423	1128542
maxcsp/planning/ normalized-driverlog04cc_ext.xml	OPTIMUM	6	15.3877	15.4643	1125462
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-19_ext.xml	OPTIMUM	1	15.9356	16.0757	1114822
csp/coloring/ normalized-myciel-5g-4-ext.xml	OPTIMUM	4	16.6535	16.7929	1108502
csp/composed-75-1-40/ normalized-composed-75-1-40-5_ext.xml	OPTIMUM	3	17.5913	17.743	1114550
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-340-5_ext.xml	OPTIMUM	142	17.8513	18.0114	1119462
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-31_ext.xml	OPTIMUM	1	18.1482	18.3149	1114798
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-70-10-7-60-1_ext.xml	OPTIMUM	3	18.2482	18.333	1116918
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-60/ normalized-kbtree-9-5-3-5-60-33_ext.xml	OPTIMUM	75	18.8281	21.1981	1128558
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-66.xml	OPTIMUM	9	19.916	20.1005	1123622
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/ normalized-kbtree-9-5-3-5-50-08_ext.xml	OPTIMUM	47	20.035	20.2328	1128734
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-70/ normalized-kbtree-9-5-3-5-70-03_ext.xml	OPTIMUM	100	20.048	20.1412	1128574
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-340-2_ext.xml	OPTIMUM	142	20.1629	20.2707	1118902
maxcsp/maxclique/ normalized-c-fat500-5_ext.xml	OPTIMUM	436	20.5469	20.7435	1126182
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/ normalized-kbtree-9-5-3-5-40-09_ext.xml	OPTIMUM	32	20.5679	20.7694	1128598
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-80/ normalized-kbtree-5-2-4-5-80-11_ext.xml	OPTIMUM	90	20.6229	20.7126	1127982
maxcsp/maxclique/ normalized-c-fat500-2_ext.xml	OPTIMUM	474	22.0556	22.1559	1126262
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-29_ext.xml	OPTIMUM	1	22.2546	22.4346	1114830
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-3.xml	OPTIMUM	10	22.5286	22.727	1123582
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-600-364046_ext.xml	OPTIMUM	70	23.8254	23.929	1127846
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-700-089745_ext.xml	OPTIMUM	80	24.3033	24.3154	1127862
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-49_ext.xml	OPTIMUM	73	24.4103	24.5172	1115710
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-40/ normalized-kbtree-9-5-3-5-40-41_ext.xml	OPTIMUM	31	24.4823	24.6934	1128606
maxcsp/randomMaxCSP/completeTight/ normalized-vcsp-15-10-100-93-1_ext.xml	OPTIMUM	73	24.5463	24.7688	1115798
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-43.xml	OPTIMUM	9	27.6448	27.8624	1124238
maxcsp/warehouses/ normalized-capmp4_ext.xml	OPTIMUM	1	27.9627	28.1227	1127110
maxcsp/celar/scens/ normalized-scenw-06-16_ext.xml	OPTIMUM	25	28.3177	28.5078	1125278
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-49_ext.xml	OPTIMUM	1	28.8806	29.0591	1114806
maxcsp/warehouses/ normalized-capmp2_ext.xml	OPTIMUM	1	29.1936	29.4779	1126894
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-360-4_ext.xml	OPTIMUM	151	29.3745	29.6381	1119086
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-6_ext.xml	OPTIMUM	1	32.1481	32.2897	1114814
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-18.xml	OPTIMUM	10	32.2341	32.4407	1123702
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/ normalized-kbtree-5-2-4-5-70-12_ext.xml	OPTIMUM	57	35.4176	35.5869	1127902
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-40_ext.xml	OPTIMUM	1	36.6214	36.9509	1114790
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-36_ext.xml	OPTIMUM	1	40.4948	40.8485	1117614
maxcsp/celar/scens/ normalized-scenw-06-18_ext.xml	OPTIMUM	24	40.8058	41.1801	1125262
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-60/ normalized-kbtree-5-2-4-5-60-10_ext.xml	OPTIMUM	43	46.123	46.3193	1127926
csp/coloring/ normalized-queens-5-5-4-ext.xml	OPTIMUM	12	47.5708	47.5926	1108558
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-370-5_ext.xml	OPTIMUM	160	50.8573	51.9889	1119030
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-700-089750_ext.xml	OPTIMUM	81	51.3482	51.3722	1127886
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-10_ext.xml	OPTIMUM	1	53.3269	54.1751	1117686
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-30/ normalized-kbtree-9-2-3-5-30-02_ext.xml	OPTIMUM	9	61.9096	61.9326	1128534
maxcsp/kbtree/kbtree-5-2-4-5/kbtree-5-2-4-5-70/ normalized-kbtree-5-2-4-5-70-33_ext.xml	OPTIMUM	57	64.6212	65.1261	1127894
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-50/ normalized-kbtree-9-5-3-5-50-06_ext.xml	OPTIMUM	49	65.0221	65.2882	1128750
maxcsp/pi/pi-30-10-25-t58/ normalized-pi-30-10-197-42-73.xml	OPTIMUM	9	67.7397	68.0101	1123654
maxcsp/kbtree/kbtree-9-5-3-5/kbtree-9-5-3-5-80/ normalized-kbtree-9-5-3-5-80-23_ext.xml	OPTIMUM	136	67.8897	68.4831	1128646
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-420-5_ext.xml	OPTIMUM	161	84.7451	85.4759	1120486
maxcsp/spot5/ normalized-spot5-29_ext.xml	OPTIMUM	47	85.9169	86.2829	1126638
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-25_ext.xml	OPTIMUM	1	88.5035	89.2641	1117622
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-46_ext.xml	OPTIMUM	2	94.8816	95.2625	1117606
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-15_ext.xml	OPTIMUM	2	100.907	101.791	1117814
csp/coloring/ normalized-myciel-5g-5-ext.xml	OPTIMUM	1	102.087	102.218	1108486
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/ normalized-kbtree-9-2-3-5-40-16_ext.xml	OPTIMUM	27	112.054	112.516	1128390
csp/tightness0.65/ normalized-rand-2-40-40-135-650-14_ext.xml	OPTIMUM	1	118.773	119.364	1114902
maxcsp/planning/ normalized-driverlog05cc_ext.xml	OPTIMUM	7	124.021	125.121	1125990
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-440-6_ext.xml	OPTIMUM	173	125.363	126.328	1120534
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-390-8_ext.xml	OPTIMUM	173	136.187	136.751	1119558
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-27_ext.xml	OPTIMUM	2	137.682	138.839	1117678
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-1_ext.xml	OPTIMUM	2	141.108	142.204	1117646
maxcsp/randomMaxCSP/completeLoose/ normalized-vcsp-25-10-100-18-44_ext.xml	OPTIMUM	1	149.471	150.775	1117822
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-80-10-6-60-8_ext.xml	OPTIMUM	3	153.115	154.421	1116502
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-400-5_ext.xml	OPTIMUM	179	160.628	161.878	1119302
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-400-10_ext.xml	OPTIMUM	179	161.684	163.749	1119510
maxcsp/maxcut/maxcut-30/ normalized-maxcut-30-400-2_ext.xml	OPTIMUM	179	163.366	163.412	1119190
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-420-2_ext.xml	OPTIMUM	135	176.564	177.916	1119942
csp/tightness0.65/ normalized-rand-2-40-40-135-650-13_ext.xml	OPTIMUM	1	199.209	200.951	1114910
csp/tightness0.5/ normalized-rand-2-40-25-180-500-18_ext.xml	OPTIMUM	1	216.332	217.084	1114366
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/ normalized-kbtree-9-2-3-5-40-38_ext.xml	OPTIMUM	27	231.657	233.585	1128382
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-800-815450_ext.xml	OPTIMUM	102	246.568	246.695	1127854
csp/tightness0.35/ normalized-rand-2-40-16-250-350-90_ext.xml	OPTIMUM	1	260.461	261.557	1114422
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-480-6_ext.xml	OPTIMUM	193	272.491	274.574	1120838
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-480-8_ext.xml	OPTIMUM	192	283.354	284.503	1120502
csp/tightness0.1/ normalized-rand-2-40-8-753-100-83_ext.xml	OPTIMUM	1	292.45	298.685	1115078
csp/tightness0.5/ normalized-rand-2-40-25-180-500-93_ext.xml	OPTIMUM	1	297.87	300.439	1114382
csp/tightness0.5/ normalized-rand-2-40-25-180-500-11_ext.xml	OPTIMUM	1	330.969	333.948	1114374
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/ normalized-kbtree-9-2-3-5-80-36_ext.xml	OPTIMUM	157	340.681	343.347	1128430
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/ normalized-kbtree-9-2-3-5-50-31_ext.xml	OPTIMUM	45	364.264	367.655	1128358
csp/tightness0.35/ normalized-rand-2-40-16-250-350-10_ext.xml	OPTIMUM	1	364.587	367.748	1114462
csp/tightness0.65/ normalized-rand-2-40-40-135-650-37_ext.xml	OPTIMUM	1	365.643	367.151	1114894
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-520-1_ext.xml	OPTIMUM	210	391.728	394.923	1120582
csp/tightness0.5/ normalized-rand-2-40-25-180-500-37_ext.xml	OPTIMUM	1	441.578	441.76	1114390
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-520-10_ext.xml	OPTIMUM	213	461.111	462.952	1120806
csp/tightness0.9/ normalized-rand-2-40-180-84-900-11_ext.xml	OPTIMUM	1	470.513	471.823	1114942
csp/tightness0.35/ normalized-rand-2-40-16-250-350-27_ext.xml	OPTIMUM	1	486.919	491.167	1114502
csp/tightness0.1/ normalized-rand-2-40-8-753-100-72_ext.xml	OPTIMUM	1	540.521	542.654	1115094
maxcsp/randomMaxCSP/sparseLoose/ normalized-vcsp-80-10-6-60-4_ext.xml	OPTIMUM	4	620.308	622.738	1116606
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-460-1_ext.xml	OPTIMUM	155	665.399	670.448	1120302
csp/tightness0.8/ normalized-rand-2-40-80-103-800-53_ext.xml	OPTIMUM	1	675.949	721.284	1115158
maxcsp/cnf/2-80-100-1000/ normalized-cnf-2-80-800-815444_ext.xml	OPTIMUM	107	717.983	720.564	1127878
csp/tightness0.2/ normalized-rand-2-40-11-414-200-76_ext.xml	OPTIMUM	1	724.26	730.949	1114238
csp/tightness0.8/ normalized-rand-2-40-80-103-800-64_ext.xml	OPTIMUM	1	730.668	731.637	1115254
csp/tightness0.5/ normalized-rand-2-40-25-180-500-16_ext.xml	OPTIMUM	1	747.931	750.962	1114406
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/ normalized-kbtree-9-2-3-5-90-29_ext.xml	OPTIMUM	196	766.222	769.58	1128406
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/ normalized-kbtree-9-2-3-5-50-05_ext.xml	OPTIMUM	48	815.95	816.265	1128366
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-500-4_ext.xml	OPTIMUM	171	824.21	829.442	1120174
csp/tightness0.35/ normalized-rand-2-40-16-250-350-11_ext.xml	OPTIMUM	1	871.716	878.46	1114446
csp/tightness0.35/ normalized-rand-2-40-16-250-350-40_ext.xml	OPTIMUM	1	888.34	896.019	1114478
csp/tightness0.35/ normalized-rand-2-40-16-250-350-95_ext.xml	OPTIMUM	1	893.181	899.354	1114438
csp/tightness0.9/ normalized-rand-2-40-180-84-900-45_ext.xml	OPTIMUM	1	893.364	897.14	1115006
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/ normalized-kbtree-9-2-3-5-70-39_ext.xml	OPTIMUM	108	897.07	899.526	1128334
csp/tightness0.5/ normalized-rand-2-40-25-180-500-24_ext.xml	OPTIMUM	1	909.126	916.909	1114398
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-540-3_ext.xml	OPTIMUM	225	940.592	943.44	1120526
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-580-2_ext.xml	OPTIMUM	217	971.091	979.295	1118502
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/ normalized-kbtree-9-2-3-5-90-06_ext.xml	OPTIMUM	193	979.48	980.703	1128414
csp/tightness0.1/ normalized-rand-2-40-8-753-100-6_ext.xml	OPTIMUM	1	1012.08	1063.31	1115110
csp/tightness0.1/ normalized-rand-2-40-8-753-100-82_ext.xml	OPTIMUM	1	1056.98	1062.62	1115070
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-90/ normalized-kbtree-9-2-3-5-90-48_ext.xml	OPTIMUM	197	1098.63	1099.75	1128398
maxcsp/maxcut/maxcut-40/ normalized-maxcut-40-580-1_ext.xml	OPTIMUM	241	1101.83	1110.32	1120470
csp/tightness0.65/ normalized-rand-2-40-40-135-650-79_ext.xml	OPTIMUM	1	1115.23	1119.76	1114878
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-580-6_ext.xml	OPTIMUM	219	1143.39	1148.28	1118302
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-560-10_ext.xml	OPTIMUM	212	1151.8	1158.06	1118630
csp/tightness0.65/ normalized-rand-2-40-40-135-650-66_ext.xml	OPTIMUM	1	1232.73	1237.7	1114886
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-29_ext.xml	OPTIMUM	1	1245.82	1250.72	1114686
maxcsp/celar/scens/ normalized-scenw-06_ext.xml	OPTIMUM	30	1261	1276.47	1125222
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-24_ext.xml	OPTIMUM	1	1371.86	1383.57	1114726
csp/rand-2-23/ normalized-rand-23-23-253-131-55021_ext.xml	OPTIMUM	1	1457.77	1468.97	1108694
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-40/ normalized-kbtree-9-2-3-5-40-50_ext.xml	OPTIMUM	30	1464.28	1470.15	1128374
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-520-6_ext.xml	OPTIMUM	180	1471.08	1482.28	1120222
csp/tightness0.35/ normalized-rand-2-40-16-250-350-53_ext.xml	OPTIMUM	1	1495.79	1508.56	1114494
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-50/ normalized-kbtree-9-2-3-5-50-24_ext.xml	OPTIMUM	48	1505.22	1516.84	1128350
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-580-10_ext.xml	OPTIMUM	221	1508.98	1518.49	1118030
csp/tightness0.35/ normalized-rand-2-40-16-250-350-7_ext.xml	OPTIMUM	1	1665.09	1672.2	1114430
csp/rand-2-23/ normalized-rand-23-23-253-131-52021_ext.xml	OPTIMUM	1	1738.43	1739.45	1108726
csp/rand-2-23/ normalized-rand-23-23-253-131-46021_ext.xml	OPTIMUM	1	1751.45	1754.46	1108702
csp/tightness0.8/ normalized-rand-2-40-80-103-800-94_ext.xml	OPTIMUM	1	1792.89	1866.52	1115166
csp/rand-2-23/ normalized-rand-23-23-253-131-51021_ext.xml	OPTIMUM	1	1819.42	1823.52	1108710
csp/rand-2-23/ normalized-rand-23-23-253-131-47021_ext.xml	OPTIMUM	1	1896.83	1923.68	1108718
csp/tightness0.5/ normalized-rand-2-40-25-180-500-12_ext.xml	OPTIMUM	1	2017.19	2077.86	1114414
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-500-7_ext.xml	OPTIMUM	175	2045.32	2046.35	1119814
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1100-992546_ext.xml	OPTIMUM	160	2121.51	2130.14	1127326
csp/geom/ normalized-geo50-20-d4-75-94_ext.xml	OPTIMUM	1	2133.04	2136.76	1114182
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/ normalized-kbtree-9-2-3-5-60-41_ext.xml	OPTIMUM	87	2148.25	2155.37	1128454
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-28_ext.xml	OPTIMUM	1	2245.49	2254.32	1114670
csp/tightness0.1/ normalized-rand-2-40-8-753-100-94_ext.xml	OPTIMUM	1	2246.48	2329.44	1115086
csp/tightness0.2/ normalized-rand-2-40-11-414-200-11_ext.xml	OPTIMUM	1	2367.75	2385.77	1114230
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/ normalized-kbtree-9-2-3-5-60-02_ext.xml	OPTIMUM	86	2611.56	2617.93	1128462
csp/tightness0.1/ normalized-rand-2-40-8-753-100-64_ext.xml	OPTIMUM	1	2700.07	2747.71	1115102
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1400-169641_ext.xml	OPTIMUM	201	2714.97	2726.51	1127358
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-32_ext.xml	OPTIMUM	1	2881.21	2895.72	1114710
csp/rand-2-24/ normalized-rand-24-24-276-139-57021_ext.xml	OPTIMUM	1	3031.16	3051.71	1108046
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-560-9_ext.xml	OPTIMUM	200	3081.6	3094.34	1119870
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-580-3_ext.xml	OPTIMUM	224	3198.73	3237.71	1118670
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/ normalized-kbtree-9-2-3-5-80-50_ext.xml	OPTIMUM	153	3228.99	3252.72	1128422
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1200-718241_ext.xml	OPTIMUM	176	3241.53	3257.29	1127374
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-580-2_ext.xml	OPTIMUM	207	3316.9	3334.05	1119606
csp/rand-2-24/ normalized-rand-24-24-276-139-52021_ext.xml	OPTIMUM	1	3358.04	3373.32	1108030
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-19_ext.xml	OPTIMUM	1	3577.66	3607.63	1114758

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
csp/QCP-15/ normalized-qcp-15-120-12_ext.xml	? (TO)	3494.43	4007.98	1108792
maxcsp/maxclique/ normalized-p-hat1000-2_ext.xml	? (TO)	3600	3612.21	1126414
csp/tightness0.9/ normalized-rand-2-40-180-84-900-27_ext.xml	? (TO)	3600.01	3700.91	1115030
maxcsp/celar/graphs/ normalized-graphw-13_ext.xml	? (TO)	3600.01	3627.11	1125374
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	? (TO)	3600.01	3613.03	1108622
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-30_ext.xml	? (TO)	3600.01	3618.21	1114678
csp/tightness0.9/ normalized-rand-2-40-180-84-900-43_ext.xml	? (TO)	3600.01	3610.22	1114950
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-680-6_ext.xml	? (TO)	3600.02	3625.71	1117998
csp/rand-2-24/ normalized-rand-24-24-276-139-56021_ext.xml	? (TO)	3600.02	3629.41	1108014
maxcsp/celar/scens/ normalized-scenw-08_ext.xml	? (TO)	3600.02	3630.31	1125198
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1300-443946_ext.xml	? (TO)	3600.02	3616.51	1127366
maxcsp/maxclique/ normalized-hamming-10-4_ext.xml	? (TO)	3600.02	3634.32	1126494
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	? (TO)	3600.02	3628.02	1108614
csp/rand-2-26/ normalized-rand-26-26-325-155-57021_ext.xml	? (TO)	3600.02	3604.61	1108318
csp/ehi-85/ normalized-ehi-85-297-55_ext.xml	? (TO)	3600.02	3614.61	1114342
csp/QCP-15/ normalized-qcp-15-120-14_ext.xml	? (TO)	3600.02	3614.11	1108800
csp/QCP-20/ normalized-qcp-20-187-11_ext.xml	? (TO)	3600.02	3621.71	1108374
maxcsp/celar/graphs/ normalized-graphw-11_ext.xml	? (TO)	3600.02	3614.62	1125342
csp/rand-2-25/ normalized-rand-25-25-300-147-58021_ext.xml	? (TO)	3600.02	3608.31	1108670
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	? (TO)	3600.03	3602.52	1108630
csp/marc/ normalized-large-80-unsat_ext.xml	? (TO)	3600.03	3617.51	1108454
csp/rand-2-24/ normalized-rand-24-24-276-139-49021_ext.xml	? (TO)	3600.03	3622.32	1108022
maxcsp/maxclique/ normalized-brock-400-4_ext.xml	? (TO)	3600.03	3607.31	1126326
csp/rand-2-24/ normalized-rand-24-24-276-139-53021_ext.xml	? (TO)	3600.03	3607.61	1108054
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1700-346746_ext.xml	? (TO)	3600.03	3601.71	1127342
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	? (TO)	3600.03	3610.71	1108110
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	? (TO)	3600.03	3604.71	1108158
csp/tightness0.8/ normalized-rand-2-40-80-103-800-3_ext.xml	? (TO)	3600.03	3633.61	1115190
csp/tightness0.1/ normalized-rand-2-40-8-753-100-78_ext.xml	? (TO)	3600.03	3649.41	1115054
csp/rand-2-26/ normalized-rand-26-26-325-155-60021_ext.xml	? (TO)	3600.03	3604.61	1108310
csp/ehi-85/ normalized-ehi-85-297-96_ext.xml	? (TO)	3600.03	3604.41	1114358
csp/rand-2-25/ normalized-rand-25-25-300-147-57021_ext.xml	? (TO)	3600.03	3627.31	1108686
csp/QCP-25/ normalized-qcp-25-264-14_ext.xml	? (TO)	3600.03	3605.01	1108422
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	? (TO)	3600.04	3607.01	1108150
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	? (TO)	3600.04	3606.51	1108094
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	? (TO)	3600.04	3607.91	1108142
csp/QCP-20/ normalized-qcp-20-187-10_ext.xml	? (TO)	3600.04	3614.61	1108382
csp/QCP-10/ normalized-qcp-10-67-10_ext.xml	? (TO)	3600.04	3623.41	1108766
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-43_ext.xml	? (TO)	3600.04	3603.31	1114742
maxcsp/maxcut/maxcut-60/ normalized-maxcut-60-580-1_ext.xml	? (TO)	3600.04	3618.61	1120118
maxcsp/maxclique/ normalized-san-200-0.9-1_ext.xml	? (TO)	3600.04	3634.21	1126454
maxcsp/maxclique/ normalized-johnson-32-2-4_ext.xml	? (TO)	3600.04	3614.61	1126510
csp/rand-2-26/ normalized-rand-26-26-325-155-56021_ext.xml	? (TO)	3600.05	3601.31	1108326
csp/tightness0.9/ normalized-rand-2-40-180-84-900-76_ext.xml	? (TO)	3600.05	3626.41	1114990
csp/tightness0.9/ normalized-rand-2-40-180-84-900-40_ext.xml	? (TO)	3600.05	3602.31	1114918
csp/rand-2-25/ normalized-rand-25-25-300-147-55021_ext.xml	? (TO)	3600.05	3601.41	1108662
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-80/ normalized-kbtree-9-2-3-5-80-38_ext.xml	? (TO)	3600.05	3604.81	1128438
csp/QCP-10/ normalized-qcp-10-67-13_ext.xml	? (TO)	3600.05	3619.21	1108742
maxcsp/maxclique/ normalized-brock-800-4_ext.xml	? (TO)	3600.05	3618.72	1126246
csp/coloring/ normalized-le-450-5a-3-ext.xml	? (TO)	3600.05	3630.61	1108526
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1500-895349_ext.xml	? (TO)	3600.05	3614.11	1127318
csp/QCP-15/ normalized-qcp-15-120-13_ext.xml	? (TO)	3600.05	3622.81	1108784
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	? (TO)	3600.05	3612.51	1108102
csp/QCP-20/ normalized-qcp-20-187-12_ext.xml	? (TO)	3600.05	3614.81	1108366
csp/ehi-90/ normalized-ehi-90-315-71_ext.xml	? (TO)	3600.05	3644.41	1114198
csp/ehi-90/ normalized-ehi-90-315-51_ext.xml	? (TO)	3600.05	3620.41	1114206
csp/ehi-85/ normalized-ehi-85-297-30_ext.xml	? (TO)	3600.05	3605.11	1114334
csp/tightness0.9/ normalized-rand-2-40-180-84-900-29_ext.xml	? (TO)	3600.05	3682.21	1115038
csp/tightness0.9/ normalized-rand-2-40-180-84-900-4_ext.xml	? (TO)	3600.05	3609.41	1114934
csp/marc/ normalized-large-84-unsat_ext.xml	? (TO)	3600.06	3650.22	1108446
csp/ehi-85/ normalized-ehi-85-297-78_ext.xml	? (TO)	3600.06	3614.71	1114326
csp/langford/ normalized-langford-3-11-ext.xml	? (TO)	3600.06	3632.22	1108342
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	? (TO)	3600.06	3603.41	1108654
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	? (TO)	3600.06	3609.81	1108126
maxcsp/planning/ normalized-driverlog09_ext.xml	? (TO)	3600.06	3623.43	1125926
maxcsp/maxclique/ normalized-mann-a45_ext.xml	? (TO)	3600.06	3613.32	1126342
maxcsp/maxclique/ normalized-brock-800-1_ext.xml	? (TO)	3600.06	3611.11	1126054
csp/tightness0.8/ normalized-rand-2-40-80-103-800-40_ext.xml	? (TO)	3600.06	3607.61	1115214
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	? (TO)	3600.06	3605.61	1108214
csp/ehi-85/ normalized-ehi-85-297-27_ext.xml	? (TO)	3600.06	3614.81	1114350
csp/ehi-90/ normalized-ehi-90-315-54_ext.xml	? (TO)	3600.06	3615.21	1114214
csp/QCP-25/ normalized-qcp-25-264-10_ext.xml	? (TO)	3600.06	3633.71	1108414
csp/ehi-90/ normalized-ehi-90-315-65_ext.xml	? (TO)	3600.06	3604.01	1114222
csp/rand-2-24/ normalized-rand-24-24-276-139-54021_ext.xml	? (TO)	3600.07	3620.21	1108038
csp/QCP-25/ normalized-qcp-25-264-11_ext.xml	? (TO)	3600.07	3606.31	1108430
csp/QCP-10/ normalized-qcp-10-67-11_ext.xml	? (TO)	3600.07	3631.41	1108758
csp/QCP-20/ normalized-qcp-20-187-14_ext.xml	? (TO)	3600.07	3601.01	1108358
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-25_ext.xml	? (TO)	3600.07	3631.71	1114750
csp/rand-2-26/ normalized-rand-26-26-325-155-52021_ext.xml	? (TO)	3600.07	3603.91	1108334
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1700-346750_ext.xml	? (TO)	3600.07	3614.61	1127334
csp/rand-2-24/ normalized-rand-24-24-276-139-51021_ext.xml	? (TO)	3600.07	3628.61	1108006
maxcsp/maxclique/ normalized-sanr-200-0.9_ext.xml	? (TO)	3600.08	3613.81	1126286
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	? (TO)	3600.08	3606.21	1108070
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	? (TO)	3600.08	3602.32	1108638
csp/QCP-20/ normalized-qcp-20-187-13_ext.xml	? (TO)	3600.08	3602.21	1108390
maxcsp/maxclique/ normalized-brock-200-4_ext.xml	? (TO)	3600.08	3631.31	1126486
csp/marc/ normalized-large-88-unsat_ext.xml	? (TO)	3600.08	3631.21	1108462
csp/QCP-25/ normalized-qcp-25-264-12_ext.xml	? (TO)	3600.08	3621.31	1108406
csp/QCP-10/ normalized-qcp-10-67-14_ext.xml	? (TO)	3600.08	3625.41	1108734
csp/QCP-15/ normalized-qcp-15-120-10_ext.xml	? (TO)	3600.08	3613.53	1108816
csp/coloring/ normalized-le-450-5a-4-ext.xml	? (TO)	3600.09	3614.71	1108478
csp/langford/ normalized-slangford-3-11-ext.xml	? (TO)	3600.09	3605.71	1108350
csp/ehi-90/ normalized-ehi-90-315-95_ext.xml	? (TO)	3600.09	3607.81	1114190
csp/tightness0.8/ normalized-rand-2-40-80-103-800-29_ext.xml	? (TO)	3600.09	3615.91	1115198
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-660-4_ext.xml	? (TO)	3600.09	3629.11	1118110
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/ normalized-kbtree-9-2-3-5-70-04_ext.xml	? (TO)	3600.09	3619.01	1128342
maxcsp/celar/scens/ normalized-scenw-07_10000_30r_ext.xml	? (TO)	3600.09	3630.71	1125254
csp/QCP-25/ normalized-qcp-25-264-13_ext.xml	? (TO)	3600.09	3606.61	1108398
csp/rand-2-25/ normalized-rand-25-25-300-147-50021_ext.xml	? (TO)	3600.09	3629.91	1108678
maxcsp/maxclique/ normalized-johnson-16-2-4_ext.xml	? (TO)	3600.09	3630.71	1126070
csp/coloring/ normalized-dsjc-125-1-4-ext.xml	? (TO)	3600.09	3625.71	1108598
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-11_ext.xml	? (TO)	3600.09	3614.31	1114782
csp/marc/ normalized-large-96-unsat_ext.xml	? (TO)	3600.09	3631.41	1108470
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	? (TO)	3600.1	3628.92	1108606
csp/tightness0.8/ normalized-rand-2-40-80-103-800-25_ext.xml	? (TO)	3600.1	3613.61	1115222
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	? (TO)	3600.1	3601.21	1108086
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-41_ext.xml	? (TO)	3600.1	3630.81	1114718
csp/QCP-10/ normalized-qcp-10-67-12_ext.xml	? (TO)	3600.1	3621.12	1108750
maxcsp/maxcut/maxcut-50/ normalized-maxcut-50-620-2_ext.xml	? (TO)	3600.1	3608.81	1118334
csp/marc/ normalized-large-92-unsat_ext.xml	? (TO)	3600.1	3605.41	1108438
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-60/ normalized-kbtree-9-2-3-5-60-21_ext.xml	? (TO)	3600.1	3604.51	1128446
maxcsp/celar/scens/ normalized-scenw-07_ext.xml	? (TO)	3600.1	3618.02	1125238
maxcsp/maxclique/ normalized-p-hat500-3_ext.xml	? (TO)	3600.1	3625.81	1126478
maxcsp/maxclique/ normalized-san-400-0.7-3_ext.xml	? (TO)	3600.1	3630.81	1126134
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	? (TO)	3600.1	3602.01	1108646
csp/tightness0.8/ normalized-rand-2-40-80-103-800-78_ext.xml	? (TO)	3600.1	3616.91	1115238
csp/rand-2-26/ normalized-rand-26-26-325-155-58021_ext.xml	? (TO)	3600.1	3609.61	1108302
csp/QCP-15/ normalized-qcp-15-120-11_ext.xml	? (TO)	3600.11	3629.51	1108808
maxcsp/kbtree/kbtree-9-2-3-5/kbtree-9-2-3-5-70/ normalized-kbtree-9-2-3-5-70-50_ext.xml	? (TO)	3600.11	3625.11	1128326
maxcsp/cnf/2-80-1100-2000/ normalized-cnf-2-80-1900-798146_ext.xml	? (TO)	3600.11	3614.31	1127350
maxcsp/maxclique/ normalized-p-hat300-3_ext.xml	? (TO)	3600.12	3605.61	1126430
maxcsp/celar/graphs/ normalized-graphw-06_ext.xml	? (TO)	3600.12	3670.51	1125350

Benchmark Name	Answer	Number of falsified constraints	CPU time	Wall clock time	TraceID
maxcsp/pedigree/ normalized-simple_ext.xml	OPTIMUM	1	0.007997	0.0106399	1127246
maxcsp/pedigree/ normalized-connell_ext.xml	OPTIMUM	1	0.010998	0.017252	1127158
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-100-735548_ext.xml	OPTIMUM	0	0.015997	0.019011	1127614
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-100-730623_ext.xml	OPTIMUM	0	0.015997	0.0219649	1127798
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-100-730629_ext.xml	OPTIMUM	0	0.015997	0.022107	1127790
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	OPTIMUM	1	0.016997	0.023101	1111138
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	OPTIMUM	1	0.021996	0.028063	1111106
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-200-461248_ext.xml	OPTIMUM	0	0.022995	0.0294689	1127598
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	OPTIMUM	1	0.025995	0.0317109	1111146
maxcsp/pedigree/ normalized-pedck60-L1_ext.xml	OPTIMUM	2	0.027995	0.0361029	1127166
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	OPTIMUM	1	0.028995	0.0334149	1111162
maxcsp/pedigree/ normalized-pedck60-L2_ext.xml	OPTIMUM	2	0.028995	0.0365749	1127230
maxcsp/pedigree/ normalized-pedck60-L12_ext.xml	OPTIMUM	6	0.030995	0.0305259	1127182
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	OPTIMUM	1	0.034994	0.0410989	1111130
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	OPTIMUM	1	0.05799	0.06104	1111154
maxcsp/pedigree/ normalized-eye_ext.xml	OPTIMUM	1	0.064989	0.069628	1127174
maxcsp/pedigree/ normalized-pedck350_ext.xml	OPTIMUM	2	0.121981	0.139161	1127214
maxcsp/pedigree/ normalized-pedck350l2_ext.xml	OPTIMUM	1	0.122981	0.128929	1127198
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	OPTIMUM	1	0.155976	0.162623	1111122
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	OPTIMUM	1	0.156975	0.167643	1111114
csp/pret/ normalized-pret-60-25_ext.xml	OPTIMUM	1	0.165974	0.16635	1109194
csp/pret/ normalized-pret-60-75_ext.xml	OPTIMUM	1	0.168973	0.175603	1109146
csp/pret/ normalized-pret-60-40_ext.xml	OPTIMUM	1	0.169973	0.175632	1109162
csp/ssa/ normalized-ssa-0432-003_ext.xml	OPTIMUM	1	0.170973	0.179609	1109988
csp/varDimacs/ normalized-hole-06_ext.xml	OPTIMUM	1	0.204968	0.216379	1112492
csp/pret/ normalized-pret-60-60_ext.xml	OPTIMUM	1	0.211967	0.218422	1109154
maxcsp/pedigree/ normalized-pedck1000_ext.xml	OPTIMUM	19	0.265959	0.272325	1127150
maxcsp/pedigree/ normalized-wijsmanguo_ext.xml	OPTIMUM	1	0.436933	0.441861	1127238
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	OPTIMUM	1	0.439932	0.443707	1111690
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	OPTIMUM	1	0.600908	0.612654	1111730
maxcsp/pedigree/ normalized-sheep4r-4-2_ext.xml	OPTIMUM	1	0.705891	0.717091	1127206
csp/dubois/ normalized-dubois-20_ext.xml	OPTIMUM	1	0.897863	0.904817	1110702
maxcsp/pedigree/ normalized-sheep4r-4-3_ext.xml	OPTIMUM	1	0.908861	0.916441	1127142
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	OPTIMUM	1	1.08383	1.09968	1111706
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	OPTIMUM	1	1.24781	1.25686	1111722
csp/dubois/ normalized-dubois-21_ext.xml	OPTIMUM	1	1.45278	1.47086	1110646
csp/varDimacs/ normalized-hole-07_ext.xml	OPTIMUM	1	1.64775	1.67422	1112508
csp/modifiedRenault/ normalized-renault-mod-37_ext.xml	OPTIMUM	1	1.70374	1.72671	1111440
csp/modifiedRenault/ normalized-renault-mod-1_ext.xml	OPTIMUM	1	2.16067	2.18896	1111328
csp/modifiedRenault/ normalized-renault-mod-12_ext.xml	OPTIMUM	1	2.22866	2.25904	1111464
csp/modifiedRenault/ normalized-renault-mod-35_ext.xml	OPTIMUM	1	2.27665	2.31124	1111456
csp/dubois/ normalized-dubois-22_ext.xml	OPTIMUM	1	2.31965	2.34407	1110718
csp/modifiedRenault/ normalized-renault-mod-40_ext.xml	OPTIMUM	1	2.32965	2.35882	1111512
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	OPTIMUM	1	2.33864	2.35469	1111714
csp/modifiedRenault/ normalized-renault-mod-17_ext.xml	OPTIMUM	1	2.34864	2.37025	1111472
maxcsp/spot5/ normalized-spot5-54_ext.xml	OPTIMUM	22	2.74358	2.77155	1126646
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	OPTIMUM	1	2.96355	2.99622	1111698
csp/modifiedRenault/ normalized-renault-mod-42_ext.xml	OPTIMUM	1	2.96455	3.28155	1111392
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	OPTIMUM	1	3.66244	3.6823	1111738
csp/modifiedRenault/ normalized-renault-mod-14_ext.xml	OPTIMUM	1	3.70644	3.74075	1111384
csp/dubois/ normalized-dubois-23_ext.xml	OPTIMUM	1	3.79542	3.83562	1110710
csp/modifiedRenault/ normalized-renault-mod-18_ext.xml	OPTIMUM	1	4.71928	4.76962	1111360
csp/dubois/ normalized-dubois-24_ext.xml	OPTIMUM	1	6.06008	6.12525	1110670
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	OPTIMUM	1	6.36303	6.36935	1111682
csp/modifiedRenault/ normalized-renault-mod-3_ext.xml	OPTIMUM	1	7.11492	7.18772	1111344
csp/dubois/ normalized-dubois-25_ext.xml	OPTIMUM	1	9.90449	9.99646	1110630
maxcsp/pedigree/ normalized-sheep4r_ext.xml	OPTIMUM	2	13.121	13.1815	1127222
csp/jnhUnsat/ normalized-jnh206_ext.xml	OPTIMUM	1	13.176	13.305	1110150
csp/dubois/ normalized-dubois-26_ext.xml	OPTIMUM	1	14.8357	14.9011	1110678
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-400-912648_ext.xml	OPTIMUM	3	15.0817	15.1098	1127582
csp/varDimacs/ normalized-hole-08_ext.xml	OPTIMUM	1	16.0886	16.2229	1112500
csp/modifiedRenault/ normalized-renault-mod-16_ext.xml	OPTIMUM	1	21.7957	22.0099	1111336
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	OPTIMUM	1	24.4023	24.6167	1111276
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	OPTIMUM	1	24.8642	25.0797	1111244
csp/dubois/ normalized-dubois-27_ext.xml	OPTIMUM	1	25.7991	26.0278	1110622
csp/modifiedRenault/ normalized-renault-mod-10_ext.xml	OPTIMUM	1	28.7156	28.9498	1111504
csp/modifiedRenault/ normalized-renault-mod-22_ext.xml	OPTIMUM	3	29.4025	29.6719	1111448
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-400-912642_ext.xml	OPTIMUM	3	29.5795	29.839	1127630
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-800-810522_ext.xml	OPTIMUM	42	33.2629	33.5568	1127774
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-38_ext.xml	OPTIMUM	1	39.0391	40.1693	1112030
csp/jnhUnsat/ normalized-jnh216_ext.xml	OPTIMUM	1	40.1029	40.457	1110262
csp/dubois/ normalized-dubois-28_ext.xml	OPTIMUM	1	41.8356	42.207	1110694
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-900-536230_ext.xml	OPTIMUM	48	42.4885	45.1676	1127822
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-1000-261925_ext.xml	OPTIMUM	60	43.9373	44.1371	1127782
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-43_ext.xml	OPTIMUM	1	48.7016	49.0156	1112094
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-1000-261929_ext.xml	OPTIMUM	62	49.2435	49.8413	1127806
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-900-536226_ext.xml	OPTIMUM	54	49.9884	50.3774	1127814
csp/jnhUnsat/ normalized-jnh211_ext.xml	OPTIMUM	2	52.902	53.3664	1110062
maxcsp/cnf/3-40-100-1000/ normalized-cnf-3-40-1000-261927_ext.xml	OPTIMUM	62	54.6937	54.9248	1127766
csp/dubois/ normalized-dubois-29_ext.xml	OPTIMUM	1	62.7755	63.0384	1110654
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1200-713329_ext.xml	OPTIMUM	79	64.0573	64.3355	1127558
csp/jnhUnsat/ normalized-jnh203_ext.xml	OPTIMUM	1	64.5282	64.9951	1110214
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	OPTIMUM	1	72.194	72.8285	1111260
csp/jnhUnsat/ normalized-jnh06_ext.xml	OPTIMUM	1	74.1957	74.8374	1110086
csp/modifiedRenault/ normalized-renault-mod-21_ext.xml	OPTIMUM	3	74.2487	74.9627	1111424
csp/jnhUnsat/ normalized-jnh219_ext.xml	OPTIMUM	1	79.3189	79.362	1110174
csp/dubois/ normalized-dubois-30_ext.xml	OPTIMUM	1	109.574	110.538	1110686
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-45_ext.xml	OPTIMUM	1	117.176	118.299	1112070
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2500-147429_ext.xml	OPTIMUM	195	125.462	125.548	1127678
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1500-890427_ext.xml	OPTIMUM	109	129.379	130.501	1127550
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1700-341827_ext.xml	OPTIMUM	129	142.766	143.382	1127534
csp/modifiedRenault/ normalized-renault-mod-27_ext.xml	OPTIMUM	6	149.565	149.656	1111320
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-2_ext.xml	OPTIMUM	1	150.715	151.597	1112102
maxcsp/pedigree/ normalized-sheep4nr_ext.xml	OPTIMUM	23	157.089	158.054	1127190
csp/jnhUnsat/ normalized-jnh214_ext.xml	OPTIMUM	1	165.401	166.089	1110158
csp/varDimacs/ normalized-hole-09_ext.xml	OPTIMUM	1	168.138	170.084	1112516
csp/bddSmall/ normalized-bdd-21-133-18-78-33_ext.xml	OPTIMUM	1	172.91	174.575	1111042
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-6_ext.xml	OPTIMUM	1	178.494	179.736	1112110
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-35_ext.xml	OPTIMUM	1	185.649	187.79	1112118
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1700-341821_ext.xml	OPTIMUM	128	197.083	197.168	1127518
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1900-793223_ext.xml	OPTIMUM	146	206.596	207.607	1127526
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2100-244628_ext.xml	OPTIMUM	161	219.512	219.59	1127686
csp/bddSmall/ normalized-bdd-21-133-18-78-19_ext.xml	OPTIMUM	3	221.202	222.321	1111010
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1900-793224_ext.xml	OPTIMUM	151	241.943	244.02	1127566
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1600-616125_ext.xml	OPTIMUM	122	251.06	253.217	1127510
csp/modifiedRenault/ normalized-renault-mod-23_ext.xml	OPTIMUM	4	253.987	256.325	1111496
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2400-421722_ext.xml	OPTIMUM	194	254.984	255.992	1127654
csp/bddSmall/ normalized-bdd-21-133-18-78-29_ext.xml	OPTIMUM	3	282.289	285.004	1110978
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	OPTIMUM	1	303.014	305.632	1111236
csp/bddSmall/ normalized-bdd-21-133-18-78-21_ext.xml	OPTIMUM	6	305.591	308.168	1111074
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-30_ext.xml	OPTIMUM	1	315.912	316.475	1112062
csp/bddSmall/ normalized-bdd-21-133-18-78-6_ext.xml	OPTIMUM	2	318.32	321.354	1111098
csp/bddSmall/ normalized-bdd-21-133-18-78-15_ext.xml	OPTIMUM	8	321.393	324.337	1111082
csp/bddSmall/ normalized-bdd-21-133-18-78-31_ext.xml	OPTIMUM	14	346.646	349.936	1111018
csp/bddSmall/ normalized-bdd-21-133-18-78-22_ext.xml	OPTIMUM	1	349.929	350.736	1111058
csp/bddSmall/ normalized-bdd-21-133-18-78-12_ext.xml	OPTIMUM	13	361.271	364.726	1111050
csp/bddSmall/ normalized-bdd-21-133-18-78-13_ext.xml	OPTIMUM	10	367.155	367.811	1110986
csp/jnhUnsat/ normalized-jnh04_ext.xml	OPTIMUM	1	374.24	377.508	1110310
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2500-147422_ext.xml	OPTIMUM	210	375.191	376.681	1127694
csp/bddSmall/ normalized-bdd-21-133-18-78-16_ext.xml	OPTIMUM	10	376.045	376.845	1111002
csp/bddSmall/ normalized-bdd-21-133-18-78-24_ext.xml	OPTIMUM	10	388.008	391.718	1111090
csp/bddSmall/ normalized-bdd-21-133-18-78-35_ext.xml	OPTIMUM	8	400.092	403.93	1111066
csp/modifiedRenault/ normalized-renault-mod-20_ext.xml	OPTIMUM	4	403.828	404.67	1111488
csp/bddSmall/ normalized-bdd-21-133-18-78-30_ext.xml	OPTIMUM	11	406.002	409.853	1111026
csp/jnhUnsat/ normalized-jnh310_ext.xml	OPTIMUM	3	414.702	416.691	1110302
csp/bddSmall/ normalized-bdd-21-133-18-78-14_ext.xml	OPTIMUM	9	426.437	430.439	1110994
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	OPTIMUM	1	426.483	428.232	1111284
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2900-050222_ext.xml	OPTIMUM	252	447.36	449.521	1127670
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	OPTIMUM	1	462.184	466.133	1111268
maxcsp/cnf/3-40-1100-2000/ normalized-cnf-3-40-1700-341823_ext.xml	OPTIMUM	139	468.467	470.32	1127542
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2500-147426_ext.xml	OPTIMUM	215	476.634	481.81	1127662
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-39_ext.xml	OPTIMUM	1	526.404	530.53	1112046
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-3_ext.xml	OPTIMUM	1	565.237	570.608	1112054
csp/jnhUnsat/ normalized-jnh303_ext.xml	OPTIMUM	3	573.152	576.974	1110230
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-2800-324527_ext.xml	OPTIMUM	244	602.02	602.211	1127638
csp/jnhUnsat/ normalized-jnh02_ext.xml	OPTIMUM	1	634.872	640.538	1110246
maxcsp/cnf/3-40-2100-3000/ normalized-cnf-3-40-3000-775927_ext.xml	OPTIMUM	269	659.506	662.533	1127646
csp/jnhUnsat/ normalized-jnh14_ext.xml	OPTIMUM	2	710.679	714.361	1110190
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	OPTIMUM	1	783.953	790.651	1111292
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-4_ext.xml	OPTIMUM	1	1101.05	1103.22	1109130
csp/pret/ normalized-pret-150-75_ext.xml	OPTIMUM	1	1192.52	1192.85	1109186
csp/pret/ normalized-pret-150-60_ext.xml	OPTIMUM	1	1205.16	1210.01	1109138
csp/pret/ normalized-pret-150-40_ext.xml	OPTIMUM	1	1221.15	1226.18	1109170
csp/pret/ normalized-pret-150-25_ext.xml	OPTIMUM	1	1290.9	1296	1109178
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-16_ext.xml	OPTIMUM	1	1451.7	1465.28	1112038
csp/varDimacs/ normalized-hole-10_ext.xml	OPTIMUM	1	2215.09	2221.73	1112524
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-22_ext.xml	OPTIMUM	1	2307.24	2328.42	1109122

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-21.xml	? (TO)	3600	3631.91	1114020
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-14.xml	? (TO)	3600	3625.41	1113996
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-3.xml	? (TO)	3600	3642.81	1113972
csp/dubois/ normalized-dubois-50_ext.xml	? (TO)	3600.01	3631.01	1110662
maxcsp/spot5/ normalized-spot5-28_ext.xml	? (TO)	3600.01	3620.01	1126558
csp/ukVg/ normalized-crossword-m1c-uk-vg11-15_ext.xml	? (TO)	3600.01	3616.61	1110834
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-12.xml	? (TO)	3600.01	3606.01	1113956
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-9.xml	? (TO)	3600.01	3609.31	1113924
maxcsp/spot5/ normalized-spot5-1403_ext.xml	? (TO)	3600.02	3636.41	1126574
maxcsp/spot5/ normalized-spot5-1401_ext.xml	? (TO)	3600.02	3606.01	1126518
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-5.xml	? (TO)	3600.02	3630.81	1114012
csp/jnhUnsat/ normalized-jnh309_ext.xml	? (TO)	3600.02	3615.21	1110254
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-16_ext.xml	? (TO)	3600.02	3627.61	1111610
csp/wordsVg/ normalized-crossword-m1c-words-vg15-19_ext.xml	? (TO)	3600.02	3614.51	1110454
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-19.xml	? (TO)	3600.02	3614.51	1114028
csp/wordsVg/ normalized-crossword-m1c-words-vg14-14_ext.xml	? (TO)	3600.03	3601.31	1110342
csp/lexVg/ normalized-crossword-m1c-lex-vg15-18_ext.xml	? (TO)	3600.03	3633.61	1111854
csp/wordsVg/ normalized-crossword-m1c-words-vg8-11_ext.xml	? (TO)	3600.03	3604.61	1110390
csp/ukVg/ normalized-crossword-m1c-uk-vg16-17_ext.xml	? (TO)	3600.03	3630.01	1110778
maxcsp/spot5/ normalized-spot5-1407_ext.xml	? (TO)	3600.03	3614.71	1126622
csp/wordsVg/ normalized-crossword-m1c-words-vg15-16_ext.xml	? (TO)	3600.03	3632.21	1110534
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-16_ext.xml	? (TO)	3600.03	3631.02	1111602
csp/wordsVg/ normalized-crossword-m1c-words-vg5-9_ext.xml	? (TO)	3600.03	3628.81	1110502
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	? (TO)	3600.03	3634.21	1111252
csp/lexVg/ normalized-crossword-m1c-lex-vg9-9_ext.xml	? (TO)	3600.04	3621.31	1111790
csp/lexVg/ normalized-crossword-m1c-lex-vg6-10_ext.xml	? (TO)	3600.04	3636.32	1111950
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-2_ext.xml	? (TO)	3600.04	3629.61	1109728
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-3_ext.xml	? (TO)	3600.04	3627.11	1109768
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1600-621045_ext.xml	? (TO)	3600.04	3627.01	1127390
csp/wordsVg/ normalized-crossword-m1c-words-vg11-14_ext.xml	? (TO)	3600.04	3604.31	1110526
csp/wordsVg/ normalized-crossword-m1c-words-vg13-17_ext.xml	? (TO)	3600.04	3631.51	1110542
csp/ukVg/ normalized-crossword-m1c-uk-vg16-19_ext.xml	? (TO)	3600.04	3602.21	1110770
csp/ssa/ normalized-ssa-2670-130_ext.xml	? (TO)	3600.04	3600.91	1109980
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-11.xml	? (TO)	3600.04	3605.21	1113988
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-17.xml	? (TO)	3600.04	3621.71	1113980
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-15_ext.xml	? (TO)	3600.04	3613.21	1111626
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-15.xml	? (TO)	3600.04	3609.91	1113940
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-14_ext.xml	? (TO)	3600.04	3622.11	1111674
csp/lexVg/ normalized-crossword-m1c-lex-vg7-10_ext.xml	? (TO)	3600.04	3602.51	1112006
csp/dubois/ normalized-dubois-100_ext.xml	? (TO)	3600.05	3620.01	1110638
csp/wordsVg/ normalized-crossword-m1c-words-vg9-10_ext.xml	? (TO)	3600.05	3620.11	1110334
csp/ukVg/ normalized-crossword-m1c-uk-vg13-17_ext.xml	? (TO)	3600.05	3609.23	1110818
csp/wordsVg/ normalized-crossword-m1c-words-vg8-8_ext.xml	? (TO)	3600.05	3617.11	1110406
csp/ukVg/ normalized-crossword-m1c-uk-vg14-15_ext.xml	? (TO)	3600.05	3601.01	1110826
csp/ukVg/ normalized-crossword-m1c-uk-vg16-18_ext.xml	? (TO)	3600.05	3628.51	1110858
csp/lexVg/ normalized-crossword-m1c-lex-vg6-8_ext.xml	? (TO)	3600.05	3603.71	1111862
csp/wordsVg/ normalized-crossword-m1c-words-vg6-10_ext.xml	? (TO)	3600.05	3615.41	1110358
csp/lexVg/ normalized-crossword-m1c-lex-vg13-15_ext.xml	? (TO)	3600.06	3603.61	1112014
maxcsp/spot5/ normalized-spot5-505_ext.xml	? (TO)	3600.06	3602.21	1126542
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-1_ext.xml	? (TO)	3600.06	3614.51	1109616
csp/lexVg/ normalized-crossword-m1c-lex-vg5-7_ext.xml	? (TO)	3600.06	3603.91	1111798
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1600-621048_ext.xml	? (TO)	3600.06	3614.91	1127430
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-10_ext.xml	? (TO)	3600.06	3614.61	1109680
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-600-364044_ext.xml	? (TO)	3600.07	3617.61	1127590
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-15_ext.xml	? (TO)	3600.07	3602.11	1109736
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-13_ext.xml	? (TO)	3600.07	3601.31	1109752
csp/ukVg/ normalized-crossword-m1c-uk-vg14-18_ext.xml	? (TO)	3600.07	3603.71	1110786
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-15_ext.xml	? (TO)	3600.07	3630.72	1111650
csp/lexVg/ normalized-crossword-m1c-lex-vg11-15_ext.xml	? (TO)	3600.07	3627.11	1111814
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-6.xml	? (TO)	3600.07	3609.02	1113932
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1200-718250_ext.xml	? (TO)	3600.07	3614.61	1127406
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1300-443942-ext.xml	? (TO)	3600.07	3614.11	1127398
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1300-443943_ext.xml	? (TO)	3600.07	3601.11	1127414
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1500-895345_ext.xml	? (TO)	3600.07	3601.71	1127422
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-1000-266847_ext.xml	? (TO)	3600.07	3612.91	1127606
maxcsp/spot5/ normalized-spot5-503_ext.xml	? (TO)	3600.07	3614.61	1126614
maxcsp/spot5/ normalized-spot5-1405_ext.xml	? (TO)	3600.07	3610.91	1126678
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-1000-266849_ext.xml	? (TO)	3600.08	3616.61	1127574
csp/lexVg/ normalized-crossword-m1c-lex-vg9-10_ext.xml	? (TO)	3600.08	3651.04	1111902
maxcsp/spot5/ normalized-spot5-509_ext.xml	? (TO)	3600.08	3620.71	1126534
csp/ukVg/ normalized-crossword-m1c-uk-vg15-18_ext.xml	? (TO)	3600.08	3620.81	1110762
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-22.xml	? (TO)	3600.08	3601.91	1113948
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-11_ext.xml	? (TO)	3600.08	3619.51	1109640
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-13.xml	? (TO)	3600.08	3609.71	1113964
maxcsp/spot5/ normalized-spot5-1506_ext.xml	? (TO)	3600.08	3620.51	1126670
csp/jnhUnsat/ normalized-jnh302_ext.xml	? (TO)	3600.08	3601.01	1110198
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-7.xml	? (TO)	3600.08	3622.61	1114004
csp/lexVg/ normalized-crossword-m1c-lex-vg13-16_ext.xml	? (TO)	3600.08	3601.61	1111758
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-17_ext.xml	? (TO)	3600.09	3620.52	1111666
csp/wordsVg/ normalized-crossword-m1c-words-vg9-11_ext.xml	? (TO)	3600.09	3600.21	1110446
maxcsp/cnf/3-80-100-1000/ normalized-cnf-3-80-700-089745_ext.xml	? (TO)	3600.09	3617.61	1127622
csp/wordsVg/ normalized-crossword-m1c-words-vg10-14_ext.xml	? (TO)	3600.09	3627.21	1110486
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-17_ext.xml	? (TO)	3600.1	3617.31	1109624
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-16_ext.xml	? (TO)	3600.1	3630.81	1111658
csp/ukVg/ normalized-crossword-m1c-uk-vg15-17_ext.xml	? (TO)	3600.1	3604.72	1110866
csp/ukVg/ normalized-crossword-m1c-uk-vg14-14_ext.xml	? (TO)	3600.1	3602.52	1110850
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-25.xml	? (TO)	3600.1	3611.22	1114036
csp/wordsVg/ normalized-crossword-m1c-words-vg10-10_ext.xml	? (TO)	3600.1	3614.71	1110438
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1200-718245_ext.xml	? (TO)	3600.1	3601.01	1127438
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-5_ext.xml	? (TO)	3600.1	3601.41	1109688
csp/wordsVg/ normalized-crossword-m1c-words-vg15-15_ext.xml	? (TO)	3600.11	3601.01	1110374
maxcsp/spot5/ normalized-spot5-404_ext.xml	? (TO)	3600.11	3617.51	1126582
maxcsp/cnf/3-80-1100-2000/ normalized-cnf-3-80-1200-718249_ext.xml	? (TO)	3600.11	3614.31	1127382
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-0_ext.xml	? (TO)	3600.11	3601.41	1109720
csp/ukVg/ normalized-crossword-m1c-uk-vg14-17_ext.xml	? (TO)	3600.11	3614.52	1110810
csp/lexVg/ normalized-crossword-m1c-lex-vg10-11_ext.xml	? (TO)	3600.11	3622.71	1112022
csp/lexVg/ normalized-crossword-m1c-lex-vg5-9_ext.xml	? (TO)	3600.11	3614.41	1111966
csp/ukVg/ normalized-crossword-m1c-uk-vg16-16_ext.xml	? (TO)	3600.11	3602.21	1110794
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-18_ext.xml	? (TO)	3600.11	3609.31	1111618
maxcsp/spot5/ normalized-spot5-414_ext.xml	? (TO)	3600.12	3628.51	1126630
csp/ukVg/ normalized-crossword-m1c-uk-vg15-19_ext.xml	? (TO)	3600.12	3603.51	1110842
maxcsp/spot5/ normalized-spot5-408_ext.xml	? (TO)	3600.12	3612.51	1126566
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-19_ext.xml	? (TO)	3600.12	3621.01	1111642

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
csp/bddLarge/ normalized-bdd-21-2713-15-79-25_ext.xml	? (MO)	62.57	62.6195	1109352
csp/bddLarge/ normalized-bdd-21-2713-15-79-1_ext.xml	? (MO)	62.58	62.62	1109456
csp/bddLarge/ normalized-bdd-21-2713-15-79-9_ext.xml	? (MO)	62.92	63.3145	1109344
csp/bddLarge/ normalized-bdd-21-2713-15-79-20_ext.xml	? (MO)	62.98	63.3128	1109304
csp/bddLarge/ normalized-bdd-21-2713-15-79-27_ext.xml	? (MO)	62.98	64.4239	1109400
csp/bddLarge/ normalized-bdd-21-2713-15-79-26_ext.xml	? (MO)	63.03	63.6134	1109424
csp/bddLarge/ normalized-bdd-21-2713-15-79-17_ext.xml	? (MO)	63.08	63.5129	1109432
csp/bddLarge/ normalized-bdd-21-2713-15-79-12_ext.xml	? (MO)	63.29	63.6132	1109376
csp/bddLarge/ normalized-bdd-21-2713-15-79-2_ext.xml	? (MO)	63.3	63.6149	1109328
csp/bddLarge/ normalized-bdd-21-2713-15-79-29_ext.xml	? (MO)	64.36	64.513	1109464
csp/bddLarge/ normalized-bdd-21-2713-15-79-6_ext.xml	? (MO)	64.88	65.2126	1109408
csp/bddLarge/ normalized-bdd-21-2713-15-79-21_ext.xml	? (MO)	66.85	66.9139	1109416
csp/bddLarge/ normalized-bdd-21-2713-15-79-15_ext.xml	? (MO)	66.85	66.9121	1109296
csp/bddLarge/ normalized-bdd-21-2713-15-79-16_ext.xml	? (MO)	66.86	66.9117	1109448
csp/bddLarge/ normalized-bdd-21-2713-15-79-18_ext.xml	? (MO)	67.09	67.813	1109368
csp/bddLarge/ normalized-bdd-21-2713-15-79-7_ext.xml	? (MO)	67.17	67.8137	1109336
csp/bddLarge/ normalized-bdd-21-2713-15-79-30_ext.xml	? (MO)	67.38	67.7146	1109320
csp/bddLarge/ normalized-bdd-21-2713-15-79-23_ext.xml	? (MO)	67.39	68.0133	1109360
csp/bddLarge/ normalized-bdd-21-2713-15-79-33_ext.xml	? (MO)	67.54	68.2195	1109280
csp/bddLarge/ normalized-bdd-21-2713-15-79-10_ext.xml	? (MO)	68.36	69.0145	1109312

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
csp/lexVg/ normalized-crossword-m1c-lex-vg12-14_ext.xml	? (exit code)	0.014997	0.019705	1111918
csp/wordsVg/ normalized-crossword-m1c-words-vg12-16_ext.xml	? (exit code)	0.019996	0.0266149	1110518
csp/lexVg/ normalized-crossword-m1c-lex-vg16-20_ext.xml	? (exit code)	0.042992	0.0476099	1111878
csp/ukVg/ normalized-crossword-m1c-uk-vg12-16_ext.xml	? (exit code)	0.082986	0.0893519	1110802
csp/lexVg/ normalized-crossword-m1c-lex-vg9-12_ext.xml	? (exit code)	0.18897	0.195474	1111958
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-15_ext.xml	? (exit code)	0.265959	0.276419	1111634
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-20_ext.xml	? (exit code)	0.299954	0.311317	1111594

MAX-CSP 2008 Competition: benchmarks results per solver

Result page for solver toulbar2 2008-06-27

Category "binary constraints in extension" (2-ARY-EXT)

Solver found the best solution (412 runs) [Show/Hide]

Solver timed out (no solution given) (122 runs) [Show/Hide]

Category "n-ary constraints in extension" (N-ARY-EXT)

Solver found the best solution (147 runs) [Show/Hide]

Solver timed out (no solution given) (103 runs) [Show/Hide]

Solver exceeded the memory limit (no solution given) (20 runs) [Show/Hide]

Solver didn't output a solution line and terminated with an unexpected exit code (7 runs) [Show/Hide]

Solver wrongly claimed it found the best solution (1 run) [Show/Hide]