SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT02/industrial/biere/ dinphil/dp04u03.shuffled.cnf	UNSAT	0.012997	0.014671	3498833
application/leberre/ 2dimensionalstrippacking/E07N15.cnf	UNSAT	0.032994	0.0331741	3498784
application/leberre/ 2dimensionalstrippacking/E15N15.cnf	UNSAT	0.084986	0.085427	3498785
SAT02/industrial/goldberg/rand_net/ rand_net60-30-1.shuffled.cnf	UNSAT	0.201968	0.20311	3498825
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-ext_con_032_008_0256-tseitin.cnf	UNSAT	0.350945	0.351807	3498702
APPLICATIONS/bitverif/ minandmaxor/minandmaxor016.cnf	UNSAT	0.377942	0.378768	3498586
SAT02/industrial/goldberg/rand_net/ rand_net60-25-10.shuffled.cnf	UNSAT	0.611906	0.614514	3498827
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-nusmvreactorp4-tseitin.cnf	UNSAT	1.02284	1.02481	3498713
industrial/babic/dspam/ dspam_dump_vc949.cnf	UNSAT	1.13183	1.13102	3498560
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bc57sensorsp1-tseitin.cnf	UNSAT	1.35079	1.3516	3498714
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp3-tseitin.cnf	UNSAT	1.49277	1.4943	3498721
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-bc57sensorsp2-tseitin.cnf	UNSAT	1.91971	1.92078	3498710
application/leberre/ 2dimensionalstrippacking/E03N17.cnf	UNSAT	2.53961	2.54411	3498773
application/leberre/ 2dimensionalstrippacking/E04N18.cnf	UNSAT	2.66459	2.66671	3498781
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvqis8x8p2-tseitin.cnf	UNSAT	3.10153	3.10446	3498708
industrial/babic/hsatv17/ hsat_vc12062.cnf	UNSAT	3.33849	3.33906	3498561
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtswvsam6x8p3-tseitin.cnf	UNSAT	4.23236	4.23583	3498716
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvtms14x8p1-tseitin.cnf	UNSAT	5.78112	5.7825	3498720
APPLICATIONS/diagnosis/ UTI-20-10t0.cnf	UNSAT	5.9421	5.94355	3498614
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns2p3-tseitin.cnf	UNSAT	6.97994	6.98106	3498709
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtswvrod6x8p1-tseitin.cnf	UNSAT	7.1999	7.19802	3498712
application/rintanen/SATPlanning/ grid-strips-grid-y-4.025-NOTKNOWN.cnf	UNSAT	7.41687	7.41951	3498672
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step15.cnf	UNSAT	7.66583	7.66781	3498684
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-bjrb07amba2andenv-tseitin.cnf	UNSAT	7.8988	7.90203	3498703
SAT-Race-2010-CNF/software-verification/ nec/hard-18-U-10652.cnf	UNSAT	8.21075	13.18	3498842
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step11.cnf	UNSAT	8.28574	8.2899	3498682
SAT04/industrial/hoonsang/vis-bmc/ dekker.used-as.sat04-989.cnf	UNSAT	10.2524	10.2539	3498801
SAT-Race-2010-CNF/software-verification/ nec/hard-25-U-7061.cnf	UNSAT	11.5692	11.5709	3498844
SAT-Race-2010-CNF/software-verification/ nec/hard-6-U-7061.cnf	UNSAT	12.6661	12.7511	3498843
industrial/palacios/medium/ blocks-4-ipc5-h21-unknown.cnf	UNSAT	12.7731	13.0324	3498559
application/fuhs/ AProVE11/AProVE11-11.cnf	UNSAT	17.5473	17.5505	3498645
manol-pipe-c6bidw_i.cnf	UNSAT	19.468	19.4694	3498580
industrial/manolios/ manol-pipe-f7idw.cnf	UNSAT	21.1458	21.1506	3498565
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-nlzbe256-tseitin.cnf	UNSAT	21.9487	21.9491	3498696
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtviseisenberg1-tseitin.cnf	UNSAT	28.6536	28.6522	3498711
SAT-Race-2010-CNF/hardware-verification/ manolios/c10idw_i.cnf	UNSAT	30.4874	30.4875	3498836
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtviseisenberg2-tseitin.cnf	UNSAT	31.1073	31.1078	3498722
APPLICATIONS/diagnosis/ ACG-10-10p0.cnf	UNSAT	31.6162	31.6198	3498612
SAT04/industrial/hoonsang/vis-bmc/ all.used-as.sat04-986.cnf	UNSAT	31.7462	31.7509	3498802
industrial/anbulagan/ medium-unsat/dated-5-11-u.cnf	UNSAT	32.643	33.526	3498545
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step13.cnf	UNSAT	37.0924	37.0921	3498686
manol-pipe-f7nidw.cnf	UNSAT	37.3663	37.3707	3498582
application/leberre/ 2dimensionalstrippacking/E02F17.cnf	UNSAT	42.2186	42.2214	3498772
application/leberre/ 2dimensionalstrippacking/E05X15.cnf	UNSAT	56.4414	56.4438	3498780
SAT03/industrial/simon/sat02/ 6pipe_6_ooo.shuffled-as.sat03-413.cnf	UNSAT	58.2022	58.2067	3498787
application/leberre/ 2dimensionalstrippacking/korf-15.cnf	UNSAT	62.1805	62.2099	3498770
SAT02/industrial/goldberg/rand_net/ rand_net60-40-10.shuffled.cnf	UNSAT	62.6705	62.6752	3498826
APPLICATIONS/diagnosis/ UCG-15-5p0.cnf	UNSAT	67.6047	67.6069	3498615
APPLICATIONS/c32sat/ post-c32s-gcdm16-23.cnf	UNSAT	70.0054	70.0126	3498608
application/rintanen/SATPlanning/ blocks-blocks-37-1.120-NOTKNOWN.cnf	UNSAT	86.3279	86.3292	3498648
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.030-NOTKNOWN.cnf	UNSAT	94.9986	95.0005	3498673
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsm5378d2-tseitin.cnf	UNSAT	97.5232	97.52	3498715
APPLICATIONS/bioinfo/ q_query_3_L150_coli.sat.cnf	UNSAT	121.995	127.623	3498610
APPLICATIONS/ bitverif/maxxor/maxxor032.cnf	UNSAT	133.385	133.418	3498598
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step15.cnf	UNSAT	167.518	167.515	3498678
application/manthey/traffic/ traffic_kkb_unknown.cnf	UNSAT	207.501	207.501	3498726
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_063_080-tseitin.cnf	UNSAT	209.592	209.593	3498690
application/manthey/traffic/ traffic_fb_unknown.cnf	UNSAT	215.742	215.743	3498724
application/manthey/traffic/ traffic_b_unsat.cnf	UNSAT	226.225	226.221	3498731
application/manthey/traffic/ traffic_pcb_unknown.cnf	UNSAT	231.689	231.696	3498730
industrial/fuhs/medium/ AProVE07-21.cnf	UNSAT	232.29	232.346	3498553
application/manthey/traffic/ traffic_3b_unknown.cnf	UNSAT	239.93	239.927	3498732
SAT02/industrial/goldberg/rand_net/ rand_net70-60-10.shuffled.cnf	UNSAT	248.336	248.331	3498824
APPLICATIONS/diagnosis/ UCG-15-10p0.cnf	UNSAT	257.519	257.517	3498619
application/rintanen/SATPlanning/ grid-strips-grid-y-3.035-NOTKNOWN.cnf	UNSAT	265.96	265.958	3498669
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k80.cnf	UNSAT	272.241	272.241	3498566
application/manthey/traffic/ traffic_f_unknown.cnf	UNSAT	277.239	277.253	3498727
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k45.cnf	UNSAT	306.454	306.45	3498567
APPLICATIONS/bioinfo/ q_query_3_l46_lambda.cnf	UNSAT	307.347	307.355	3498607
application/jarvisalo/ HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtpmsgoodbakery-tseitin.cnf	UNSAT	318.1	318.109	3498718
manol-pipe-c10nidw.cnf	UNSAT	324.507	324.521	3498578
velev-pipe-o-uns-1.0-7.cnf	UNSAT	398.47	398.47	3498635
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k100.cnf	UNSAT	399.507	399.55	3498569
SAT02/industrial/aloul/ Homer/homer14.shuffled.cnf	UNSAT	407.916	407.928	3498820
industrial/IBM_FV_2002_13_rule_1/ SAT_dat.k20.cnf	UNSAT	427.057	427.236	3498568
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvissoap1-tseitin.cnf	UNSAT	432.572	432.566	3498719
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step20.cnf	UNSAT	589.296	589.284	3498680
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf	UNSAT	612.705	612.715	3498693
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf	UNSAT	644.051	644.051	3498707
APPLICATIONS/diagnosis/ UTI-20-10p0.cnf	UNSAT	851.657	851.64	3498618
application/rintanen/SATPlanning/ blocks-blocks-37-1.130-NOTKNOWN.cnf	UNSAT	951.914	951.901	3498668
SAT03/industrial/schuppan/l2s/ bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf	UNSAT	1143.73	1143.71	3498796
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-13-step17.cnf	UNSAT	1217.45	1217.42	3498689
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-21-step11.cnf	UNSAT	1227.02	1226.99	3498687
velev-pipe-o-uns-1.1-6.cnf	UNSAT	1238.7	1238.68	3498634
industrial/fuhs/hard/ AProVE07-03.cnf	UNSAT	1474.44	1474.4	3498555
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w9.shuffled.cnf	UNSAT	1567.79	1567.74	3498830
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-lfsr_004_127_112-tseitin.cnf	UNSAT	1705.08	1705.09	3498691
SAT02/industrial/dellacherie/ comb/comb1.shuffled.cnf	UNSAT	1789.44	1789.39	3498828
application/rintanen/SATPlanning/ blocks-blocks-36-0.120-NOTKNOWN.cnf	UNSAT	1848.03	1847.98	3498654
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom12.cnf	UNSAT	1877.54	1877.49	3498744
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf	UNSAT	2230.26	2230.19	3498723
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq57_a.cnf	UNSAT	2632.65	2632.58	3498838
industrial/anbulagan/ hard-unsat/dated-10-17-u.cnf	UNSAT	2658.12	2658.02	3498550
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf	UNSAT	2686.32	2686.27	3498804
SAT03/industrial/schuppan/l2s/ valves-gates-1-k617-unsat.shuffled-as.sat03-412.cnf	UNSAT	2700.48	2700.4	3498795
SAT03/industrial/goldberg/hard_eq_check/ c6288mul.miter.shuffled-as.sat03-346.cnf	UNSAT	2841.33	2841.27	3498789
application/leberre/ 2dimensionalstrippacking/korf-17.cnf	UNSAT	3288.58	3288.56	3498779
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf	UNSAT	3554.62	3554.52	3498658
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf	UNSAT	3609.53	3609.46	3498704
SAT-Race-2010-CNF/hardware-verification/ velev/1dlx_c_iq60_a.cnf	UNSAT	3664.13	3664.03	3498837
APPLICATIONS/ bitverif/maxxor/maxxor064.cnf	UNSAT	4039.51	4039.36	3498597
SAT02/industrial/aloul/ Homer/homer16.shuffled.cnf	UNSAT	4296.55	4296.42	3498821
industrial/jarvisalo/ eq.atree.braun.11.unsat.cnf	UNSAT	4343.27	4343.15	3498563
industrial/anbulagan/ hard-unsat/dated-5-13-u.cnf	UNSAT	4465.05	4465.06	3498552
industrial/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq7.cnf	UNSAT	4539.33	4540.91	3498572
industrial/anbulagan/ hard-unsat/total-10-17-u.cnf	UNSAT	4833.65	4833.54	3498549
velev-vliw-uns-4.0-9-i1.cnf	UNSAT	4911.63	4911.55	3498577

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
SAT05/industrial/maris05/DriverLog/ driverlog1_ks99i.renamed-as.sat05-3951.cnf	SAT	0.006998	0.00856108	3498814
SAT02/industrial/aloul/ Bart/bart17.shuffled.cnf	SAT	0.008998	0.011153	3498819
SAT05/industrial/maris05/DriverLog/ driverlog3_v01a.renamed-as.sat05-3963.cnf	SAT	0.009997	0.012144	3498815
application/kullmann/AES/Benchmarks/ 32/aes_32_1_keyfind_1.cnf	SAT	0.015997	0.019339	3498766
SAT02/industrial/biere/ dinphil/dp04s04.shuffled.cnf	SAT	0.017996	0.0204479	3498831
SAT05/industrial/maris05/Rovers/ rovers1_ks99i.renamed-as.sat05-3971.cnf	SAT	0.020996	0.0214611	3498816
SAT05/industrial/maris05/Ferry/ ferry5_ks99i.renamed-as.sat05-3994.cnf	SAT	0.037993	0.039691	3498817
SAT02/industrial/biere/ dinphil/dp10s10.shuffled.cnf	SAT	0.330949	0.331207	3498832
SAT02/industrial/goldberg/fpga_routing/ vda_gr_rcs_w9.shuffled.cnf	SAT	0.446931	0.449664	3498823
application/fuhs/ AProVE11/AProVE11-12.cnf	SAT	0.798877	0.798496	3498637
application/jarvisalo/ AAAI2010-SATPlanning/aaai10-planning-ipc5-rovers-18-step12.cnf	SAT	1.02084	1.02263	3498685
application/fuhs/ AProVE11/AProVE11-09.cnf	SAT	1.19682	1.19775	3498641
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_15_SAT.cnf	SAT	1.38879	1.394	3498629
APPLICATIONS/diagnosis/ UTI-10-5t1.cnf	SAT	1.63275	1.63477	3498616
application/fuhs/ AProVE11/AProVE11-16.cnf	SAT	1.78073	1.78047	3498639
SAT04/industrial/vangelder/cnf-color/ abb313GPIA-9-tr.used-as.sat04-321.cnf	SAT	1.81772	1.82115	3498798
application/leberre/ 2dimensionalstrippacking/E05F18.cnf	SAT	1.9407	1.94382	3498775
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbsharemodes_vc5759-tseitin.cnf	SAT	3.22551	3.22693	3498700
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-src_wget_vc18517-tseitin.cnf	SAT	3.48147	3.49037	3498694
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libmsrpc_vc1225336-tseitin.cnf	SAT	3.60245	3.60382	3498699
application/fuhs/ AProVE11/AProVE11-02.cnf	SAT	4.28435	4.29023	3498646
application/fuhs/ AProVE11/AProVE11-07.cnf	SAT	4.32734	4.33262	3498640
APPLICATIONS/diagnosis/ UTI-20-10t1.cnf	SAT	4.92725	4.92818	3498625
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_18_SAT.cnf	SAT	4.99624	5.57828	3498627
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-bin_libsmbclient_vc1228502-tseitin.cnf	SAT	5.59615	5.61333	3498697
application/manthey/ traffic/traffic_r_sat.cnf	SAT	8.77467	8.78093	3498729
application/fuhs/ AProVE11/AProVE11-10.cnf	SAT	9.02463	9.02775	3498642
application/fuhs/ AProVE11/AProVE11-13.cnf	SAT	9.27259	9.27428	3498644
application/kullmann/AES/Benchmarks/ 32/aes_32_2_keyfind_1.cnf	SAT	11.6792	11.6794	3498765
velev-pipe-sat-1.0-b9.cnf	SAT	11.9372	11.9401	3498633
SAT05/industrial/grieu05/vmpc/ vmpc_25.renamed-as.sat05-1913.cnf	SAT	12.4991	12.5021	3498810
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug5.cnf	SAT	14.8067	14.8211	3498573
application/fuhs/ AProVE11/AProVE11-15.cnf	SAT	17.1414	17.1438	3498638
SAT_RACE08/Q1/ SAT_dat.k80_04.cnf	SAT	17.5263	17.5343	3498576
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-rfunit_flat-64-tseitin.cnf	SAT	19.544	19.5451	3498695
ibm-2002-21r-k95.cnf	SAT	20.2399	20.2425	3498636
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.085-SAT.cnf	SAT	20.3279	20.347	3498651
APPLICATIONS/crypto/ desgen/gss-14-s100.cnf	SAT	21.2008	21.32	3498604
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug6_q0.used-as.sat04-725.cnf	SAT	25.5141	25.5155	3498806
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-18-step16.cnf	SAT	28.5237	28.5306	3498683
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-27-step14.cnf	SAT	28.7616	28.7733	3498681
APPLICATIONS/diagnosis/ UR-10-10p1.cnf	SAT	35.1097	35.1152	3498623
application/rintanen/SATPlanning/ blocks-blocks-36-0.160-NOTKNOWN.cnf	SAT	36.2355	36.2446	3498676
velev-npe-1.0-9dlx-b71.cnf	SAT	36.6914	36.7088	3498632
application/rintanen/SATPlanning/ blocks-blocks-36-0.180-SAT.cnf	SAT	38.0702	38.1081	3498653
application/rintanen/SATPlanning/ blocks-blocks-36-0.170-NOTKNOWN.cnf	SAT	38.1052	38.1117	3498656
APPLICATIONS/c32sat/ post-cbmc-zfcp-2.8-u2-noholes.cnf	SAT	39.726	39.8958	3498609
application/rintanen/SATPlanning/ blocks-blocks-37-1.150-SAT.cnf	SAT	42.1596	42.1606	3498671
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pipesworld-12-step16.cnf	SAT	44.7802	44.7815	3498677
SAT04/industrial/velev/pipe-sat-1-1/ 12pipe_bug4_q0.used-as.sat04-723.cnf	SAT	44.8202	44.834	3498807
application/leberre/ 2dimensionalstrippacking/E04F19.cnf	SAT	50.2684	50.2733	3498774
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-TPP-30-step11.cnf	SAT	52.2641	52.2682	3498679
SAT05/industrial/grieu05/vmpc/ vmpc_29.renamed-as.sat05-1916.cnf	SAT	54.8087	54.8102	3498809
industrial/vliw_sat_4.0/ 9vliw_m_9stages_iq3_C1_bug6.cnf	SAT	58.5951	58.598	3498574
application/leberre/ 2dimensionalstrippacking/E05F20.cnf	SAT	59.441	59.4459	3498786
ibm-2004-01-k90.cnf	SAT	63.2304	63.3472	3498584
APPLICATIONS/bioinfo/ q_query_3_L70_coli.sat.cnf	SAT	71.5331	71.5476	3498611
industrial/anbulagan/ hard-sat/partial-10-15-s.cnf	SAT	73.1249	73.1425	3498547
APPLICATIONS/diagnosis/ ACG-15-5p1.cnf	SAT	82.8724	82.8855	3498624
application/leberre/ 2dimensionalstrippacking/E04F20.cnf	SAT	91.7321	91.7343	3498778
APPLICATIONS/crypto/ desgen/gss-19-s100.cnf	SAT	103.525	103.531	3498606
APPLICATIONS/crypto/ desgen/gss-16-s100.cnf	SAT	117.169	117.173	3498601
application/rintanen/SATPlanning/ transport-transport-two-cities-sequential-15nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.040-SAT.cnf	SAT	207.387	207.393	3498661
application/leberre/ 2dimensionalstrippacking/E02F20.cnf	SAT	238.166	238.162	3498771
ibm-2004-23-k100.cnf	SAT	300.016	300.014	3498581
industrial/palacios/medium/ cube-11-h14-sat.cnf	SAT	336.92	336.915	3498558
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k80.cnf	SAT	378.736	378.751	3498570
SAT05/industrial/grieu05/vmpc/ vmpc_32.renamed-as.sat05-1919.cnf	SAT	402.007	402.011	3498811
APPLICATIONS/diagnosis/ UCG-20-5p1.cnf	SAT	500.423	503.118	3498620
application/leberre/ 2dimensionalstrippacking/E02F22.cnf	SAT	508.799	508.788	3498777
industrial/IBM_FV_2004_30/ IBM_FV_2004_rule_batch_30_SAT_dat.k55.cnf	SAT	537.852	537.84	3498571
application/rintanen/SATPlanning/ transport-transport-city-sequential-25nodes-1000size-3degree-100mindistance-3trucks-10packages-2008seed.060-SAT.cnf	SAT	645.912	645.898	3498674
application/manthey/traffic/ traffic_3_uc_sat.cnf	SAT	801.074	801.067	3498728
application/jarvisalo/AAAI2010-SATPlanning/ aaai10-planning-ipc5-pathways-17-step21.cnf	SAT	941.679	941.7	3498688
APPLICATIONS/diagnosis/ UCG-15-10p1.cnf	SAT	1009.9	1009.9	3498613
SAT-Race-2010-CNF/cryptography/ mizh/md5_48_3.cnf	SAT	1053.04	1053.02	3498835
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	1228.2	1228.17	3498650
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf	SAT	1901.51	1901.54	3498663
SAT05/industrial/grieu05/vmpc/ vmpc_34.renamed-as.sat05-1926.cnf	SAT	1914.58	1914.52	3498808
ibm-2002-30r-k85.cnf	SAT	2109.75	2109.71	3498583
application/kullmann/AES/Benchmarks/ 32/aes_32_3_keyfind_1.cnf	SAT	2168.68	2168.64	3498769
SAT_RACE08/Q1/ SAT_dat.k85.cnf	SAT	2329.18	2329.14	3498575
APPLICATIONS/diagnosis/ UTI-20-10p1.cnf	SAT	2447.44	2447.41	3498621
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf	SAT	2556.24	2556.17	3498662
SAT05/industrial/grieu05/vmpc/ vmpc_35.renamed-as.sat05-1921.cnf	SAT	2965.45	2965.35	3498812
application/rintanen/SATPlanning/ transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	SAT	3573.66	3573.53	3498657
application/manthey/traffic/ traffic_r_uc_sat.cnf	SAT	3948.05	3947.95	3498725
SAT05/industrial/narain05/vpn/ clauses-8.renamed-as.sat05-1964.cnf	SAT	4090.62	4090.57	3498818
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf	SAT	4339.42	4339.22	3498675
SAT05/industrial/grieu05/vmpc/ vmpc_36.renamed-as.sat05-1922.cnf	SAT	4673.92	4673.8	3498813
industrial/palacios/hard/ sortnet-8-ipc5-h19-sat.cnf	SAT	4933.57	4933.46	3498557

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom25.cnf	? (TO)	5000	4999.91	3498737
application/kullmann/AES/Benchmarks/ 64/aes_64_3_keyfind_1.cnf	? (TO)	5000	4999.91	3498764
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom26.cnf	? (TO)	5000	4999.91	3498735
SAT04/industrial/vangelder/ cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf	? (TO)	5000	4999.91	3498799
application/kullmann/AES/Benchmarks/ 128/aes_128_3_keyfind_1.cnf	? (TO)	5000	4999.91	3498757
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf	? (TO)	5000	4999.91	3498698
APPLICATIONS/bitverif/ minxorminand/minxorminand128.cnf	? (TO)	5000.01	4999.81	3498585
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf	? (TO)	5000.01	4999.81	3498717
SAT03/industrial/li/li-test4/ li-test4-100.shuffled-as.sat03-370.cnf	? (TO)	5000.01	4999.81	3498793
SAT04/industrial/vangelder/cnf-color/ myciel6-tr.used-as.sat04-320.cnf	? (TO)	5000.01	4999.91	3498800
SAT-Race-2010-CNF/hardware-verification/ velev/2dlx_ca_bp_f_liveness.cnf	? (TO)	5000.01	4999.91	3498840
APPLICATIONS/diagnosis/ UR-20-10p1.cnf	? (TO)	5000.02	5000.01	3498622
APPLICATIONS/bitverif/ maxxororand/maxxororand064.cnf	? (TO)	5000.02	5000.01	3498592
industrial/anbulagan/ hard-sat/partial-10-17-s.cnf	? (TO)	5000.02	4999.91	3498546
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf	? (TO)	5000.02	4999.91	3498803
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_11_ooo.cnf	? (TO)	5000.02	5000.01	3498839
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom22.cnf	? (TO)	5000.02	4999.91	3498753
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_08_UNSAT.cnf	? (TO)	5000.02	4999.91	3498626
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf	? (TO)	5000.03	4999.91	3498659
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom17.cnf	? (TO)	5000.03	4999.91	3498754
application/leberre/ 2dimensionalstrippacking/E00X23.cnf	? (TO)	5000.03	4999.91	3498782
industrial/anbulagan/ hard-unsat/partial-5-11-u.cnf	? (TO)	5000.03	4999.91	3498551
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top29.cnf	? (TO)	5000.03	4999.91	3498746
application/kullmann/AES/Benchmarks/ 128/aes_128_10_keyfind_1.cnf	? (TO)	5000.03	4999.91	3498760
APPLICATIONS/crypto/ md5gen/gus-md5-12.cnf	? (TO)	5000.03	4999.91	3498599
APPLICATIONS/satComp09_BioInstances/ ndhf_xits_19_UNKNOWN.cnf	? (TO)	5000.03	4999.91	3498630
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom13.cnf	? (TO)	5000.03	4999.91	3498743
APPLICATIONS/crypto/ md5gen/gus-md5-11.cnf	? (TO)	5000.03	4999.91	3498600
industrial/palacios/hard/ sortnet-7-ipc5-h15-unsat.cnf	? (TO)	5000.04	5000.21	3498556
APPLICATIONS/bitverif/ maxor/maxor128.cnf	? (TO)	5000.04	4999.91	3498594
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-countbits128-tseitin.cnf	? (TO)	5000.04	5000.11	3498701
SAT-Race-2010-CNF/cryptography/ mizh/sha0_36_5.cnf	? (TO)	5000.04	4999.91	3498834
SAT04/industrial/velev/vliw_unsat_2.0/ 9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf	? (TO)	5000.04	4999.91	3498805
SAT03/industrial/schuppan/l2s/ dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf	? (TO)	5000.04	5000.01	3498797
APPLICATIONS/bitverif/countbitsrotate/ countbitsrotate032.cnf	? (TO)	5000.04	4999.81	3498588
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf	? (TO)	5000.04	4999.91	3498652
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf	? (TO)	5000.04	4999.91	3498655
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top21.cnf	? (TO)	5000.04	4999.91	3498741
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top22.cnf	? (TO)	5000.04	4999.91	3498739
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf	? (TO)	5000.04	4999.91	3498660
application/kullmann/AES/Benchmarks/ 64/aes_64_4_keyfind_1.cnf	? (TO)	5000.04	4999.91	3498761
APPLICATIONS/crypto/ desgen/gss-21-s100.cnf	? (TO)	5000.04	4999.91	3498605
application/kullmann/AES/Benchmarks/ 32/aes_32_5_keyfind_1.cnf	? (TO)	5000.04	4999.81	3498767
industrial/anbulagan/ hard-sat/partial-10-13-s.cnf	? (TO)	5000.04	5000.01	3498548
APPLICATIONS/bitverif/countbitswegner/ countbitswegner128.cnf	? (TO)	5000.04	4999.91	3498593
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom14.cnf	? (TO)	5000.04	4999.91	3498749
SAT02/industrial/nam/fpga-routing/ k2fix_gr_rcs_w8.shuffled.cnf	? (TO)	5000.05	4999.91	3498829
SAT03/industrial/li/li-exam/ li-exam-61.shuffled-as.sat03-366.cnf	? (TO)	5000.05	4999.91	3498792
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom24.cnf	? (TO)	5000.05	4999.91	3498734
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top26.cnf	? (TO)	5000.05	5000.01	3498733
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf	? (TO)	5000.05	4999.91	3498706
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.080-SAT.cnf	? (TO)	5000.05	4999.91	3498667
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.035-NOTKNOWN.cnf	? (TO)	5000.05	4999.91	3498666
application/leberre/ 2dimensionalstrippacking/korf-18.cnf	? (TO)	5000.05	4999.91	3498776
application/jarvisalo/smtqfbv-aigs/ smtlib-qfbv-aigs-servers_slapd_a_vc149789-tseitin.cnf	? (TO)	5000.06	4999.91	3498692
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top30.cnf	? (TO)	5000.06	4999.91	3498750
SAT03/industrial/goldberg/hard_eq_check/ x1mul.miter.shuffled-as.sat03-359.cnf	? (TO)	5000.06	4999.91	3498790
APPLICATIONS/bitverif/ countbitssrl/countbitssrl064.cnf	? (TO)	5000.06	4999.91	3498589
application/leberre/ 2dimensionalstrippacking/E00N23.cnf	? (TO)	5000.06	4999.91	3498783
application/kullmann/AES/Benchmarks/ 64/aes_64_2_keyfind_1.cnf	? (TO)	5000.06	4999.91	3498762
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom16.cnf	? (TO)	5000.06	5001.51	3498752
application/kullmann/AES/Benchmarks/ 128/aes_128_1_keyfind_1.cnf	? (TO)	5000.06	4999.91	3498759
industrial/fuhs/hard/ AProVE07-01.cnf	? (TO)	5000.06	4999.91	3498554
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom21.cnf	? (TO)	5000.06	4999.91	3498755
APPLICATIONS/bitverif/countbitsarray/ countbitsarray04_32.cnf	? (TO)	5000.06	5000.01	3498595
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.060-NOTKNOWN.cnf	? (TO)	5000.07	4999.91	3498649
industrial/crypto/ mizh-sha0-36-2.cnf	? (TO)	5000.07	4999.91	3498564
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top23.cnf	? (TO)	5000.07	4999.91	3498740
APPLICATIONS/ bitverif/maxxor/maxxor128.cnf	? (TO)	5000.07	5000.31	3498596
SAT03/industrial/maris/CNF/ gripper13u.shuffled-as.sat03-395.cnf	? (TO)	5000.07	4999.91	3498788
industrial/jarvisalo/ eq.atree.braun.12.unsat.cnf	? (TO)	5000.08	4999.91	3498562
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top25.cnf	? (TO)	5000.08	5000.01	3498747
application/kullmann/AES/Benchmarks/ 64/aes_64_1_keyfind_1.cnf	? (TO)	5000.08	4999.91	3498763
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom19.cnf	? (TO)	5000.08	4999.91	3498745
application/rintanen/SATPlanning/ transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf	? (TO)	5000.08	5000.01	3498670
APPLICATIONS/satComp09_BioInstances/ rbcl_xits_09_UNKNOWN.cnf	? (TO)	5000.08	5000.21	3498631
SAT03/industrial/kukula/addm_bench/ am_7_7.shuffled-as.sat03-363.cnf	? (TO)	5000.08	5000.01	3498794
APPLICATIONS/satComp09_BioInstances/ rpoc_xits_09_UNSAT.cnf	? (TO)	5000.08	5000.01	3498628
APPLICATIONS/diagnosis/ UR-20-10p0.cnf	? (TO)	5000.08	5005.61	3498617
APPLICATIONS/crypto/ desgen/gss-22-s100.cnf	? (TO)	5000.08	5000.01	3498602
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf	? (TO)	5000.08	5000.01	3498665
application/kullmann/AES/Benchmarks/ 128/aes_128_2_keyfind_1.cnf	? (TO)	5000.08	4999.91	3498758
APPLICATIONS/crypto/ desgen/gss-27-s100.cnf	? (TO)	5000.09	5000.01	3498603
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom18.cnf	? (TO)	5000.09	5000.01	3498751
SAT-Race-2010-CNF/hardware-verification/ velev/11pipe_k.cnf	? (TO)	5000.09	5006.61	3498841
APPLICATIONS/bitverif/ minandmaxor/minandmaxor128.cnf	? (TO)	5000.09	5000.01	3498587
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom20.cnf	? (TO)	5000.09	5000.01	3498738
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom15.cnf	? (TO)	5000.09	5000.01	3498736
SAT03/industrial/goldberg/hard_eq_check/ k2mul.miter.shuffled-as.sat03-355.cnf	? (TO)	5000.09	4999.91	3498791
APPLICATIONS/bitverif/ smulo/smulo064.cnf	? (TO)	5000.09	5000.01	3498591
application/rintanen/SATPlanning/ openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf	? (TO)	5000.1	5000.01	3498664
application/fuhs/ AProVE11/AProVE11-06.cnf	? (TO)	5000.1	5000.01	3498643
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-bottom23.cnf	? (TO)	5000.1	5000.01	3498756
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top28.cnf	? (TO)	5000.1	4999.91	3498748
application/jarvisalo/HWMCC10-combination-timeframe-expansion/ hwmcc10-timeframe-expansion-k45-pdtpmspalu-tseitin.cnf	? (TO)	5000.1	5000.01	3498705
mizh-sha0-36-4.cnf	? (TO)	5000.1	5000.11	3498579
application/fuhs/slp-synthesis-AES/ slp-synthesis-aes-top24.cnf	? (TO)	5000.1	5000.21	3498742
application/rintanen/SATPlanning/ sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf	? (TO)	5000.1	5000.01	3498647
SAT02/industrial/aloul/ Homer/homer17.shuffled.cnf	? (TO)	5000.11	5000.01	3498822
APPLICATIONS/bitverif/ mulhs/mulhs016.cnf	? (TO)	5000.12	5000.01	3498590
application/kullmann/AES/Benchmarks/ 32/aes_32_4_keyfind_1.cnf	? (TO)	5000.13	5000.01	3498768

SAT 2011 Competition: main competition (phase 2): benchmarks results per solver

Result page for solver EBGlucose 1.0 (incomplete)

Category "applications instances" (APPLICATION)

Solver proved unsatisfiability (UNSATISFIABLE) (108 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) (91 runs) [Show/Hide]

Solver timed out (no solution given) (101 runs) [Show/Hide]